The CVApps packager is now able to take into account an external properties file and to replace the value found in it into predefined placeholders set in configuration files during the deployment process (#26005). The goal is to be able, from a single application zip file, to target multiple deployment environments.
For instance, you can add a placeholder myPath in the path value of a file connector in the Connector.xml configuration file:
... <KeyValue description="Define root paths to crawl (file, smb or ftp)" key="FilesystemRootPaths"> <KeyValue key="0"> <KeyValue value="${MY_PATH}" key="RootKey"/> ...
Set a value for that property in a properties file and use it when deploying your application with the CVApps installer.
... MY_PATH=/data/source1/myFiles ...
Support of Partial update for Consolidation Server
Partial update is now supported by the consolidation server, without impacts on performances. You can use the updateDocument command to push a partial meta set of a document. Please carefully notice that if you directly push link directives within a document, you will also have to send those directives again within the partial update command. If link creation is handled only with transformation processors, then partial update will be fully supported.
Replay Server/Connector component (Beta version)
A new component is available in this release: the Replay server. This component allows the capture of a document flow that is sent to a PushAPI and to be able to "replay" it, fully or partially, later on. For more details, see the "Replay Connector" section in CloudView Connectors Guide.
Please be aware that this feature is beta and should not be deployed in a production environment.
Other Improvements
Connectors
• Crawler: add log messages in debug mode when fetching a document from a crawler box (#26195)
Consolidation server
• Default compacter configuration for consolidation server does not lead to unreasonable slots number anymore (#25827).
• Parallel compaction for compact job is activated to ensure not to stack up too many uncompacted generations when a major compact job occurs (#25794).
• The "Force Aggregation" operation behaves as a "Commit" (#25907) by default, meaning that the storage is considered as fully aggregated at the end of the operation. This behavior occurs only when there is no specific type nor uri targets set.
Core
• Greatly improved groupBy performance in the case of a groupBy on a Long, optionally with a sum aggregation (#25832). Average gain is a factor 2 on the groupBy operation latency.
• Change default keepAlive and http maxConnections settings to reduce risk of ephemeral port exhaustion (#25766)
• When having a lot of fields in the datamodel configuration, applying configuration is less time consuming (#25779)
• Compacter is not driven only by the importer and will check for better slots optimization by itself (#25810)
• Reduce ItemStore size when dealing with empty collection of alphanum (#26126)
• Reduce ItemStore size when dealing with dynamic properties (#26111)
• Switch default configuration of the DIH from "auto" to "mmap" (#26173)
• Add a MAMI command to know when a dict is built and ready to use (#25785)
• Add a MAMI command to know when a dict is cleared (#25786)
Indexing
• In the .NET PAPI client, it is possible to use session concept (PushAPISession) to guarantee session and detect error when pushing document (#25917)
Search
• Date formater configuration is available for a date prefix handler (#23059). If you don't want the product to discover by itself the date format or if you want to set a custom one, it is possible to specify it on the date prefix handler in the Search Logic configuration.
• Emits a log when maximum number of threads in Jetty has been reached to better understand SearchServer blocking case (#25857)
• Suggest dispatcher can target a dynamic properties prefix handler with or without meta name (#25245)
• Dynamic range facet provides also open ranges (#25043). Computed interval when using Open range option have the following boundaries "[$;$[". This option provides better results accuracy.
Administration Console
• Clear old configuration files is available in the "Versions" page of the Admin UI (#25972). To reduce space taken by old versions of CloudView configuration, it is possible to keep only the last versions and delete older ones.
• The "detect title" option used for categories is available for a data model property in the advanced faceting options (#25664)
• When a dynamic property is used to support a standard property, it is not possible to delete it (#25755)
• Drop-down list reviewed when adding properties (#25861)
• It is possible to define a semantic type that does not imply a mapping on a dictionary (#22558)
• Doctor CloudView emits an alert when the number of slots of a build group is too high and might benefit from a full compact operation (#20358)
• Review consistency behavior of sort and reverse sort and sort help in the UI (#15245)
• Number of searchable documents for a build group is more accurate (#25768). Discarded documents can be deducted using the Pushed documents value.
• When a configuration change cannot be applied without clearing build group first, the warning message is also kept on the build group status (#19519)
• Field type options when adding a property in the datamodel allow to target dedicated and dynamic fields (#25751)
• Improve synthesis speed for deep category tree when a maxCategoryTreeDepth has been set (#25831)
Convert
• Better thumbnails generated for pathological xls (#25784).
• The advanced document conversion feature (DCV license) supports MS-Project format (#22656) and Visio format (#22655)
• Preview improvement to avoid superposition effect for all OCRized pdf (#25619)
• HTML Parser handle main HTML5 new tags (#26085)
Mashup Builder / UI
• A more recent version of jQuery (1.12.3) is now shipped with the product. If you wants to use this release of jQuery, change the included javascript files in your application properties (#25368)
• User timezone can be detected automatically using a new available pre-request trigger and pushed as a parameter of a feed (#25670). Check upgrade notes below for more details.
Business Console
• When testing a semantic resource that is not part of a pipeline, the tokenizer used is the default one set on the resource configuration (#25883)
• Reporting store for queries analysis has a default rotation policy (#18539)
Upgrade notes
CloudView R2016x and R2016x R1 configurations are fully compatible with CloudView R2016x R2.
Mashup Builder: user timezone detection
To benefit from this feature inside an existing Mashup application,the following operations are needed:
In the application properties of your application, section General > JavaScript, add the following entries:
• /resources/javascript/jquery.cookie.js
• /resources/javascript/timezone.js
Add a new trigger in the application trigger page section:
Open a page and choose the Design tab Drop in the application page trigger section the trigger "Cookie to parameter" (it can be found in Triggers > Pre Request trigger section)
Set the following parameter for the trigger: Parameter name : timezone Cookie name: mashup-timezone
For each feed that requires to push the user timezone information, add the following configuration:
In theAdvanced Parameters section, set Timezone Parameter to ${page.params['timezone']}
Major fixed issues
Ticket
Title
Existing since
Status
Component
#25988
Allow overriding of the CloudviewBasedSecurityProvider class
V6R2016x
closed
360/Mashup UI & API
#25872
Widgets depending on external url should not use explicit protocol for inclusion
Prehistoric defect
closed
360/Mashup UI & API
#25926
Race condition preventing MashupUI reporting from correctly working
V6R2013x
closed
360/Mashup UI & API
#26176
Storage client throws a NumberFormatException when enumerating an entry with an empty key
Prehistoric defect
closed
360/Mashup UI & API
#25978
Not possible anymore to share dynamic properties of parent class using Admin UI
V6R2016x.R1
closed
Admin-ui
#25977
OutOfMemory in gateway when using UTF8 chars above "0xFFFF" in AdminUI or Api-UI
V6R2015x.SP3
closed
Config system / APIs
#24550
JDBC Connector: a ForceFullRescan uses incremental query instead of initial query
V6R2014x.SP4
closed
Connectors / Connector JDBC
#26042
On windows, Garbage Collector can delete matching expression rules files and thus break impact detection mechanisms
V6R2015x.SP4
closed
Consolidation
#26045
Avoid printing alarmist wrong messages about aspose during indexing process
V6R2014 GA
closed
Convert
#24353
Hotfix installation does not keep execution permission of files
Prehistoric defect
qa
Generic
#25968
Gateway deadlock while rotating collection in Sqlite server
Prehistoric defect
closed
Generic
#19646
Crash of indexingserver while building with BasisTech
V6R2016x.R1
closed
Indexing
#25923
Crash: 'offset - 1 == _currentOffset && "Must be always use as iterator"' failed at com/exalead/ds/itemstore/SegmentMover.cpp:465
V6R2016x
closed
Indexing
#26059
Migration of RelatedTerms from 15x to 16x was not done for indexingserver that was not located on master host
V6R2016x
closed
Migration
#26125
Searchserver crash on synthesisTreeBuilder
V6R2014 SP2
closed
Search
#25750
Synthesis on sparse Related termes with query including timestamp restriction have a performance issue
V6R2015x.SP1
qa
Search
#25830
Synthesis with timestamp restriction have a performance issue
V6R2016x
qa
Search
#25966
Prefix query on pattern search on dynamic fields is not working
V6R2016x.R1
closed
Search
#25980
Slice crash for some 2D synthesis
V6R2016x.R1
closed
Search
#26179
Leak when using #strnormalize or when sorting on normalized form
V6R2015x.SP2
closed
Search
#25886
Crash of SearchServer: 'rootCat==0x0' failed synthesisTreeBuilder
V6R2014x.SP4
closed
Search
#26082
Rapid memory consumption on indexingServer with NamedEntitiesExtraction NE-all
V6R2014x
closed
Semantic
#26009
IndexingServer possible crash on invalid UTF-8
Prehistoric defect
closed
Semantic
#25549
Cannot install deployment package in 2016x due to concurrent configuration detected
V6R2016x
closed
Tools
#26169
CVApps: the Deployment.xml should be deployed with the rest of the configuration
Prehistoric defect
closed
Tools
Other fixed issues
Ticket
Title
Existing since
Composant
#22724
Install application does not install plugins
V6R2014x.SP3
360/Mashup UI & API
#25833
javascript error on pivotTable widget
Prehistoric defect
360/Mashup UI & API
#26025
Mashup UI SDK: process start in tomcat but with a bunch of exceptions
V6R2016x
360/Mashup UI & API
#25681
Fix broken checks preventing you from removing some index fields in admin UI
Prehistoric defect
Admin-ui
#26243
For a Template prefix handler, the "Default prefix handler" option is not available in the Admin UI
V6R2015x.SP4
Admin-ui
#25997
Name confusion when reading "indexed documents" in admin-ui
V6R2016x
Admin-ui
#25882
Missing [AnyToken] element in rules graphical editor of business console
V6R2014x
Business Console
#23297
tablespace TEMP Oracle error does not end the JDBC connector scan
V6R2013x.SP2
Connectors / Connector JDBC
#25850
SharepointX connector fails to start when deployed on a consolidation server
V6R2016x
Connectors / Connector Microsoft SharePoint
#19990
IOException in admin console when clearing a crawler
V6R2013x.SP3
Crawler
#25888
Resource manager: no error if trying to rollback or delete an unexisting version
Prehistoric defect
Generic
#25896
MaxAge/Size to logs when building a cvdiag is not respeected for subfolders of searchserver
Prehistoric defect
Generic
#25986
After Apps install, the Mashup Builder still has old config loaded
V6R2016x.R1
Generic
#26151
Incorrect error message when executing dump-rdict command on a value field