Previous Release Notes : R2015x.SP4
 
R2015x.SP4
 
What's New
Other Improvements
Upgrade notes
Major fixed issues
Other fixed issues
What's New
This release does not introduce any major change but focuses instead on two major goals:
Ensuring robustness & performance of the Consolidation Server component 
Minor enhancements on existing features.
For Consolidation Server, compared to CloudView 2015x.SP3, the Transformation step can be up to 10 times faster and the Aggregation step can be up to 3 times faster.
Managed Documents are created much quicker.
We have also extended our test coverage on industry related use cases.
Please read carefully the Other Improvements section below.
Other Improvements
Connectors
XML connector: in split mode, the XML connector should not re-index a file if it has not been modified (#24008)
Lotus Notes connector: support of dates before 1902 and after 2037 for Lotus Notes proxy level 1.6 and higher (#24352)
Platform
Consolidation server
Performance & Robustness
Filter on forwarded document type before passing them to the right forward pool (#24766)
Avoid loading payload for each document matched when not necessary (#24774)
Handle connector clear on a large volume of deleted documents with less impact on memory (#24778)
Optimize adjacent vertices collections (#24579)
Optimize GDS Trie enumerations (#24634)
Load virtual vertex arcs from disk only if we there are no arcs pointing to/from it in memory (#24565)
Processors
isFetchOperation is exposed for Java Aggregation processor (in the ICreateAggregationHandler interface) (#24589)
Methods added to delete parts or parts metas for Groovy and Java processors (#24402)
In the PushAPITransformationHelpers the createChildDocumentAndGet method returns the created child document's URI (#24704)
The PushAPITransformationHelpers provide a method to add an arc between two vertices not bound to the current PAPI document (#24657)
Beware, in that case, the ownership of the arc is taken by the first vertex, not the PAPI document, meaning that if this particular vertex is modified, the arc will be deleted automatically.
The same operation should be pushed once again to recreate the arc.
Introspection UI
Better highlighting of the current node in the introspection graph (#24396)
Text copy/selection on payload information is enabled (#24525)
Monitoring
Consolidation server monitoring graphs are clearer and provide more relevant information (#24712)
Admin UI
The Setup UI proposes the Consolidation Server installation with basic configuration (#21084)
Consolidation config is editable without having a Consolidation Server deployed (#24407)
Improved home page monitoring for Consolidation Server (#24491)
When dealing with a large number of properties in data model, pagination is enabled on related pages(#24530)
The "About CloudView" page is providing the list of deployed hotfixes if any (#24645)
Indexing
It is possible to store a meta inside a dynamic property declared on a parent class (#24912)
This feature will help to lower the number of physical fields used by the index and thus lower the number of IOs.
It is possible to delete a document via the Push API using delete by "Prefix" instead of "RootPath" (#24745). This can be useful if children document URIs are not built using a "/" as separator.
This method has to be used with care by the Push API client because it has to handle the separator on its side.
eno:bo:masterpart eno:bo:masterpart:subpart1 eno:bo:master eno:bo:master:subpart2
 
Sending deleteFromPrefix("eno:bo:master") will delete all above documents even if the intention was to only delete eno:bo:master and eno:bo:master:subpart2 .
New condition behavior for "Copy Context Chunk" document processor to select only a subset of values from a multi-valued field (#24201)
attach_1cca9b85b156e38ad0321bb52eb3a72e
Index RAM consumption has been greatly reduced when using a lot of slots and a lot of different category/value names (#24249)
 
Search
Geo queries performance has been improved (#23196). The gain goes from a factor of 2 for small dataset up to a factor of 10 for large ones (above millions of documents)
Adding {hl=0} to an arbitrary node in ELLQL or UQL prevents the associated subquery from being used for summary/highlight (#24402).
This option can be useful when query restrictions are not supposed to be visible from the user side (which can occur in case of unwanted highlighting)
Add a backslash syntax in UQL to disable special interpretation of UQL operators (parentheses, =, {, }, etc.) (#24572)
Template prefix handler can be used inside a query template to execute a query rewriting just after parsing (#24532)
For example, with the following definition:
<TemplatePrefixHandler name="myTemplatePH" aliases="myTPh,my_tph" template="categories:\"path/here\" AND title:(__QUERY__)">
the query:
foo AND my_tph:bar
will be rewritten as follows:
foo AND categories:"path/here" AND title:(bar)
When using #innerjoin in ELLQL , it is possible to consolidate ranking key from left and right member of the join (#24909)
Semantics
As language detector processor may output several relevant languages, it is possible to limit the number of detected languages that are kept (#22853)
When activating semantic query analysis on a search logic, setting the singleMatch option to false allow all rules to trigger simultaneously and not only the most relevant ones (#24273)
This option is directly available in configuration files.
Add an annotation "lemma" in Form Indexing config to take into account all forms when a Basistech tokenizer and a lemmatizer processor are specified in the analysis pipeline (#24411).
Alerting
Alerts (id or name) producing error when compiling alert rules are written in log file (#24486)
Alerts having a syntax not supported by the FastRuleBuilder are explicitly logged (#24387)
Look for "Unable to convert ELLQL to FastRule for alert(s)" in log files
Tools
From the cvconsole, it is possible to dump every used dictionaries for any field type (#24356)
o Alphanum: dump-alphanum-dict
o Numerical: dump-numerical-list
o PointField: dump-point-kdtree
o UidField: dump-field
o Category & ValueField:  dump-cdict / dump-rdict
Licensing
The CloudView server now supports DSLS (Dassault Systemes Licensing Server) for licensing mechanism (#24513).
Check the "Installation procedures" and "Monitoring" sections in the Installation & Administration guide.
Upgrade notes
If you use the Consolidation Server, you MUST run all aggregations before migrating.
During the migration, the graph data structure used by the Consolidation Server is rewritten to improve performances. This operation can take a few minutes but may take a lot of RAM.
If you encounter an OutOfMemoryError, you should edit the install.sh script to increase the Xmx and relaunch the operation.
Major fixed issues
 
Ticket
Title
Existing since
Component
#24945
StorageService Datasource connection time out are not correctly handled
V6R2015x.SP3
360/Mashup Builder
#24457
Charts widgets keep the pagination parameter with refinement
V6R2015x.SP1
360/Mashup UI & API
#24531
Product does not properly handle the cancellation of a previously selected facet
V6R2015x.SP1
360/Mashup UI & API
#24914
StorageService doesn't close JDBC connections on applyConf while recreating new ones
V6R2015x.SP3
360/Mashup UI & API
#24849
In Admin UI, adding a new Search Logic breaks the display
V6R2015x.SP2
Admin-ui
#24875
Couldn't apply configuration: 'ramBased="true"' needs 'retrievable="true"'
V6R2015x.SP3
Admin-ui
#24942
Configuration of custom Java Transformation in Consolidation Server disappears after an Apply config
V6R2015x.SP3
Admin-ui
#23960
Alerting: impossible to create alerts when the search queries contain a date prefix handler
V6R2014x.SP4
Alerting
#24242
lastExecutionTimestamp stays at zero
V6R2014x.SP4
Alerting
#24974
SDC: TableReaderTD usage is not local to a thread
V6R2015x
Connectors / SDC
#24640
Some slots seems to be GC whereas they shouldn't
V6R2015x.SP3
Consolidation
#24420
Ambiguous method deleteDocument(String, String) in Consolidation Server delete aggregation processor
V6R2015x.SP3
Consolidation
#24452
Delete Java aggregation/transformation processor are not detected/suggested by the add java proc menu in Administration Console
V6R2015x.SP3
Consolidation
#24481
Consolidation performance issues when there are too many relationships in the object graph
V6R2015x.SP3
Consolidation
#24508
Clear is too slow with consolidation
V6R2015x.SP3
Consolidation
#24705
Max RAM usage threshold is not taken into account
V6R2015x.SP3
Consolidation
#24750
X&T Java Processors configurations are not validated on apply
V6R2015x.SP3
Consolidation
#24918
Consolidation does not work anymore with crawler
V6R2015x.SP3
Consolidation
#24639
Replication fails with kernel >= 3.14
Prehistoric defect
Core
#20757
estimate-ram-attr-usage is wrong in column mode
V6R2014 SP2
Generic
#23569
Windows server restart creates "Unclean shutdown"
Prehistoric defect
Generic
#24575
Disabling connectors automatic restart not working...
V6R2015x.SP3
Generic
#24644
Search service flagged alive even if it is not on default configuration
V6R2014x.SP4
Generic
#24725
Crash indexingserver : MOT::TransducerBasicMatcher::emitTemporaryMatch
V6R2014x.SP4
Generic
#24499
Migration of Related Terms can produce corrupted lists
V6R2015x.SP3
Indexing
#22649
Crash of indexing server using direct i/o in write slots config
V6R2014x.SP4
Indexing
#23968
html_relevant_content_extractor boosts only the first chunk of classes/ids to boost
Prehistoric defect
Indexing
#24184
OutOfMemory crashes caused by DeleteDocumentRootPath
V6R2014x.SP4
Indexing
#24213
Indexing, long query and AttGrp 1 memory consumption
V6R2014x.SP4
Indexing
#24588
Dict import should not be fatal for HA build scenarios
V6R2014 GA
Indexing
#24703
Checkpoints files are not cleared
V6R2015x.SP3
Indexing
#7588
Acronym detector is too greedy
V6R2015x.SP3
Platform/MOT
#24650
Issue Advanced Results Table with criteria Containing special character
V6R2014 SP2
Search
#24773
Spellcheck only works if either autocorrect or computeNHits is enabled
Prehistoric defect
Search
#24103
Terms are not highlighted properly when using NEAR/NEXT/AFTER/BEFORE
V6R2015x.SP2
Search
#24227
Infinite loop in IndexQuery::WordPosHandler::seek
V6R2014x.SP1
Search
#24320
slice crash : DS::DiskIdToObjectGroup::decodeMultiNumericalList when querying dates in dynamic fields with #extract
V6R2015x
Search
#24337
Searcher::SynthesisTreeBuilder::buildGroup SIGSEGV while processing huge 2D synthesis
V6R2015x.SP2
Search
#24405
We are losing proximity boost for fields with pattern search
V6R2013x
Search
#24417
slice crash : IndexQuery::NotExprNode::seek(unsigned int, IndexQuery::HitContext&)+0x153
V6R2015x
Search
#24464
Shared memory leak in searchserver, RT dictionary mapped many times
V6R2015x.SP3
Search
#24788
Polish language causes stemming to crash search with isolated trailing numbers
V6R2014x.SP3
Search
#24217
Static suggest: prob subExpr
V6R2014x.SP4
Semantic
#24651
We set a proximity boost even if matches have no position
V6R2014x.SP4
Semantic
#24811
Some Chinese/Japanese synonyms do not match
Prehistoric defect
Semantic
Other fixed issues
Ticket
Title
Existing since
Component
#24860
Issue with I18n when HTTP context path is : '/'
V6R2014x.SP4
360/Mashup Builder
#24663
Export CSV widget transforms double quote into simple quote
V6R2014 SP2
360/Mashup UI & API
#24365
Restore does not restore if you switch to another page
Prehistoric defect
Admin-ui
#24413
Correct consolidation context-sensitive help
V6R2015x.SP3
Admin-ui
#24537
Crawler: rules and URLs down buttons go rules to up
V6R2015x.SP3
Admin-ui
#24785
Wrong pre-filled directive name in API Console: SDC_TYPE
V6R2015x.SP3
Admin-ui
#23885
Alerting SMTP server modification needs GoLive and restart to be applied
V6R2015x.SP2
Alerting
#24121
RealTime Alerting: FastRules matcher should handle ORs under proximity operators
V6R2014x.SP4
Alerting
#24274
SQA: wrong pipeline for testing the SQA resource in the Business Console
V6R2015x.SP2
Business Console
#24358
CSV: List of column name for any option does not display the first column name
V6R2014x
Connectors / Connector CSV
#24408
Field order in a CSV connector config change with JVM version
V6R2015x
Connectors / Connector CSV
#24585
Deduplicate on values when activating grouping option is not working correctly
Prehistoric defect
Connectors / Connector CSV
#23864
Invalid session used by connector when indexing server is restarting while scan is running
V6R2015x.SP2
Connectors / Connectors Framework Java
#24807
Force aggregation should not trigger impact detection
V6R2015x.SP3
Connectors / Structured Data Consolidation
#24379
Failed to retrieve structures to compact: java.io.IOException: Cannot get size of the slots of this table: No such file or directory
V6R2015x.SP3
Consolidation
#24383
Fetch fail with generated child document
V6R2015x.SP3
Consolidation
#24453
Force aggregation excluding an URI doesn't work
V6R2015x.SP3
Consolidation
#24523
Double-click on a vertex in the Introspection Console does not work
V6R2015x.SP3
Consolidation
#24524
Bad display with too many scrollbars for the payload in the Introspection tab
V6R2015x.SP3
Consolidation
#24746
ChildDocument created in an aggregation processor are not deleted
V6R2015x.SP3
Consolidation
#24755
Consolidation processor: close button only on UI when switching from context
V6R2015x.SP3
Consolidation
#23188
Anchors broken in preview
Prehistoric defect
Convert
#24384
Document conversion error log level
V6R2014x.SP4
Convert
#24406
Convert log: Not converted memory file
V6R2014x.SP4
Convert
#24626
thumbnail of Excel files are not well displayed
V6R2015x.SP3
Convert
#24459
Handle NTFS creation/access time read in ZIP files
V6R2015x.SP3
Core
#24896
MaxFormContentSize is hardcoded in webappdeployer
Prehistoric defect
Core
#24503
Spellcheck : Exact words shouldn't be spellchecked
V6R2012x
Dictionaries
#18396
Add documentation on "Ranks remapping"
V6R2013x.SP2
Documentation
#24641
KeyNotFoundException rollbackVersion during apps install
V6R2015x.SP1
Generic
#24643
Monitoring Console doesn't store data while system is experiencing heavy loads
V6R2014x.SP4
Generic
#24353
Hotfix installation does not keep execution permission of files
Prehistoric defect
Generic
#22868
Indexing server crash while restarting during GC
V6R2014 GA
Indexing
#24577
Wrong naming for concatenate Value processor generated for gps point (or XY point)
V6R2014x
Indexing
#24642
Dict compact every N import + Apply Conf head to single thread indexing processing
V6R2014x.SP4
Indexing
#24787
big RAM consumption when using a lot document.getAllChunks in a custom document processor
V6R2015x.SP3
Indexing
#24798
Port still reserved when recreating a build group
V6R2015x.SP2
Indexing
#23993
Small leaks in indexing server which might induce fragmentation
V6R2015x.SP2
Indexing
#19861
#distance and #within consume very much system CPU time
V6R2014 GA
Search
#19973
Stopwords configuration: the combination stopWordsOnlyQueryAction="empty" and action="opt" is not implemented
Prehistoric defect
Search
#24403
Possible search server crash after slice crash
V6R2015x
Search
#24410
rowHash.get(current->cref1, &parentCat) failed for duplicate ranges in synthesis
V6R2012x
Search
#24444
Can't remove value in ranks remapping in the UI
V6R2015x.SP2
Search
#24506
Timeout during a query with huge rdict
V6R2014x.SP2
Search
#24591
Disable transparency for excel thumbnails
V6R2015x.SP1
Search
#24702
No highlight when using a MultiQueryPrefixHandler with a #consecutive query
V6R2015x.SP1
Search
#24923
Search API parameter "add_hit_metas" with dynamic properties make the feed context panel empty
V6R2015x.SP3
Search
#24948
Possibly wrong ranking result in min merge mode
Prehistoric defect
Search
#24887
Preview highlight does not work for OCRized pdf
V6R2015x.SP3
Search
#24497
Change login admin in the ui : prob in the mashup
V6R2015x.SP2
Security
#24381
Ending up with a division by zero in similar document scores
V6R2014x.SP3
Semantic
#24833
Possible summarizer crash for Chinese / Japanese docs
V6R2014x
Semantic
#21390
Named Entities: pathological case in people rules
Prehistoric defect
Semantic
#24485
Related terms filter not always coherent in multi slices deployment
V6R2015x.SP1
Semantic