R2014x.SP2 is a maintenance release to R2014x. For information about new features, see the online help: About this Release > What's New.
Improvements
Platform
Indexing
• Speed indexing has been improved by increasing parallelism and reducing contention to benefit from machines with multiple cores.
• Optimized RAM consumption during gdict build #20822.
Search
• To be more responsive at the first query, the index can now be configured to auto-play a list of simple queries at startup, before the service is opened. For more information, see XML CloudView Configuration Reference > Build Groups > Index Runtime Configs > WarmupConfig.
Semantics
• In query expansion, you can disable lemmatization of synonyms using the lemmatize_synonyms option on prefix handler configuration #21217:
o <FullTextPrefixHandler ... queryExpansionConfig="lemmatization{lemmatize_synonyms=true}, syns{}" .../>
• Tokenization configuration has a new normalization option for transliterating Unicode Latin Extended B characters. This is useful when you want to match documents in another charset from the one you use for searching #21033.
o Example: search for words containing "Ł" using the closest Latin character "L" even though it does not match phonetically.
o Note: this feature will be enabled by default in the next major release (R2015x).
Supported transliterations:
00D0 = Ð -> 'd'
0110 = Đ -> 'd'
00F0 = ð -> 'd'
0111 = đ -> 'd'
00D8 = Ø -> 'o'
00F8 = ø -> 'o'
0126 = Ħ -> 'h'
0127 = ħ -> 'h'
0131 = ı -> 'i'
0141 = Ł -> 'l'
0142 = ł -> 'l'
0166 = Ŧ -> 't'
0167 = ŧ -> 't'
0192 = ƒ -> 'f'
Other platform improvements
• Added cvadmin suggest dump-suggest-to-xml command to export the content of a suggest dictionary to an XML file. This can be useful for generating other resources or debugging purpose #19075.
• To avoid file access issues, it is recommended to always run CloudView with the same user (and not the root/admin). To prevent user mistakes, a warning is displayed when CloudView is started with a different user from the last start (Linux only) #21273.
• List of ciphers accepted by CloudView when SSL is enabled can now be configured in the internal deployment configuration to prevent users from connecting with weak encryption mechanisms #19948.
o More info in Configuring SSL cipher suites section of the Installation and Administration Guide
• Show used network ports in the list of process on the Administration Console home page #20878.
• Search reporting now uses usersession_id in addition to the user_id parameter for identifying unique users #21128.
• Result of tokenization process is displayed in the Document Tracker (Data Processing / Test) #21269.
• Location of build group Document Cache can be changed using configuration. Default location is the "cache" sub-directory of the build group #21111.
• Streaming search results is now possible even when using synthesis with disjunctive facets #21393.
• query_origin field in query reporting explains "what" created this request: page load on Mashup UI; AJAX load on Mashup UI; trusted queries; cache warm-up; isAlive; alerting; and so forth #14201.
Mashup
Pivot Table Widget
The Mashup Builder application contains a new Pivot Table widget. Users can expand/collapse the views of facets (see the Country facet in the following screenshot) and click on any value of the pivot table to refine results on the whole page.
Note: The pivot table widget only shows the top level of hierarchical facets (including Date facets). This means you will need to define 3 separate facets in your widget rows or columns, to break down a date into Years / Months / Days.
More info in the Adding a Pivot Table section of the Getting Started Guide.
Cross-Site Request Forgery (CSRF) protection
An option in the Mashup Builder enables protection against CSRF (fishing). This is most useful when using forms on a Mashup page to transmit data to the server (for authoring actions like tagging, ranking...) #20208.
More info in the Cross-Site Request Forgery Protection section of the Installation and Administration Guide.
Mashup Expression Language internationalization functions
• ${user:locale(MELHttpServletRequest request)} returns the locale used by the current user from the HTTP query.
• ${date:format(MELString date, MELString pattern, MELString locale, MELString timeZone)} returns the date formatted as the output pattern using specified locale and timezone.
• ${i18n:message(MELHttpServletRequest request, MELType code) translates a string like ${i18n[code]} but using the locale from the HTTP query.
• ${i18n:message(MELHttpServletRequest request, MELType code, MELType[]... parameters) translates a string containing variable parts (specified by {0}, {1}, etc.) which are replaced by the values in parameters.
> created by John Doe on February 10, 2014 at 10:30am
Business console
Semantic resources management
• Semantic resources sources have been moved from a single SemanticResources.xml file in the DATADIR/config/360/applications/<app> folder to individual files (one per resource) in the DATADIR/businessConsole/semanticResources folder.
• Semantic resources editor now supports better the editing of large resources. It is also optimized when Business Console is on the same host as the Resource Manager #18967.
Connectivity
Managing un-managed connector
There are 2 major differences between managed and un-managed connectors:
1. Un-managed connectors cannot be controlled (scan, clear...) by CloudView
2. Un-managed connectors cannot run Push API filters unless they are written in Java
The R-Scan Client and Managed Push API connector can be used to get rid of these limitations.
Here is a summary table of managed and un-managed connectivity solutions:
Compatible with non-Java connectors
Controlled with Admin Console
Compatible with Java Push-API filters
Compatible with SDC
Managed Java Connector
-
Yes
Yes
Yes
RSCAN Client Connector
No
Yes
No
Yes
Managed Push API Connector
Yes
No
Yes
No
So here is how to select a solution for using Push API filters on a managed connector:
1. Can you add Push-API filters on your connector?
1. Yes -> add Push-API filter on the connector
2. No -> Is it a Java connector?
1. Yes -> use RSCAN Client Connector
2. No -> use Managed Push API Connector
Other connectivity improvements
• The Connector / Advanced / Push API section in the Administration Console allows configuring push and indexing options #21177.
• The CAD section in the Files connector shows the list of known Computer Aided Design file extensions #20821.
• Converter now processes Autocad and Microstation file formats (DWG, DXF, DGN, ...) in memory instead of using temporary files reducing disk footprint #21132 and #21251.
Documentation
• New Online Help format which:
o allows phrase search, wildcard search, exact search with quotes
o allows highlighting of search terms on multiple browsers
o allows references to sections of external guides.
o enhances load times
o allows better handling of the end-user’s device resolution.
• CloudView Connectors Guide:
o "Crawler" chapter rewritten to give more details and configuration recommendations for several use cases.
o New chapter for the "Managed Push API connector"
o New chapter for the "RScan Client connector" (the RScan server implementation is explained in the "Deploying Connectors on a Remote Server" section of the Connector Programmer Guide.
• Installation and Administration Guide:
o Installation procedures and administration tasks are now gathered in a single document: CloudView installation and administration guide
o New section on CloudView processes ("Processes in detail")
o New "Checklist before going live" section
• Technical Reference Guide:
o New "How to control the data model expansion" section
• CloudView Programmer Guide:
o New section on alerting API ("Customizing alerting")
• Mashup Programmer Guide:
o New "Implement how to display subwidgets" section
o New "Update widgets with Mashup Ajax Client" section
o New "Reference JSP in a controller" section
• Connector Programmer Guide:
o New "Implement a continuous scan" scan section
o New "Calculating a diff between Two Data Sources" section
o New "Implement concurrent scan modes" section
API & SDK
• Mashup-UI SDK: added request:forEachParameter tag to iterate on request parameter names #20968.
• Grouping (formerly named collapsing) can be disabled on a search logic through API: http://HOST:BASEPORT+10/search-api/search?q=%23all&sle=set:relevanceConfig.groupConfig=null #21575.
Upgrade notes
Supported platforms
R2014x was the last CloudView version to support RedHat 5. R2015x will support RedHat 6 only.
Changes that can break things
• Semantic resources are now stored into individual files (one per resource) into DATADIR/businessConsole/semanticResources instead of DATADIR/config/360/applications/<app>/SemanticResources.xml. The migrator handles the directory changes correctly as well as splitting the file.
• Command line dictionary export (cvdebug dict dump-rt and dump-words) now output language name instead of identifier #21156.
o Example: before: lang="2", now: lang="en"
• In Mashup charts widgets, the refinement link has been shortened in order to reduce the amount of data. All those links have a common part which is now factored in the baseUrl of the chart and concatenated on Click event. As such, links are transformed like so #20743:
o Old link: "chart?cv.q=doc&cv.page=1&cv.r=%2Bf%2Ffile_extension%2Fjpg"
o New link: "cv.r=%2Bf%2Ffile_extension%2Fjpg". With baseUrl: "chart?cv.q=doc&cv.page=1"
• Kerberos is now provided in a separate plugin. Please contact the EXALEAD support team for help on implementation.
• The HTTP crawler now extracts links from Javascript by default. To return to the old behavior, you can disable this in the configuration using extractJs="false" #21483.
Major fixed issues
Ticket
Title
Existing since
Component
11656
Deleting app badly updates configuration
V6R2012x.SP1
Mashup Builder
20783
Mapquest map now needs a key
V6R2014x.SP1
Mashup Builder
21029
MEL Parsing error for "i18n" namespace in MashupBuilder
V6R2014 GA
Mashup Builder
21302
Grouping cannot be configured on mashup feeds
V6R2014x
Mashup Builder
21421
MashupBuilder permissions are not properly resolved for a user with uppercase
V6R2014x.SP1
Mashup Builder
14277
Allow passing security tokens in Mashup Fetcher requests
V6R2013
Mashup UI
20640
Incorrect display of several graphic widgets.
V6R2014x
Mashup UI & API
20914
resources are not included in composite widgets when the packer is disabled
V6R2014x
Mashup UI & API
20916
theme resources are not available when packer enabled
V6R2014x
Mashup UI & API
20967
Trusted queries display is broken when the query is too long
V6R2014x
Mashup UI & API
21003
preview : Highlighting and term navigation is missing on lots of documents
V6R2014x.SP1
Mashup UI & API
21030
Quoted expressions display errors in trusted queries
V6R2014x.SP1
Mashup UI & API
21036
Unmodifiable exception in storage proxy controller with UrlRewriteFilter enabled
V6R2014x
Mashup UI & API
21113
Missing user info in Query reporting
V6R2014x.SP1
Mashup UI & API
21120
V6R2014x - display problem in search UI with IE 8
V6R2014x
Mashup UI & API
21133
MashupAjaxClient "update" method can be called only once
Prehistoric defect
Mashup UI & API
21168
JS Error in trusted queries
V6R2014 GA
Mashup UI & API
21212
cannot force tab opening in tab widget anymore
V6R2014 GA
Mashup UI & API
21213
some widget styles are not applied on custom theme
V6R2014 GA
Mashup UI & API
21214
RemoveIfNoEntries trigger does not support Table layout widgets
V6R2014 GA
Mashup UI & API
21262
Clicking on Open CSV/XML/AJAX link in debug > widgets does not work
V6R2014x
Mashup UI & API
21287
Highcharts widgets do not support huge dataset
V6R2014x.SP1
Mashup UI & API
21550
Session Cookie is sent with GET query as URL parameter
V6R2014x
Mashup UI & API
21553
Local File Inclusion vulnerability with language module
V6R2014x
Mashup UI & API
20933
adminUI crawler_connector>Rules extension blacklist are added at every save/apply
V6R2014x.SP1
Admin-ui
21314
Error while using document tracker with CompoundWord Splitter
V6R2014x
Admin-ui
21328
If you select "Index Field and Facet" when creating a datamodel enumerated property, no hit meta is and can't be generated
Prehistoric defect
Admin-ui
20724
cvdebug analyzer test not working for buildgroups other than bg0
V6R2014 SP1
Alerting
20930
Incorrect cron expression goes undetected and prevents gateway to start
V6R2014 SP2
Alerting
21165
Business console doesn't garbage %DATADIR%/businessconsole
V6R2013x.SP2
Business Console
21415
No business console on AIX (blank page)
V6R2012x
Business Console
21459
V6R2014xSP1: reporting unique users bad label display
V6R2014x.SP1
Business Console
21043
Unable to push non-Latin documents with API Console
V6R2014x.SP1
Config system / APIs
14180
ExchangeWS: no HTML preview for text attachments
V6R2013
Connectors / C#-Exchange
7521
UserProfile enumerator is buggy
5.1.9
Connectors / C#-SharePoint2007
20247
Too many PAPI#sync operations with IMAP connector
V6R2014x
Connectors / Connector IMAP
20828
PDF preview doesn't display text content due to numerical char names not mapped
V6R2014 SP2
Convert
20923
Thumbnail fail on rh6
V6R2014x
Convert
20951
Convert crashes on some recursive OLE2 storages on Linux
Prehistoric defect
Convert
21068
PDF Text extraction issue
V6R2014x.SP1
Convert
21129
Convert does not isolate anymore temporary files in a dedicated directory
V6R2014x
Convert
21538
Convert: shuffled characters with PDF files
V6R2014x.SP1
Convert
20607
Sometimes getBuildGroup status returns that slice compacting=false but it is wrong
V6R2014 SP2
Core
21335
User names with non-ASCII characters break Cloudview (Truncated UTF-8 sequence)
V6R2014 SP2
Core
21544
CVE-2014-0160: remove HeartBleed vulnerability on OpenSSL for windows/solaris/aix
V6R2014x
Core
20905
Impossible to roll back to initial config when a crawler is deployed on the Java connector server
V6R2014x.SP1
Crawler
21034
Crawler restart is too long because of box recovery
V6R2014x.SP1
Crawler
20660
indexingserver loops failing to compact dictionary
V6R2014x
Dictionaries
21154
dictionary does not always build phonetics and related terms
