V6R2013

Use dynamic properties to handle several metas with a single field, while retaining the full search, faceting and retrieve features. The mapping of metas to index fields can be done using advanced matching rules. This is useful both to handle huge number of metas in a single CloudView instance, and also when the meta names that will be pushed are not fully known in advance.

"Trace metas" feature allows you to visualize all metas pushed or created during analysis, and to easily create new data model properties to handle them. It is particularly useful as an introspection tool when the schema of the data sources are not known.

Both features are accessible directly from the "Data Model" screen of the Administration Console.

For an example of using traced metas, see the "Building Analytical Applications" chapter of the CloudView Getting Started Guide.
For more information on both traced metas and dynamic properties, see Chapter 3 of the CloudView Technical Reference Guide.

This feature allows users to save queries through simple Mashup-UI widgets. Saved queries are then replayed incrementally on administrator-defined schedules. Several actions are possible when new matching documents are found:

• Send events to an HTTP server, for integration in a customer's publication workflow.

For more information, see the "Alerting" chapter of the CloudView Business Console Guide.

There are now two kinds of multi-dimension facets:

• Multi-dimension facets, which should generally be preferred, offer a "one-level-per-axis" view, over an arbitrary number of axis. A refine on a value of an axis will cause a drill-down on this value, if children are available.

• Hierarchical 2D facets generate a "all-levels-at-once" view over two axis.

For more information on multidimensional facets, see the "Advanced Search Features" chapter of the CloudView Technical Reference Guide.

Many Mashup-UI widgets have been updated to use these new facets, such as:

Trusted Queries is an innovative search form that allows users to browse the actual content of the index in real time while formulating their queries.

This is an enhanced port of the Trusted Queries widget that was available in CloudView V5. List of facets used for browsing can now be defined.

For more information, see "Adding Trusted Queries" in the Mashup Builder's User Guide

• The searcher will now automatically choose the best query evaluation mode. A new query evaluation mode has been added, providing vast performance improvements for queries with both full hits and exhaustive faceting over a large result set.

• A new kind of index field has been added, the "value field". If offers much faster faceting on non-hierarchical data. It can be used directly from the data model, by checking the "Enumerated" flag on an alphanum property. Note that in that case, an index field is created for each property.

• It is now possible to sort facets based on aggregation values or using explicit orders (like "critical, then major, then normal, then minor")

• Date facets and some of the date manipulation functions in virtual fields are much faster

• A new kind of index field has been added, the "UID field". It stores identifiers that are unique per document, and allows a very fast search for large lists of these identifiers. (a bit like "uri:A OR uri:b OR uri:c OR ....)

• Alphanumerical index fields can now have a "bloom filter" computed. This auxiliary data structure can make lookups in the dictionaries faster, at the expense of an additional RAM consumption.

• It is now possible to write custom term scoring expressions (like TF-IDF)

• SolidWorks formats are now supported on Linux and Solaris (extraction and thumbnails extraction)

• HTML preview performance has been improved for formats using Stellent Outside-In

o Details on each index slice, including the slice <-> search-api exchanges

o CloudView V5 feed is now distinct from CloudView feed (which only queries CloudView V6)

o You can now draw your search area on the Google Maps widget. Users can draw polygons and circles to perform a geo search.

o A new Metric widget to display a single metric based on a facet or aggregation

o Charts widgets now support multiple aggregations with different axis and representations on a single chart

o A new Multi-dimension Facets Builder widget provides users with the ability to build a 2D facet on the fly, using an administrator-defined list of facets and aggregation functions for each of the axis.

• The Mashup Builder is not fully reloaded after applying configuration anymore

o A new JSP API (TLD) has been added (with full documentation) to make building widgets much easier

o A new kind of Mashup-UI trigger has been added: Parameter Adapter Widget Trigger (PAWT). Each widget can be passed specific parameters, and can alter the API request, depending on these parameters, allowing for deeper interactions without allowing all backend parameters to be passed in by users

o A new framework for widgets communication has been added. Widgets can share interfaces to other widgets and act accordingly (e.g., Google Maps widget shares an interface to add and remove polygons and circles. The search form uses this interface to create the geo search query).

• New CloudView Installation and Deployment Guide, with single-host and multi-host installation procedures, as well as several recommended deployment scenarios.

• New CloudView Administration Guide, with common tasks for maintaining a production deployment.

• CloudView Technical Reference Guide now includes a chapter on security sources, as well as how to use the Resource Manager to compile and distribute semantic resources (replacing qshare and ishare).

• Load balancer health monitors (isAlive) are now available in the Mashup Builder, and can be controlled remotely for smooth scheduled downtimes

• sorted=false sort mode was not fully usable in Mashup-UI - Note that it is generally not required anymore to explicitely ask for this mode thanks to the new mode selector

• Several issues related to high availability and multi-machine deployments have been fixed

o Impossible to use connectors and business console rules on slave machines if security folder was not copied manually

• Legacy Exascript Lotus Notes: don't fail on dates before 1970 or after 2070

• Russian lemmatization resource has been moved to an addon. Russian lemmatization will automatically be disabled when you migrate. If you need the feature, install the add-on and re-enable it.

• The identification of facets inside Mashup-Builder has moved from facet path (Top/MyFacet) to id (myfacet). After automatic migration, make sure that all your widgets are still displaying correct data.

• Many configuration checks have been improved. In some cases where an invalid config was previously accepted, migration might fail on the new checks. In that case, fix the reported mistake in the original configuration (you don't need to apply), then restart the migration.

• Some of the Highcharts-based Mashup widgets will fail once migrated. To fix them, you need to edit their Javascript code, and replace:

• When migrating, the monitoring probes on the detailed status of each index field have been disabled by default, as they tended to be too costly. They must be re-enabled on a per-field basis if you need them, by editing config/Reporting.xml, and inserting, within the <PerformanceMonitoringConfig> node, children nodes like <MonitoredIndexField name="text"/>.

• Crawler forced metas and feedfetcher metas are no longer prefixed with meta: or ff:

• "MatrixFacet" has been removed and is replaced by "MultidimensionFacet" and "Hierarchical2DFacet". Please see the CloudView Technical Reference Guide to know which one you need.

• Crawler no longer spontaneously reindexes all its documents when its buildgroup is cleared. A manual reindex operation is now required, to avoid the crawler replaying its whole log from scratch, which could lead to multiple full reindex operations.

• In some rare cases, the filesystem connector can fail on Linux. As a workaround, disable the "Use native readers" option.

• When working with multiple children classes, Trusted Queries omits the parent facets from the suggestions.