Package com.exalead.search.query.linguistic

Visitor classes that provides tokenization and linguistic expansion of the abstract syntax tree's alphabetic leaves.

See: Description

Interface Summary

Interface	Description
DictionaryInterface
LinguisticExpanderResource.Handler	A Handler is a factory for: a set of SemanticProcessor to annotate the TokenizedNode a factory of PostProcessor

Class Summary

Class	Description
AlternativesCleaner	Remove alternatives from non seqexprs.
ApproximateHandler	Implement approximate expansion for the LinguisticExpander.
ApproximateHandler.PostProcessor
CJHandler	Specific handling of CJ query chunks Reminder: after the MOT Pipe, we have: - one token per ideogram - CJ forms if recall mode enabled: one annotation per ideogram, annotation tag = cjk, all annotations with nbTokens = 1 - "tokenizer" forms: one annotation per detected word (with nbTokens > 1) - all japanese alternative forms per detected word (with nbTokens > 1) Example: query 本田技術研究所 NORMALIZE annotations [本田] [技術] [研究所] cjk annotations [本] [田] [技] [術] [研] [究] [所] tokens [本] [田] [技] [術] [研] [究] [所] result (本田 OR "本 田") AND (技術 OR "技 術") AND (研究所 OR "研 究 所") This handler does the following: - Merge CJ forms of the same token into a sequence with a weight defined by the cjk form-indexing trust level
CorpusFrequenciesHandler	Implement corpus frequencies handling for the LinguisticExpander.
CustomHandler
DictionaryInterface.InstanceHandler
LemmatizationHandler	Implement lemma expansion for the Linguistic Expander. A lemma in morphology is the canonical form of a lexeme.
LinguisticExpander	Perform the tokenization of UserQueryChunks, and linguistic expansions using a set of MOT processors and their associated post-processors. This class is not thread-safe, an instance per thread is required. You do not instantiate this class, but acquire thread-specific instances through the LinguisticExpanderResource.
LinguisticExpanderResource	Global thread-safe resource for linguistic expansion. Building a resource is expensive, be careful to reuse this between queries.
LinguisticExpanderResource.PostProcessorFactory	Abstract factory that creates a LinguisticPostProcessor.
LinguisticExpansionConfigurator	This visitor applies the linguistic expansion configuration of a prefix handler, on the whole branch under the Prefix node.
LinguisticPostProcessor	A linguistic expansion post processor.
MatchingModeSelector	Handle the "matchingMode" parameter of the TokenizedNode. This allows to perform: - (exact OR lowercase OR normalized) - (exact OR lowercase) - (lowercase OR normalized) Please refer to the documentation for more information about this parameter.
ModuleConfigs
ModuleConfigs.Approximate	Approximate (fuzzy) matching module - query-specific config
ModuleConfigs.Base
ModuleConfigs.Custom
ModuleConfigs.Lemmatization	Lemmatization module - query-specific config
ModuleConfigs.Phonetic	Phonetic matching module query-specific config
ModuleConfigs.Stemming	Stemming module - query-specific config
ModuleConfigs.SynonymsExpansion	Synonyms expansion module - query-specific config
NGramHandler	Implements ngram search for the Linguistic Expander.
PhoneticHandler	Implement phonetic expansion for the LinguisticExpander.
PhoneticHandler.PostProcessor
RegexpExpander	Perform linguistic expansion of patterns in the user query. This step transforms the "UserQueryRegexp" and "UserQueryChunk" (with prefix or suffix options) objects in their pattern expansions, represented as UserQueryChunk.
RelatedTermHandler	Implements related terms search for the Linguistic Expander.
SemanticProcessorHandler	Implements custom semantic processing for the Linguistic Expander.
SpellChecker	This visitor handles the spell-checking of a Text node. It works before tokenization in order to be able to correct the spelling of chunks like "toure iffel" -> "tour eiffel". Therefore, it must precede the other linguistic Visitors and especially the LinguisticExpander which tokenizes the raw Text chunks. If inserted after the processor distributing linguistic options, it will avoid working on nodes that do not require expansion.
StemmingHandler	Implement stemming expansion for the Linguistic Expander. A stem is a form to which affixes can be attached.
StopWordHandler	Implement stop words detection for the LinguisticExpander.
StopWordTagger	Implement stop words detection for the LinguisticExpander.
SynonymHandler	Implement synonyms expansion for the Linguistic Expander.
URLMatcherHandler

Enum Summary

Enum	Description
RegexpExpander.PrefixSuffixStatus

Package com.exalead.search.query.linguistic Description

Visitor classes that provides tokenization and linguistic expansion of the abstract syntax tree's alphabetic leaves. This package includes a small extensible framework to handle linguistic expansion through annotations and dictionary querying, as well as some visitor classes that provide useful linguistic-related functionality such as regular-expression matching in the dictionary, or spell-checking of the query chunks. See also the transform package to understand how the Tokenized nodes are handled into final nodes.