com.exalead.search.query.linguistic

Class LemmatizationHandler

java.lang.Object

com.exalead.search.query.linguistic.LemmatizationHandler

All Implemented Interfaces:

LinguisticExpanderResource.Handler

public class LemmatizationHandler
extends java.lang.Object
implements LinguisticExpanderResource.Handler

Implement lemma expansion for the Linguistic Expander.
A lemma in morphology is the canonical form of a lexeme. Lexeme, in this context, refers to the set of all the forms that have the same meaning, and lemma refers to the particular form that is chosen by convention to represent the lexeme. In lexicography, this unit is usually also the citation form or headword by which it is indexed.

This processor expands the query with the lemmas of the tokenized words.
Produces forms with formName=normalized,source=$PROCESSOR_NAME

Internal details

The MOT processor is in charge of of annotating the raw Text's alphabetic tokens with the normalized words having the same lemma. ( http://en.wikipedia.org/wiki/Lemma).
A static dictionary is used for lemmatisation.

The post-processor simply expands the tokenized text with these words under the NORMALIZED form.

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String[]	availableLanguages

Constructor Summary

Constructors

Constructor and Description
LemmatizationHandler()
LemmatizationHandler(java.lang.String language)
LemmatizationHandler(java.lang.String language, java.lang.String resourceDir)

Method Summary

Modifier and Type	Method and Description
LinguisticExpanderResource.PostProcessorFactory	buildPostProcessorFactory()
java.util.List<SemanticProcessor>	buildSemanticProcessor()
void	release()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

availableLanguages

public static java.lang.String[] availableLanguages

Constructor Detail

LemmatizationHandler

public LemmatizationHandler()

LemmatizationHandler

public LemmatizationHandler(java.lang.String language)

LemmatizationHandler

public LemmatizationHandler(java.lang.String language,
                            java.lang.String resourceDir)

Method Detail

buildSemanticProcessor

public java.util.List<SemanticProcessor> buildSemanticProcessor()

Specified by:

buildSemanticProcessor in interface LinguisticExpanderResource.Handler

Returns:

a set of SemanticProcessor to annotate the TokenizedNode

buildPostProcessorFactory

public LinguisticExpanderResource.PostProcessorFactory buildPostProcessorFactory()

Specified by:

buildPostProcessorFactory in interface LinguisticExpanderResource.Handler

Returns:

a factory of PostProcessor

release

public void release()

Specified by:

release in interface LinguisticExpanderResource.Handler