com.exalead.mot.components

Class Normalizer

java.lang.Object

com.exalead.gni.GNIObject

com.exalead.mot.core.Processor

com.exalead.mot.components.Normalizer

public class Normalizer
extends Processor

A normalizer lowercases and normalizes (remove accent, use lowercases) tokens

Field Summary

Fields

Modifier and Type	Field and Description
java.lang.String[]	fromTags The source to use to create annotations (default is the token)
boolean	queryMode
java.lang.String	resource The processor resource
boolean	transliteration Remove some problematic (not really) "accents"
int	trustLevel The trustLevel to add on annotations

Fields inherited from class com.exalead.mot.core.Processor

fields, name

Constructor Summary

Constructors

Constructor and Description
Normalizer(NormalizerResource resource)
Normalizer(NormalizerResource resource, boolean transliteration)
Normalizer(java.lang.String name, java.lang.String resource, java.lang.String fields)
Normalizer(java.lang.String name, java.lang.String resource, java.lang.String fields, ProcessingMode mode)

Method Summary

Modifier and Type	Method and Description
protected void	finalize()
java.lang.String	getLowercaseForm(java.lang.String str) Get the lowercase form
static java.lang.String	getLowercaseTag()
java.lang.String	getNormalizedForm(java.lang.String str, int lang) Get the normalized form
java.lang.String	getNormalizedForm(java.lang.String str, int lang, boolean useException) Get the normalized form
static java.lang.String	getNormalizeTag()
void	init(java.lang.String name, java.lang.String[] fields) Initialize the processor

Methods inherited from class com.exalead.mot.core.Processor

checkResource, destroy, getName, init

Methods inherited from class com.exalead.gni.GNIObject

printInternalCppPointer

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

resource

public java.lang.String resource

The processor resource

fromTags

public java.lang.String[] fromTags

The source to use to create annotations (default is the token)

trustLevel

public int trustLevel

The trustLevel to add on annotations

queryMode

public boolean queryMode

transliteration

public boolean transliteration

Remove some problematic (not really) "accents"

Constructor Detail

Normalizer

public Normalizer(java.lang.String name,
                  java.lang.String resource,
                  java.lang.String fields,
                  ProcessingMode mode)

Normalizer

public Normalizer(java.lang.String name,
                  java.lang.String resource,
                  java.lang.String fields)

Normalizer

public Normalizer(NormalizerResource resource,
                  boolean transliteration)

Normalizer

public Normalizer(NormalizerResource resource)

Method Detail

init

public void init(java.lang.String name,
                 java.lang.String[] fields)

Initialize the processor

Specified by:

init in class Processor

Parameters:

name - Its name

fields - The list of fields on which it's active

finalize

protected void finalize()

Overrides:

finalize in class java.lang.Object

getNormalizeTag

public static java.lang.String getNormalizeTag()

getLowercaseTag

public static java.lang.String getLowercaseTag()

getNormalizedForm

public java.lang.String getNormalizedForm(java.lang.String str,
                                          int lang)

Get the normalized form

Parameters:

str - The word

lang - The language

Returns:

The normalized form

getNormalizedForm

public java.lang.String getNormalizedForm(java.lang.String str,
                                          int lang,
                                          boolean useException)

Get the normalized form

Parameters:

str - The word

lang - The language

useException - Should we use exceptions ?

Returns:

The normalized form

getLowercaseForm

public java.lang.String getLowercaseForm(java.lang.String str)

Get the lowercase form

Parameters:

str - The word

lang - The language

Returns:

The lowercase form