com.exalead.mot.components

Class TokenizeAnnotation

java.lang.Object

com.exalead.gni.GNIObject

com.exalead.mot.core.Processor

com.exalead.mot.components.TokenizeAnnotation

public class TokenizeAnnotation
extends Processor

Field Summary

Fields

Modifier and Type	Field and Description
java.lang.String	annotationKind Specify the type of annotation, by default we wil lcompare annotation with NORMALIZED annotation values = exact|lowercase|normalized"
java.lang.String	annotationsToTokenize Comma separated list of Annotations to transform in tokens to allow You should not have overlap between two annotation of this type, you can put a KeepLongest operation within the AnnotationManager just before to avoid problems
java.lang.String	resource The processor resource

Fields inherited from class com.exalead.mot.core.Processor

fields, name

Constructor Summary

Constructors

Constructor and Description
TokenizeAnnotation(java.lang.String name, java.lang.String resource, java.lang.String fields) resource should be a valid tokenizer resource

Method Summary

Modifier and Type	Method and Description
protected void	finalize()
void	init(java.lang.String name, java.lang.String[] fields) Initialize the processor
protected void	init(java.lang.String name, java.lang.String[] fields, java.lang.String[] annotations, int kind, java.lang.String tokenizerResource)

Methods inherited from class com.exalead.mot.core.Processor

checkResource, destroy, getName, init

Methods inherited from class com.exalead.gni.GNIObject

printInternalCppPointer

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

resource

public java.lang.String resource

The processor resource

annotationsToTokenize

public java.lang.String annotationsToTokenize

Comma separated list of Annotations to transform in tokens to allow You should not have overlap between two annotation of this type, you can put a KeepLongest operation within the AnnotationManager just before to avoid problems

annotationKind

public java.lang.String annotationKind

Specify the type of annotation, by default we wil lcompare annotation with NORMALIZED annotation values = exact|lowercase|normalized"

Constructor Detail

TokenizeAnnotation

public TokenizeAnnotation(java.lang.String name,
                          java.lang.String resource,
                          java.lang.String fields)

resource should be a valid tokenizer resource

Method Detail

finalize

protected void finalize()

Overrides:

finalize in class java.lang.Object

init

public void init(java.lang.String name,
                 java.lang.String[] fields)

Description copied from class: Processor

Initialize the processor

Specified by:

init in class Processor

Parameters:

name - Its name

fields - The list of fields on which it's active

init

protected void init(java.lang.String name,
                    java.lang.String[] fields,
                    java.lang.String[] annotations,
                    int kind,
                    java.lang.String tokenizerResource)