com.exalead.mot.components

Class TokensToAnnotation

java.lang.Object

com.exalead.gni.GNIObject

com.exalead.mot.core.Processor

com.exalead.mot.components.TokensToAnnotation

public class TokensToAnnotation
extends Processor

For a list of annotations tags, this processor annotates a token with the annotation's matching tokens for each token. This can be usefull for example to classify on a token and it's annotations, or on multi-tokened annotations. ie. if we tag a sentence "X Y Z T", that we have "aTag" as tag to match and that Y is tagged "aTag" with displayform "aDisp" and nbTokens = 3, we will also tag Y with tag "toksToAnno" and displayform "aTag#aDisp#Y Z" prefixWithTag and prefixWithDisplayForm should be used only if they are usefull to create a disambiguisation/hierarchy on the annotated data (ie. tag#disp#toks => toks is a disp of kind tag). If "tag" or "disp" are always the same, they may not be usefull.

Field Summary

Fields

Modifier and Type	Field and Description
char	displayFormSeperator The character that seperates the displayform from the token or tag.
int	maxTokenSpan Maximum annotation size to consider (in terms of token count).
boolean	prefixWithDisplayForm Should the token (or tag) be prefixed with display form ?
boolean	prefixWithTag Should the token be prefixed with matched annotation tag ? ie.
java.lang.String	suffix The suffix for the created displayform.
java.lang.String	tag Tag for this processor.
char	tagSeperator The character that seperates the tag and token.
java.lang.String	tagsToMatch The list of tags to match seperated by ",".
int	windowSize Number of tokens this processor runs on.

Fields inherited from class com.exalead.mot.core.Processor

fields, name

Constructor Summary

Constructors

Constructor and Description
TokensToAnnotation(java.lang.String name, java.lang.String fields) Builds a TokensToAnnotation processor.

Method Summary

Modifier and Type	Method and Description
protected void	finalize()
protected void	init(java.lang.String name, int sentenceMaxSize, java.lang.String tag, java.lang.String[] tagsToMatch, boolean prefixWithTag, char tagSeperator, boolean prefixWithDisplayForm, char displayFormSeperator, int maxTokenSpan, java.lang.String suffix, java.lang.String[] fields)
void	init(java.lang.String name, java.lang.String[] fields) Initialize the processor

Methods inherited from class com.exalead.mot.core.Processor

checkResource, destroy, getName, init

Methods inherited from class com.exalead.gni.GNIObject

printInternalCppPointer

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

tag

public java.lang.String tag

Tag for this processor.

tagsToMatch

public java.lang.String tagsToMatch

The list of tags to match seperated by ",".

windowSize

public int windowSize

Number of tokens this processor runs on.

prefixWithTag

public boolean prefixWithTag

Should the token be prefixed with matched annotation tag ? ie. "tag#token"

tagSeperator

public char tagSeperator

The character that seperates the tag and token.

prefixWithDisplayForm

public boolean prefixWithDisplayForm

Should the token (or tag) be prefixed with display form ?

displayFormSeperator

public char displayFormSeperator

The character that seperates the displayform from the token or tag.

maxTokenSpan

public int maxTokenSpan

Maximum annotation size to consider (in terms of token count).

suffix

public java.lang.String suffix

The suffix for the created displayform.

Constructor Detail

TokensToAnnotation

public TokensToAnnotation(java.lang.String name,
                          java.lang.String fields)

Builds a TokensToAnnotation processor.

Parameters:

name - the processor's name.

fields - fields on which the processor runs.

Method Detail

init

public void init(java.lang.String name,
                 java.lang.String[] fields)

Initialize the processor

Specified by:

init in class Processor

Parameters:

name - Its name

fields - The list of fields on which it's active

finalize

protected void finalize()

Overrides:

finalize in class java.lang.Object

init

protected void init(java.lang.String name,
                    int sentenceMaxSize,
                    java.lang.String tag,
                    java.lang.String[] tagsToMatch,
                    boolean prefixWithTag,
                    char tagSeperator,
                    boolean prefixWithDisplayForm,
                    char displayFormSeperator,
                    int maxTokenSpan,
                    java.lang.String suffix,
                    java.lang.String[] fields)