com.exalead.mot.components

Class ChineseTokenizer

java.lang.Object

com.exalead.gni.GNIObject

com.exalead.mot.core.Converter

com.exalead.mot.components.ChineseTokenizer

public class ChineseTokenizer
extends Converter

Chinese tokenizer

Field Summary

Fields

Modifier and Type	Field and Description
boolean	addSimplified Should we add annotations on simplified chinese ?
java.lang.String	tokenizerResource The tokenizer resource name to use

Fields inherited from class com.exalead.mot.core.Converter

name, resource

Constructor Summary

Constructors

Constructor and Description
ChineseTokenizer(java.lang.String name, java.lang.String resource, java.lang.String tokenizerResource, boolean addSimplified) Initialize a chinese tokenizer

Method Summary

Modifier and Type	Method and Description
protected void	finalize()
static java.lang.String	getSimplifiedTag()
void	init(java.lang.String name, java.lang.String resource) Initialize the Converter

Methods inherited from class com.exalead.mot.core.Converter

destroy, init

Methods inherited from class com.exalead.gni.GNIObject

printInternalCppPointer

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

tokenizerResource

public java.lang.String tokenizerResource

The tokenizer resource name to use

addSimplified

public boolean addSimplified

Should we add annotations on simplified chinese ?

Constructor Detail

ChineseTokenizer

public ChineseTokenizer(java.lang.String name,
                        java.lang.String resource,
                        java.lang.String tokenizerResource,
                        boolean addSimplified)

Initialize a chinese tokenizer

Parameters:

name - Its name

resource - The associated resource name

tokenizerResource - The tokenizer resource name

addSimplified - Add annotations on simplified chinese

Method Detail

init

public void init(java.lang.String name,
                 java.lang.String resource)

Initialize the Converter

Specified by:

init in class Converter

Parameters:

name - Its name

resource - Its associated resource name

finalize

protected void finalize()

Overrides:

finalize in class java.lang.Object

getSimplifiedTag

public static java.lang.String getSimplifiedTag()