com.exalead.mot.components

Class JapaneseTokenizer

java.lang.Object

com.exalead.gni.GNIObject

com.exalead.mot.core.Converter

com.exalead.mot.components.JapaneseTokenizer

public class JapaneseTokenizer
extends Converter

Japanese tokenizer

Field Summary

Fields

Modifier and Type	Field and Description
boolean	addMorphology add morphology annotations
boolean	addRomanji add romaji annotations
boolean	queryMode query mode
java.lang.String	tokenizerResource the tokenizer's resource name

Fields inherited from class com.exalead.mot.core.Converter

name, resource

Constructor Summary

Constructors

Constructor and Description
JapaneseTokenizer(java.lang.String name, java.lang.String resource, java.lang.String tokenizerResource, boolean addRomanji, boolean addMorphology, boolean query) Initialize a new japanese tokenizer

Method Summary

Modifier and Type	Method and Description
void	enableQueryMode() Enable the query mode
protected void	finalize()
static java.lang.String	getExpandedTag()
static java.lang.String	getFactorizedTag()
static java.lang.String	getHiraganaTag()
static java.lang.String	getMorphologyTag()
static java.lang.String	getRadicalExpandTag()
static java.lang.String	getRadicalFactorTag()
static java.lang.String	getRomanjiTag()
void	init(java.lang.String name, java.lang.String resource) Initialize the Converter
void	init(java.lang.String name, java.lang.String tokenizerResource, java.lang.String resource, boolean queryMode, boolean addRomanji, boolean addMorphology)

Methods inherited from class com.exalead.mot.core.Converter

destroy, init

Methods inherited from class com.exalead.gni.GNIObject

printInternalCppPointer

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

queryMode

public boolean queryMode

query mode

addRomanji

public boolean addRomanji

add romaji annotations

addMorphology

public boolean addMorphology

add morphology annotations

tokenizerResource

public java.lang.String tokenizerResource

the tokenizer's resource name

Constructor Detail

JapaneseTokenizer

public JapaneseTokenizer(java.lang.String name,
                         java.lang.String resource,
                         java.lang.String tokenizerResource,
                         boolean addRomanji,
                         boolean addMorphology,
                         boolean query)

Initialize a new japanese tokenizer

Parameters:

name - Its name

resource - The associated resource name

tokenizerResource - The tokenizer's resource name

addRomanji - Should we annotate romaji words?

addMorphology - Should we annotate morphology?

query - Use query mode?

Method Detail

init

public void init(java.lang.String name,
                 java.lang.String resource)

Initialize the Converter

Specified by:

init in class Converter

Parameters:

name - Its name

resource - Its associated resource name

init

public void init(java.lang.String name,
                 java.lang.String tokenizerResource,
                 java.lang.String resource,
                 boolean queryMode,
                 boolean addRomanji,
                 boolean addMorphology)

finalize

protected void finalize()

Overrides:

finalize in class java.lang.Object

enableQueryMode

public void enableQueryMode()

Enable the query mode

getHiraganaTag

public static java.lang.String getHiraganaTag()

getFactorizedTag

public static java.lang.String getFactorizedTag()

getExpandedTag

public static java.lang.String getExpandedTag()

getRomanjiTag

public static java.lang.String getRomanjiTag()

getMorphologyTag

public static java.lang.String getMorphologyTag()

getRadicalFactorTag

public static java.lang.String getRadicalFactorTag()

getRadicalExpandTag

public static java.lang.String getRadicalExpandTag()