com.exalead.linguistic.v10

Class ChineseTokenizer

java.lang.Object

com.exalead.linguistic.v10.Tokenizer

com.exalead.linguistic.v10.ChineseTokenizer

All Implemented Interfaces:

com.exalead.util.Checkable, java.io.Serializable

public class ChineseTokenizer
extends Tokenizer
implements com.exalead.util.Checkable, java.io.Serializable

When set in the configuration, tokenizes Chinese documents.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
boolean	addSimplified
static boolean	DEFAULT_ADD_SIMPLIFIED
java.lang.String	resourceDir

Constructor Summary

Constructors

Constructor and Description
ChineseTokenizer()
ChineseTokenizer(ChineseTokenizer o) Copy constructor

Method Summary

Modifier and Type	Method and Description
void	check(boolean deep, java.lang.String errorContext) Checks this ChineseTokenizer.
static ChineseTokenizer	fromString(java.lang.String s) String representation of this ChineseTokenizer.
java.lang.String	getResourceDir() URL for the resource (data://, file;// or resource://) if null, use standard resource of product.
boolean	isAddSimplified() Annotates each token with its simplified Chinese transliteration, when applicable.
ChineseTokenizer	makeCopy() Creates and returns a deep copy of this ChineseTokenizer.
static ChineseTokenizer	readFrom(java.io.InputStream is) Read this ChineseTokenizer from an XML fragment.
void	setAddSimplified(boolean addSimplified) Annotates each token with its simplified Chinese transliteration, when applicable.
void	setResourceDir(java.lang.String resourceDir) URL for the resource (data://, file;// or resource://) if null, use standard resource of product.
java.lang.String	toString() String representation of this ChineseTokenizer.
ChineseTokenizer	withAddSimplified(boolean addSimplified)
ChineseTokenizer	withAddSimplified(java.lang.Boolean addSimplified)
ChineseTokenizer	withResourceDir(java.lang.String resourceDir)
void	writeTo(java.io.OutputStream os) Write this ChineseTokenizer as an XML fragment

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

addSimplified

public boolean addSimplified

DEFAULT_ADD_SIMPLIFIED

public static final boolean DEFAULT_ADD_SIMPLIFIED

See Also:

Constant Field Values

resourceDir

public java.lang.String resourceDir

Constructor Detail

ChineseTokenizer

public ChineseTokenizer()

ChineseTokenizer

public ChineseTokenizer(ChineseTokenizer o)

Copy constructor

Method Detail

setAddSimplified

public void setAddSimplified(boolean addSimplified)

Annotates each token with its simplified Chinese transliteration, when applicable.

isAddSimplified

public boolean isAddSimplified()

Annotates each token with its simplified Chinese transliteration, when applicable.

withAddSimplified

public ChineseTokenizer withAddSimplified(boolean addSimplified)

withAddSimplified

public ChineseTokenizer withAddSimplified(java.lang.Boolean addSimplified)

setResourceDir

public void setResourceDir(java.lang.String resourceDir)

URL for the resource (data://, file;// or resource://)
if null, use standard resource of product.

getResourceDir

public java.lang.String getResourceDir()

URL for the resource (data://, file;// or resource://)
if null, use standard resource of product.

withResourceDir

public ChineseTokenizer withResourceDir(java.lang.String resourceDir)

makeCopy

public ChineseTokenizer makeCopy()

Creates and returns a deep copy of this ChineseTokenizer.

Overrides:

makeCopy in class Tokenizer

readFrom

public static ChineseTokenizer readFrom(java.io.InputStream is)
                                 throws javax.xml.bind.JAXBException

Read this ChineseTokenizer from an XML fragment.

Throws:

javax.xml.bind.JAXBException

writeTo

public void writeTo(java.io.OutputStream os)
             throws javax.xml.bind.JAXBException,
                    java.io.IOException

Write this ChineseTokenizer as an XML fragment

Overrides:

writeTo in class Tokenizer

Throws:

javax.xml.bind.JAXBException

java.io.IOException

fromString

public static ChineseTokenizer fromString(java.lang.String s)
                                   throws javax.xml.bind.JAXBException,
                                          java.io.UnsupportedEncodingException

String representation of this ChineseTokenizer.

Throws:

javax.xml.bind.JAXBException

java.io.UnsupportedEncodingException

toString

public java.lang.String toString()

String representation of this ChineseTokenizer.

Overrides:

toString in class Tokenizer

check

public void check(boolean deep,
                  java.lang.String errorContext)
           throws com.exalead.util.TypedException

Checks this ChineseTokenizer.

Specified by:

check in interface com.exalead.util.Checkable

Overrides:

check in class Tokenizer

Throws:

com.exalead.util.TypedException