ChineseTokenizer
• com.exalead.linguistic.v10.ChineseTokenizer
• When set in the configuration, tokenizes Chinese documents.
• Parent elements:
◦ com.exalead.linguistic.v10.TokenizationConfig (as TokenizationConfig)
• Attributes:
Name | Type | Default value | Description |
|---|
addSimplified | boolean | | Annotates each token with its simplified Chinese transliteration, when applicable. |
resourceDir | string | | URL for the resource (data://, file;// or resource://) if null, use standard resource of product. |