BasisTechTokenizer
• com.exalead.linguistic.v10.BasisTechTokenizer
• No documentation for this element.
• Parent elements:
◦ com.exalead.linguistic.v10.TokenizationConfig (as TokenizationConfig)
• Attributes:
Name | Type | Default value | Description |
|---|
language | iso code | | The language handled by this tokenizer. This can be null for all unhandled languages. |