Name | Type | Default value | Description |
|---|---|---|---|
type | enum(token, separator, sentence, ignore, punct) | token | Values = "token", "separator", "sentence" (will break related terms extraction, named entities, ...), "ignore" or "punct" (sentence is considered as a separator but it is also considered as an entity separator for semantic extractors) |
toOverride | string |