Parameter | Description |
|---|---|
Scan latest entries only | If selected, the next scan starts at the latest scanned log entry. |
Line format | Specify the format of the log files. According to the selected pattern, you need to create the corresponding log fields. |
Encoding | Enter the file encoding to use. By default, utf-8. |
Max number of crawled lines | Defines the maximum number of lines crawled for a single file. |
Log fields | Add fields corresponding to the selected log file format in Line pattern definition. |
Additional output | You can: • Add a meta for the name of the file that has been scanned: Set file name in the meta. • Add a meta for the line scanned in the file: Set file line in the meta. • Add a meta for data that have not been parsed properly: Set lines that do not match the format in the meta. • Group data that has not been parsed properly in a single document: Group consecutive lines that do not match the format. |
Filesystem paths | Enter the filesystem path for the files (.ZIP, .LOG, .GZ) or directory to crawl. You can prefix paths by: • data:// OR /data – relative to the <DATADIR> • resource:// – relative to the NGRESOURCEPATH (see definition on <DATADIR>/bin/ngstart.env) • kit:// – relative to the <INSTALLDIR> • file:// – absolute path, for example, file://temp/csv-data/ Click Add path for each path you want to crawl. |