Name | Type | Default value | Description |
|---|---|---|---|
url | string | The root url. | |
site | boolean | True | Enable site-mode: only crawl urls that belong to this 'site'. |
priority | int | Priority shift. Increase or decrease priority. 0 means normal, -1 is higher priority, +1 lower. | |
group | string | default | Key used to group rules and root urls. |
kvs | string | A semi-colon separated list of key-values. example: "key1=value1;key2=value2" |