π’
{{ form.max_urls.label_tag }}
{{ form.max_urls }}
{% if form.max_urls.errors %}
{{ form.max_urls.errors }}
{% endif %}
Maximum URLs in this crawl.
π¦
{{ form.crawl_max_size.label_tag }}
{{ form.crawl_max_size }}
{% if form.crawl_max_size.errors %}
{{ form.crawl_max_size.errors }}
{% endif %}
Combined size of files saved by this crawl.
β±οΈ
{{ form.crawl_timeout.label_tag }}
{{ form.crawl_timeout }}
{% if form.crawl_timeout.errors %}
{{ form.crawl_timeout.errors }}
{% endif %}
Time budget for this crawl.
β
{{ form.timeout.label_tag }}
{{ form.timeout }}
{% if form.timeout.errors %}
{{ form.timeout.errors }}
{% endif %}
Must be >10s: 11, 1.5m, 1hr.
π
{{ form.snapshot_max_size.label_tag }}
{{ form.snapshot_max_size }}
{% if form.snapshot_max_size.errors %}
{{ form.snapshot_max_size.errors }}
{% endif %}
Combined size of files saved by this crawl.
ποΈ
{{ form.delete_after.label_tag }}
{{ form.delete_after }}
{% if form.delete_after.errors %}
{{ form.delete_after.errors }}
{% endif %}
0 = keep forever. Durations: 1hr, 30d, 3mo.
{{ form.crawl_max_concurrent_snapshots.label_tag }}
{% include 'config/concurrency_control.html' with field=form.concurrency_config_field %}
{% if form.crawl_max_concurrent_snapshots.errors %}
{{ form.crawl_max_concurrent_snapshots.errors }}
{% endif %}