snapshot command generator

Build install and run commands for web-snapshot-cli

Target

Website URL

Output directory

Where files are saved (snapshot) or served from (restore)

--crawlFollow same-origin links

--gobusterBundled wordlists; soft 404 pages are filtered out

--sitemapSeed from sitemap.xml / robots.txt

--resumeSkip already-downloaded files

Extra wordlists (one per line)

Builtin names: common, large. --gobuster uses both by default. Pages that return 200 but show 404/not-found content are skipped.

Wordlist extensions

Max pages

Depth

Concurrency

Crawl delay (sec)

Timeout (sec)

Output format

Include globs (one per line)

Exclude globs (one per line)

Cookies (name=value, one per line)

Headers (Name: Value, one per line)

Custom User-Agent

--robotsRespect robots.txt

--same-originSame origin only

--no-assetsSkip CSS/JS/images

--verboseDetailed logs

--dry-runDon't write files

snapshot https://example.com ./mirror

Install first: pip install web-snapshot-cli

After snapshot, restore locally: snapshot -restore ./mirror