ScrapeTL

New Scraper

Scraper Script (.py) *

📄

Click or Drag .py file here

must define BaseScraper class
and implement start_scrape()

Scraper Name *

Homepage URL

Description

Thumbnail Preview

🎌

Source Link / File

📂 Upload...

Release Notes / Commit Message

TAG:

Registered Scrapers

0

No scrapers registered yet. Click "+ Add Scraper" to create one.

New Schedule

Input Parameters

Select a scraper to view available parameters.

Scraper Plugin *

Schedule Name (Optional)

Execution Cycle (Cron Expression) *

Thumbnail Preview

📅

Thumbnail URL Override

📂 Upload...

🎌 Defaults to the parent scraper's thumbnail.
Change URL or upload a file to override specifically for this schedule.

TAG:

Active Schedules

0

No schedules configured.

Scrape History

Task Queue

Catch-up tasks and one-time executions

	Photo	Scraper	Scheduled For ▼	Label / Note	Status
Queue is empty.

Add Connector

Set up automated notifications and data piping.

Discord Webhook

Send scrape results to Discord.

HTTP Request

POST, PUT, or GET any web endpoint.

Integrations

0

No integrations yet.

Context Registry

Shared values and dynamic expressions accessible by all scrapers.

	Type	Key / Variable	Current Value	Status	Description	Actions

NEW

New Scraper Flow

Snap

100%

General Settings

🌍 Language & Time

IANA Timezone

Used for interpreting cron schedules.

🌐 Browser Defaults (Playwright)

Default Mode

Default execution visibility.

Remote Playwright Server (CDP URL)

Leave blank to use local Chromium executable.

🧹 Maintenance & Logging

Log Storage Directory

Root folder for per-run .log files.

Log Retention (Days)

Automatic purging of logs older than this.

Max Log File Size (KB)

Limits the captured stdout per run.

Payload Preview Row Limit (0 for unlimited)

Number of data rows saved in DB.

Batch Throttle (seconds)

Delay between iterations when running a Batch variable.