Metadata-Version: 2.5
Name: dailyscraper
Version: 0.1.0a1
Summary: Web scraping framework with one interface for browser (Playwright) and HTTP scraping, JSON-defined scrapers and proxy rotation
Project-URL: Homepage, https://dailyscraper.com/
Project-URL: Source, https://github.com/quoterbox/dailyscraper
Project-URL: Issues, https://github.com/quoterbox/dailyscraper/issues
Author: JQ
License-Expression: MIT
License-File: LICENSE.md
License-File: THIRD_PARTY_LICENSES
Keywords: crawler,data-extraction,ecommerce,http,parallel,playwright,proxy-rotation,scraper,scraping,scraping-framework,web-scraping,xpath
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Internet :: WWW/HTTP
Requires-Python: >=3.13
Requires-Dist: openpyxl>=3.1
Requires-Dist: playwright==1.59.0
Requires-Dist: psutil>=6
Requires-Dist: pydantic>=2.9
Requires-Dist: python-dotenv>=1.0
Description-Content-Type: text/markdown

# DailyScraper
A web scraping framework for any website: scrape with a real browser (Playwright) or with plain HTTP requests (planned) through one shared interface.

# Why DailyScraper

### Quick start, even for complex websites
- Covers everyday web scraping needs: 99% of scraped data follows the same `list → details` structure
- Get started without writing code: just copy the **XPath/CSS** selectors of the elements you need from your browser
- Every scraper is a simple, readable JSON file
- Export data to **CSV, XLSX, XML and JSON**
- Scraping status notifications by email and messengers
- Works with any catalog type: classic pagination or infinite scroll

### Customization
- Process data at every stage with your own Python handlers
- Add your own page templates and handlers for them
- Flexible detection of the catalog end, blocks and other scenarios
- Simple, clear architecture that is easy to extend
- Works with both sync and async code (planned)
- Handy CLI to set up your own project in minutes

### Reliability
- Anti-captcha service support (planned)
- Use proxies for both browser and HTTP scraping (HTTP is planned)
- Residential proxy support
- Automatic recovery of browser processes after errors
- Automatic proxy rotation and cooldown
- Page templates and fallback selectors
