Metadata-Version: 2.4
Name: arach
Version: 0.1.0
Summary: Concurrent ETA-optimized HTTP downloader.
License: MIT
Requires-Python: >=3.13
Description-Content-Type: text/markdown

# Spider

Spider is the project-local concurrent HTTP downloader.

## Entry points

Programmatic:

```python
from tools.spider import Download, DownloadManager
```

CLI:

```bash
python -m tools.spider --help
python -m tools.spider -j 5 -c 10 -o downloads URL1 URL2
```

`parallel` limits active files; `max_connections` limits HTTP connections globally. Spare range connections are assigned using predicted ETA reduction and runtime per-domain throughput learning.

See `docs/tools/spider/DOCS.md` for complete documentation.

<!-- exactus:inventory:start -->
## Directory contents

### Files

- [`__init__.py`](__init__.py) — Concurrent ETA-optimized HTTP downloader.
- [`__main__.py`](__main__.py) — Run Spider from ``python -m tools.spider``.
- [`core.py`](core.py) — Parallel HTTP downloads with a fixed-height ANSI terminal dashboard.

### Subdirectories

No subdirectories.

<!-- exactus:inventory:end -->
