Metadata-Version: 2.4
Name: gzspidertools
Version: 0.0.30
Summary: Scrapy Tools
License-File: LICENSE
Keywords: crawler,scraping,scrapy-extension
Requires-Python: >=3.11
Requires-Dist: aiohttp<3.11.0,>=3.10.6
Requires-Dist: aiomysql<0.2.0,>=0.1.1
Requires-Dist: curl-cffi>=0.13.0
Requires-Dist: dbutils<4.0.0,>=3.1.1
Requires-Dist: drissionpage<=4.1.1.2,>=v4.1.0.18
Requires-Dist: itemadapter<0.8.0,>=0.7.0
Requires-Dist: kafka-python<2.1.0,>=2.0.2
Requires-Dist: loguru<0.8.0,>=0.7.0
Requires-Dist: motor<3.6.0,>=3.5.1
Requires-Dist: pika<1.4.0,>=1.3.2
Requires-Dist: prometheus-client>=0.23.1
Requires-Dist: pymysql<2.0.0,>=1.0.2
Requires-Dist: scrapy==2.13.3
Requires-Dist: sqlalchemy<3.0.0,>=2.0.23
Provides-Extra: all
Requires-Dist: aio-pika<9.5.0,>=9.4.2; extra == 'all'
Requires-Dist: asyncpg<0.31.0,>=0.30.0; extra == 'all'
Requires-Dist: elasticsearch-dsl<9.0.0,>=8.11.0; extra == 'all'
Requires-Dist: mmh3<4.0.0,>=3.0.0; extra == 'all'
Requires-Dist: numpy<2.1.0,>=2.0.1; extra == 'all'
Requires-Dist: opencv-python<4.12.0.0,>=4.11.0.86; extra == 'all'
Requires-Dist: oracledb<4.0.0,>=3.3.0; extra == 'all'
Requires-Dist: oss2<3.0.0,>=2.18.4; extra == 'all'
Requires-Dist: psycopg[binary,pool]<3.3.0,>=3.2.0; extra == 'all'
Requires-Dist: pycryptodome<4.0.0,>=3.15.0; extra == 'all'
Requires-Dist: python-hcl2<5.0.0,>=4.3.0; extra == 'all'
Requires-Dist: pyyaml<6.1,>=6.0; extra == 'all'
Requires-Dist: redis<6.2.0,>=6.1.0; extra == 'all'
Provides-Extra: database
Requires-Dist: aio-pika<9.5.0,>=9.4.2; extra == 'database'
Requires-Dist: asyncpg<0.31.0,>=0.30.0; extra == 'database'
Requires-Dist: elasticsearch-dsl<9.0.0,>=8.11.0; extra == 'database'
Requires-Dist: oracledb<4.0.0,>=3.3.0; extra == 'database'
Requires-Dist: psycopg[binary,pool]<3.3.0,>=3.2.0; extra == 'database'
Requires-Dist: redis<6.2.0,>=6.1.0; extra == 'database'
Description-Content-Type: text/markdown

概述
=======
   一句话介绍：用于扩展 Scrapy 功能来解放双手。


安装
=======

   可以直接输入以下命令：

.. code:: bash

   pip install gzspidertools

-------------------------------

   可选安装1，安装数据库相关的所有依赖：

.. code:: bash

   pip install gzspidertools[database]

-----------------------------------------

   可选安装2，通过以下命令安装所有依赖：

.. code:: bash

   pip install gzspidertools[all]

注：详细的安装介绍请查看 `安装指南`_。

用法
=======
   开发人员只需根据命令生成示例模板，再配置相关设置即可。

   # 查看库版本
   gzcmd version

   # 创建项目
   gzcmd startproject <project_name>

   # 进入项目根目录
   cd <project_name>

   # 替换(覆盖)为真实的配置 .conf 文件：
   # 这里是为了演示方便，正常情况是直接在 VIT 中的 .conf 文件填上你需要的配置即可
   cp /root/mytemp/.conf DemoSpider/VIT/.conf

   # 生成爬虫脚本
   gzcmd genspider <spider_name> <example.com>

   # 运行脚本
   scrapy crawl <spider_name>
   # 注：也可以使用 gzcmd crawl <spider_name>
=======

## uv

uv 安装更新
> pip install --upgrade uv

uv sync


## build

> uv build 

> uv publish 
