Metadata-Version: 2.1
Name: robots-checker
Version: 1.2.1
Summary: A tool to filter out data from robots.txt restricted URL domains.
Author: Dongyang Fan
Requires-Python: >=3.7
Requires-Dist: datasets
Requires-Dist: pandas
Requires-Dist: protego

