cmoncrawl.processor.pipeline.downloader
cmoncrawl.processor.pipeline.downloader#
Classes
|
|
|
Dummy downloader for testing It doesn't download anything but return files passed in the constructor and extracts metadata from the file |
Classes
|
|
|
Dummy downloader for testing It doesn't download anything but return files passed in the constructor and extracts metadata from the file |