cmoncrawl.processor.pipeline.streamer#

Classes

BaseStreamerFile(root, max_directory_size, ...)

Abstract Class which defines the basic functionality of a file streamer

IStreamer()

Base class for all outstreamers

StreamerDummy()

Dummy Streamer which keeps the output is memory

StreamerFileHTML(root, max_directory_size)

StreamerFileJSON(root, max_directory_size, ...)