Downloading pygments (1.2MiB)
Downloading aiohttp (1.7MiB)
Downloading hf-xet (4.3MiB)
Downloading pandas (10.3MiB)
Downloading pyarrow (47.8MiB)
Downloading numpy (15.9MiB)
 Downloading hf-xet
 Downloading aiohttp
 Downloading pygments
 Downloading numpy
 Downloading pandas
 Downloading pyarrow
Installed 40 packages in 927ms
============================= test session starts ==============================
platform linux -- Python 3.13.7, pytest-8.4.1, pluggy-1.6.0
rootdir: /tests
plugins: anyio-4.15.1, json-ctrf-0.3.5
collected 1 item

../tests/test_outputs.py .                                               [100%]

==================================== PASSES ====================================
______________________ test_compress_decompress_workflow _______________________
---------------------------- Captured stdout setup -----------------------------
Generating test data.
Generated mini-shard 1/10000
Generated mini-shard 101/10000
Generated mini-shard 201/10000
Generated mini-shard 301/10000
Generated mini-shard 401/10000
Generated mini-shard 501/10000
Generated mini-shard 601/10000
Generated mini-shard 701/10000
Generated mini-shard 801/10000
Generated mini-shard 901/10000
Generated mini-shard 1001/10000
Generated mini-shard 1101/10000
Generated mini-shard 1201/10000
Generated mini-shard 1301/10000
Generated mini-shard 1401/10000
Generated mini-shard 1501/10000
Generated mini-shard 1601/10000
Generated mini-shard 1701/10000
Generated mini-shard 1801/10000
Generated mini-shard 1901/10000
Generated mini-shard 2001/10000
Generated mini-shard 2101/10000
Generated mini-shard 2201/10000
Generated mini-shard 2301/10000
Generated mini-shard 2401/10000
Generated mini-shard 2501/10000
Generated mini-shard 2601/10000
Generated mini-shard 2701/10000
Generated mini-shard 2801/10000
Generated mini-shard 2901/10000
Generated mini-shard 3001/10000
Generated mini-shard 3101/10000
Generated mini-shard 3201/10000
Generated mini-shard 3301/10000
Generated mini-shard 3401/10000
Generated mini-shard 3501/10000
Generated mini-shard 3601/10000
Generated mini-shard 3701/10000
Generated mini-shard 3801/10000
Generated mini-shard 3901/10000
Generated mini-shard 4001/10000
Generated mini-shard 4101/10000
Generated mini-shard 4201/10000
Generated mini-shard 4301/10000
Generated mini-shard 4401/10000
Generated mini-shard 4501/10000
Generated mini-shard 4601/10000
Generated mini-shard 4701/10000
Generated mini-shard 4801/10000
Generated mini-shard 4901/10000
Generated mini-shard 5001/10000
Generated mini-shard 5101/10000
Generated mini-shard 5201/10000
Generated mini-shard 5301/10000
Generated mini-shard 5401/10000
Generated mini-shard 5501/10000
Generated mini-shard 5601/10000
Generated mini-shard 5701/10000
Generated mini-shard 5801/10000
Generated mini-shard 5901/10000
Generated mini-shard 6001/10000
Generated mini-shard 6101/10000
Generated mini-shard 6201/10000
Generated mini-shard 6301/10000
Generated mini-shard 6401/10000
Generated mini-shard 6501/10000
Generated mini-shard 6601/10000
Generated mini-shard 6701/10000
Generated mini-shard 6801/10000
Generated mini-shard 6901/10000
Generated mini-shard 7001/10000
Generated mini-shard 7101/10000
Generated mini-shard 7201/10000
Generated mini-shard 7301/10000
Generated mini-shard 7401/10000
Generated mini-shard 7501/10000
Generated mini-shard 7601/10000
Generated mini-shard 7701/10000
Generated mini-shard 7801/10000
Generated mini-shard 7901/10000
Generated mini-shard 8001/10000
Generated mini-shard 8101/10000
Generated mini-shard 8201/10000
Generated mini-shard 8301/10000
Generated mini-shard 8401/10000
Generated mini-shard 8501/10000
Generated mini-shard 8601/10000
Generated mini-shard 8701/10000
Generated mini-shard 8801/10000
Generated mini-shard 8901/10000
Generated mini-shard 9001/10000
Generated mini-shard 9101/10000
Generated mini-shard 9201/10000
Generated mini-shard 9301/10000
Generated mini-shard 9401/10000
Generated mini-shard 9501/10000
Generated mini-shard 9601/10000
Generated mini-shard 9701/10000
Generated mini-shard 9801/10000
Generated 9898 test files
---------------------------- Captured stderr setup -----------------------------
Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 4628 examples [00:00, 34313.48 examples/s]
Generating train split: 9408 examples [00:00, 28178.28 examples/s]
Generating train split: 14037 examples [00:00, 34185.07 examples/s]
Generating train split: 18508 examples [00:00, 34300.25 examples/s]
Generating train split: 23057 examples [00:00, 31520.75 examples/s]
Generating train split: 27549 examples [00:00, 34960.86 examples/s]
Generating train split: 32060 examples [00:00, 37488.43 examples/s]
Generating train split: 36548 examples [00:01, 38465.24 examples/s]
Generating train split: 41282 examples [00:01, 39246.78 examples/s]
Generating train split: 45801 examples [00:01, 34321.45 examples/s]
Generating train split: 55346 examples [00:01, 39676.47 examples/s]
Generating train split: 59997 examples [00:01, 40841.73 examples/s]
Generating train split: 64252 examples [00:01, 40559.95 examples/s]
Generating train split: 68767 examples [00:01, 39839.95 examples/s]
Generating train split: 73564 examples [00:01, 39859.02 examples/s]
Generating train split: 78065 examples [00:02, 36660.64 examples/s]
Generating train split: 82514 examples [00:02, 36950.51 examples/s]
Generating train split: 87212 examples [00:02, 37970.51 examples/s]
Generating train split: 91794 examples [00:02, 39609.78 examples/s]
Generating train split: 96407 examples [00:02, 36134.27 examples/s]
Generating train split: 100921 examples [00:02, 37623.49 examples/s]
Generating train split: 105527 examples [00:02, 39494.14 examples/s]
Generating train split: 110011 examples [00:02, 40764.29 examples/s]
Generating train split: 114448 examples [00:03, 39942.76 examples/s]
Generating train split: 123717 examples [00:03, 41794.03 examples/s]
Generating train split: 128199 examples [00:03, 42103.92 examples/s]
Generating train split: 132871 examples [00:03, 41919.80 examples/s]
Generating train split: 137465 examples [00:03, 38443.33 examples/s]
Generating train split: 142093 examples [00:03, 39740.60 examples/s]
Generating train split: 146537 examples [00:03, 40799.35 examples/s]
Generating train split: 151171 examples [00:03, 42208.84 examples/s]
Generating train split: 155695 examples [00:04, 42888.85 examples/s]
Generating train split: 160125 examples [00:04, 42883.67 examples/s]
Generating train split: 164831 examples [00:04, 42442.44 examples/s]
Generating train split: 169418 examples [00:04, 41432.35 examples/s]
Generating train split: 174224 examples [00:04, 36963.71 examples/s]
Generating train split: 178721 examples [00:04, 35742.58 examples/s]
Generating train split: 187976 examples [00:04, 39355.95 examples/s]
Generating train split: 192291 examples [00:05, 35880.92 examples/s]
Generating train split: 196759 examples [00:05, 37470.15 examples/s]
Generating train split: 201256 examples [00:05, 39097.49 examples/s]
Generating train split: 205928 examples [00:05, 40427.16 examples/s]
Generating train split: 210384 examples [00:05, 40584.46 examples/s]
Generating train split: 215024 examples [00:05, 39648.71 examples/s]
Generating train split: 219465 examples [00:05, 36034.47 examples/s]
Generating train split: 224136 examples [00:05, 37688.19 examples/s]
Generating train split: 228662 examples [00:05, 39278.10 examples/s]
Generating train split: 233020 examples [00:06, 40259.43 examples/s]
Generating train split: 237429 examples [00:06, 37635.43 examples/s]
Generating train split: 242080 examples [00:06, 34481.02 examples/s]
Generating train split: 246733 examples [00:06, 31843.26 examples/s]
Generating train split: 255874 examples [00:06, 35474.77 examples/s]
Generating train split: 260334 examples [00:06, 37136.20 examples/s]
Generating train split: 264806 examples [00:06, 38577.18 examples/s]
Generating train split: 269418 examples [00:07, 40174.99 examples/s]
Generating train split: 274149 examples [00:07, 41821.18 examples/s]
Generating train split: 278833 examples [00:07, 40288.18 examples/s]
Generating train split: 283387 examples [00:07, 40733.35 examples/s]
Generating train split: 287951 examples [00:07, 39831.34 examples/s]
Generating train split: 292646 examples [00:07, 37841.50 examples/s]
Generating train split: 297116 examples [00:07, 39232.50 examples/s]
Generating train split: 301743 examples [00:07, 40718.91 examples/s]
Generating train split: 306036 examples [00:07, 38803.82 examples/s]
Generating train split: 310765 examples [00:08, 39776.89 examples/s]
Generating train split: 315368 examples [00:08, 35956.80 examples/s]
Generating train split: 319765 examples [00:08, 37751.57 examples/s]
Generating train split: 324228 examples [00:08, 39072.08 examples/s]
Generating train split: 328806 examples [00:08, 39618.37 examples/s]
Generating train split: 333564 examples [00:08, 39568.46 examples/s]
Generating train split: 338040 examples [00:08, 35587.11 examples/s]
Generating train split: 342797 examples [00:08, 37783.66 examples/s]
Generating train split: 347254 examples [00:09, 37660.70 examples/s]
Generating train split: 351738 examples [00:09, 36672.55 examples/s]
Generating train split: 356318 examples [00:09, 38435.28 examples/s]
------------------------------ Captured log setup ------------------------------
WARNING  huggingface_hub.utils._http:_http.py:993 Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
----------------------------- Captured stdout call -----------------------------
Installing dependencies with uv sync...
Running compress script: /app/compress.py /app/c4_test_c9358cbb-4eba-45d2-aaa3-d5224faffe0c/ /app/c4_test_e9f2a541-ab78-4f05-912e-bb0dba3e7b33/
Compression test passed. Now testing decompression.
Running decompress script: /app/decompress.py /app/c4_test_e9f2a541-ab78-4f05-912e-bb0dba3e7b33/
Successfully verified 9898 files match original hashes
=========================== short test summary info ============================
PASSED ../tests/test_outputs.py::test_compress_decompress_workflow
======================== 1 passed in 143.31s (0:02:23) =========================
