DAY-EC activated.
COMMAND_ID=261253ce-06c9-4e38-903d-defe3ced5231
STATUS=Failed RC=1
DAY-EC activated.
DAY-EC activated.
timestamp_utc	2026-06-03T06:42:26Z

== tmux tail ==
clconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/benchmarks/ru
n_bclconvert.L003.0003_tiles0263-0393.bench.tsv
    reason: Missing output files: /fsx/run_dir_mounts/20260514_LH01106_0009_B23T
VLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T
0642Z/tile_reports/L003/0003_tiles0263-0393/bclconvert.done, /fsx/run_dir_mounts
/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_d
evshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0003_tiles0263-0393/Reports/fa
stq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bc
lconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L0
03/0003_tiles0263-0393/Reports/Demultiplex_Stats.csv; Input files updated by ano
ther job: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclcon
vert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/normalized.SampleS
heet.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclcon
vert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/validated.ok
    wildcards: lane=L003, shard=0003_tiles0263-0393
    threads: 192
    resources: mem_mb=1200000, mem_mib=1144410, disk_mb=1000, disk_mib=954, tmpd
ir=<TBD>, threads=192, time=5440, partition=i192bigmem, vcpu=192, distribution=b
lock, exclusive=--exclusive, constraint=, exclude=, include=

TMPDIR=/dev/shm/dayoa_bclconvert_tmp bash workflow/scripts/run_bclconvert_lane.s
h docker://nfcore/bclconvert:4.0.3 /fsx/run_dir_mounts/20260514_LH01106_0009_B23
TVLGLT4 /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconve
rt_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/000
3_tiles0263-0393 /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from
_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/normalized.
SampleSheet.csv 3 /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_fro
m_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_repor
ts/L003/0003_tiles0263-0393/SampleSheet.csv false false false 1 24 4 64 32 false
 true 1000 '{"BarcodeMismatchesIndex1": "0", "BarcodeMismatchesIndex2": "0"}' '{
}' __dayoa_no_force__ 192 /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/f
asts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lo
gs/run_bclconvert.L003.0003_tiles0263-0393.log /fsx/run_dir_mounts/20260514_LH01
106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydir
fix_20260603T0642Z/tile_fastqs/L003/0003_tiles0263-0393/Reports/fastq_list.csv /
fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6
shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0003_tiles02
63-0393/Reports/Demultiplex_Stats.csv /fsx/run_dir_mounts/20260514_LH01106_0009_
B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260
603T0642Z/tile_reports/L003/0003_tiles0263-0393/bclconvert.done s_3_1367+s_3_136
8+s_3_1369+s_3_1370+s_3_1371+s_3_1372+s_3_1373+s_3_1374+s_3_1375+s_3_1376+s_3_13
77+s_3_1378+s_3_1379+s_3_1380+s_3_1381+s_3_1382+s_3_1383+s_3_1384+s_3_1385+s_3_1
386+s_3_1387+s_3_1388+s_3_1389+s_3_1390+s_3_1391+s_3_1392+s_3_1393+s_3_1394+s_3_
1395+s_3_1396+s_3_1397+s_3_1398+s_3_1401+s_3_1402+s_3_1403+s_3_1404+s_3_1405+s_3
_1406+s_3_1407+s_3_1408+s_3_1409+s_3_1410+s_3_1411+s_3_1412+s_3_1413+s_3_1414+s_
3_1415+s_3_1416+s_3_1417+s_3_1418+s_3_1419+s_3_1420+s_3_1421+s_3_1422+s_3_1423+s
_3_1424+s_3_1425+s_3_1426+s_3_1427+s_3_1428+s_3_1429+s_3_1430+s_3_1431+s_3_1432+
s_3_1433+s_3_1434+s_3_1435+s_3_1436+s_3_1437+s_3_1438+s_3_1439+s_3_1440+s_3_1441
+s_3_1442+s_3_1443+s_3_1444+s_3_1445+s_3_1446+s_3_1447+s_3_1448+s_3_1449+s_3_145
0+s_3_1451+s_3_1452+s_3_1453+s_3_1454+s_3_1455+s_3_1456+s_3_1457+s_3_1458+s_3_14
59+s_3_1460+s_3_1461+s_3_1462+s_3_1463+s_3_1464+s_3_1465+s_3_1466+s_3_1467+s_3_1
468+s_3_1469+s_3_1470+s_3_1471+s_3_1472+s_3_1473+s_3_1474+s_3_1475+s_3_1476+s_3_
1477+s_3_1478+s_3_1479+s_3_1480+s_3_1481+s_3_1482+s_3_1483+s_3_1484+s_3_1485+s_3
_1486+s_3_1487+s_3_1488+s_3_1489+s_3_1490+s_3_1491+s_3_1492+s_3_1493+s_3_1494+s_
3_1495+s_3_1496+s_3_1497+s_3_1498+s_3_2101 /dev/shm/dayoa_bclconvert 65000000000
0

[Wed Jun  3 06:41:55 2026]
rule merge_bclconvert_tile_shards:
    input: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclco
nvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_reports/L003
/0001_tiles0001-0131/bclconvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009_
B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260
603T0642Z/tile_reports/L003/0002_tiles0132-0262/bclconvert.done, /fsx/run_dir_mo
unts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigm
em_devshm_emptydirfix_20260603T0642Z/tile_reports/L003/0003_tiles0263-0393/bclco
nvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclc
onvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_reports/L00
3/0004_tiles0394-0524/bclconvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009
_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_2026
0603T0642Z/tile_reports/L003/0005_tiles0525-0654/bclconvert.done, /fsx/run_dir_m
ounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192big
mem_devshm_emptydirfix_20260603T0642Z/tile_reports/L003/0006_tiles0655-0784/bclc
onvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bcl
convert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L00
3/0001_tiles0001-0131/Reports/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH011
06_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirf
ix_20260603T0642Z/tile_fastqs/L003/0002_tiles0132-0262/Reports/fastq_list.csv, /
fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6
shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0003_tiles02
63-0393/Reports/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVL
GLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T06
42Z/tile_fastqs/L003/0004_tiles0394-0524/Reports/fastq_list.csv, /fsx/run_dir_mo
unts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigm
em_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0005_tiles0525-0654/Report
s/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_fro
m_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastq
s/L003/0006_tiles0655-0784/Reports/fastq_list.csv, /fsx/run_dir_mounts/20260514_
LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empt
ydirfix_20260603T0642Z/tile_fastqs/L003/0001_tiles0001-0131/Reports/Demultiplex_
Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclco
nvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/
0002_tiles0132-0262/Reports/Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_
LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empt
ydirfix_20260603T0642Z/tile_fastqs/L003/0003_tiles0263-0393/Reports/Demultiplex_
Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclco
nvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/
0004_tiles0394-0524/Reports/Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_
LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empt
ydirfix_20260603T0642Z/tile_fastqs/L003/0005_tiles0525-0654/Reports/Demultiplex_
Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclco
nvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/
0006_tiles0655-0784/Reports/Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_
LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empt
ydirfix_20260603T0642Z/normalized.SampleSheet.csv
    output: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclc
onvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_reports/L00
3/bclconvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_fr
om_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_fast
qs/L003/Reports/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVL
GLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T06
42Z/lane_fastqs/L003/Reports/Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514
_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emp
tydirfix_20260603T0642Z/lane_reports/L003/SampleSheet.csv
    log: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconv
ert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/merge_bclconve
rt_tile_shards.L003.log
    jobid: 3
    benchmark: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_b
clconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/benchmarks/me
rge_bclconvert_tile_shards.L003.bench.tsv
    reason: Missing output files: /fsx/run_dir_mounts/20260514_LH01106_0009_B23T
VLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T
0642Z/lane_reports/L003/bclconvert.done, /fsx/run_dir_mounts/20260514_LH01106_00
09_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20
260603T0642Z/lane_fastqs/L003/Reports/Demultiplex_Stats.csv, /fsx/run_dir_mounts
/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_d
evshm_emptydirfix_20260603T0642Z/lane_fastqs/L003/Reports/fastq_list.csv, /fsx/r
un_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard
_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_reports/L003/SampleSheet.csv;
 Input files updated by another job: /fsx/run_dir_mounts/20260514_LH01106_0009_B
23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_202606
03T0642Z/tile_fastqs/L003/0005_tiles0525-0654/Reports/Demultiplex_Stats.csv, /fs
x/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6sh
ard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_reports/L003/0001_tiles000
1-0131/bclconvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fas
ts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile
_reports/L003/0006_tiles0655-0784/bclconvert.done, /fsx/run_dir_mounts/20260514_
LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empt
ydirfix_20260603T0642Z/tile_fastqs/L003/0005_tiles0525-0654/Reports/fastq_list.c
sv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l
003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0003_ti
les0263-0393/Reports/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B
23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_202606
03T0642Z/tile_fastqs/L003/0006_tiles0655-0784/Reports/fastq_list.csv, /fsx/run_d
ir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i19
2bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0001_tiles0001-0131/R
eports/Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGL
T4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642
Z/tile_fastqs/L003/0001_tiles0001-0131/Reports/fastq_list.csv, /fsx/run_dir_moun
ts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem
_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0003_tiles0263-0393/Reports/
Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fast
s_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_
fastqs/L003/0002_tiles0132-0262/Reports/Demultiplex_Stats.csv, /fsx/run_dir_moun
ts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem
_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0006_tiles0655-0784/Reports/
Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fast
s_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_
reports/L003/0002_tiles0132-0262/bclconvert.done, /fsx/run_dir_mounts/20260514_L
H01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empty
dirfix_20260603T0642Z/normalized.SampleSheet.csv, /fsx/run_dir_mounts/20260514_L
H01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_empty
dirfix_20260603T0642Z/tile_reports/L003/0004_tiles0394-0524/bclconvert.done, /fs
x/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6sh
ard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs/L003/0004_tiles0394
-0524/Reports/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGL
T4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642
Z/tile_reports/L003/0003_tiles0263-0393/bclconvert.done, /fsx/run_dir_mounts/202
60514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devsh
m_emptydirfix_20260603T0642Z/tile_fastqs/L003/0004_tiles0394-0524/Reports/Demult
iplex_Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from
_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_report
s/L003/0005_tiles0525-0654/bclconvert.done, /fsx/run_dir_mounts/20260514_LH01106
_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix
_20260603T0642Z/tile_fastqs/L003/0002_tiles0132-0262/Reports/fastq_list.csv
    wildcards: lane=L003
    resources: mem_mb=3000, mem_mib=2862, disk_mb=1000, disk_mib=954, tmpdir=<TB
D>, threads=1, time=5440, partition=i192bigmem, vcpu=1, distribution=block, excl
usive=, constraint=, exclude=, include=

python workflow/scripts/merge_bclconvert_tile_shards.py --tile-fastq-root /fsx/r
un_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard
_i192bigmem_devshm_emptydirfix_20260603T0642Z/tile_fastqs --lane-output-dir /fsx
/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6sha
rd_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_fastqs/L003 --report-dir /f
sx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6s
hard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_fastqs/L003/Reports --lan
e L003 --shards 0001_tiles0001-0131,0002_tiles0132-0262,0003_tiles0263-0393,0004
_tiles0394-0524,0005_tiles0525-0654,0006_tiles0655-0784 --merge-fastqs false --s
ample-sheet /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclc
onvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/normalized.Sampl
eSheet.csv --lane-sample-sheet /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLG
LT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T064
2Z/lane_reports/L003/SampleSheet.csv --done /fsx/run_dir_mounts/20260514_LH01106
_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix
_20260603T0642Z/lane_reports/L003/bclconvert.done --log /fsx/run_dir_mounts/2026
0514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm
_emptydirfix_20260603T0642Z/logs/merge_bclconvert_tile_shards.L003.log >> /fsx/r
un_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard
_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/merge_bclconvert_tile_shards.
L003.log 2>&1 && test -s /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fa
sts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lan
e_fastqs/L003/Reports/fastq_list.csv && test -s /fsx/run_dir_mounts/20260514_LH0
1106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydi
rfix_20260603T0642Z/lane_fastqs/L003/Reports/Demultiplex_Stats.csv

[Wed Jun  3 06:41:55 2026]
localrule run_bclconvert:
    input: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclco
nvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/validated.ok
, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l00
3_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/normalized.SampleSheet.csv
, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l00
3_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_reports/L003/bclconve
rt.done, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconv
ert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_fastqs/L003/Re
ports/fastq_list.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts
_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_f
astqs/L003/Reports/Demultiplex_Stats.csv, /fsx/run_dir_mounts/20260514_LH01106_0
009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_2
0260603T0642Z/lane_reports/L003/SampleSheet.csv
    output: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclc
onvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/bclconvert.
done
    log: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconv
ert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/run_bclconvert
.lane_fastqs_ready.log
    jobid: 2
    benchmark: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_b
clconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/benchmarks/ru
n_bclconvert.lane_fastqs_ready.bench.tsv
    reason: Missing output files: /fsx/run_dir_mounts/20260514_LH01106_0009_B23T
VLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T
0642Z/logs/bclconvert.done; Input files updated by another job: /fsx/run_dir_mou
nts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigme
m_devshm_emptydirfix_20260603T0642Z/lane_fastqs/L003/Reports/Demultiplex_Stats.c
sv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l
003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/validated.ok, /fsx/
run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shar
d_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_fastqs/L003/Reports/fastq_li
st.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconve
rt_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_reports/L003/bc
lconvert.done, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_b
clconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/normalized.Sa
mpleSheet.csv, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_b
clconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_reports/
L003/SampleSheet.csv
    resources: mem_mb=3000, mem_mib=2862, disk_mb=1000, disk_mib=954, tmpdir=/de
v/shm/dayoa_bclconvert_tmp, threads=1, time=5440, partition=i192bigmem, vcpu=1,
distribution=block, exclusive=, constraint=, exclude=, include=


            set -euo pipefail
            mkdir -p /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_
from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs
            : > /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_
bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/run_bcl
convert.lane_fastqs_ready.log
            printf 'merge_lane_fastqs=false; lane FASTQs remain under %s for lan
es %s\n' \
              /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bc
lconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/lane_fastqs L0
03 >> /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert
_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/run_bclconvert.la
ne_fastqs_ready.log
            touch /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_fro
m_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/bclco
nvert.done


[Wed Jun  3 06:41:55 2026]
localrule produce_bclconvert_fastqs:
    input: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclco
nvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/validated.ok
, /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert_l00
3_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/logs/bclconvert.done
    output: /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclc
onvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/fastqs.complete
    log: results/day/hg38/logs/produce_bclconvert_fastqs.log
    jobid: 0
    benchmark: results/day/hg38/benchmarks/produce_bclconvert_fastqs.bench.tsv
    reason: Missing output files: /fsx/run_dir_mounts/20260514_LH01106_0009_B23T
VLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T
0642Z/fastqs.complete, results/day/hg38/benchmarks/produce_bclconvert_fastqs.ben
ch.tsv; Input files updated by another job: /fsx/run_dir_mounts/20260514_LH01106
_0009_B23TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix
_20260603T0642Z/logs/validated.ok, /fsx/run_dir_mounts/20260514_LH01106_0009_B23
TVLGLT4/fasts_from_bclconvert_l003_6shard_i192bigmem_devshm_emptydirfix_20260603
T0642Z/logs/bclconvert.done
    resources: mem_mb=3000, mem_mib=2862, disk_mb=1000, disk_mib=954, tmpdir=/de
v/shm, threads=1, time=5440, partition=i192,i128,i192mem, vcpu=1, distribution=b
lock, exclusive=, constraint=, exclude=, include=

touch /fsx/run_dir_mounts/20260514_LH01106_0009_B23TVLGLT4/fasts_from_bclconvert
_l003_6shard_i192bigmem_devshm_emptydirfix_20260603T0642Z/fastqs.complete
Job stats:
job                             count    min threads    max threads
----------------------------  -------  -------------  -------------
bclconvert_validate_inputs          1              1              1
merge_bclconvert_tile_shards        1              1              1
produce_bclconvert_fastqs           1              1              1
run_bclconvert                      1              1              1
run_bclconvert_tile_shard           6            192            192
total                              10              1            192

Reasons:
    (check individual jobs above for details)
    input files updated by another job:
        merge_bclconvert_tile_shards, produce_bclconvert_fastqs, run_bclconvert,
 run_bclconvert_tile_shard
    missing output files:
        bclconvert_validate_inputs, merge_bclconvert_tile_shards, produce_bclcon
vert_fastqs, run_bclconvert, run_bclconvert_tile_shard

This was a dry-run (flag -n). The order of jobs does not reflect the order of ex
ecution.
RETURN CODE: 0
__DRYRUN_EMPTYDIRFIX_EXIT__=0
[Dslu](DAYOA)

== dryrun validation ==
exit_line	__DRYRUN_EMPTYDIRFIX_EXIT__=0

STDERR:
failed to run commands: exit status 1
