Jobsub ID 234655.17@dunegpschedd02.fnal.gov
| Jobsub ID | 234655.17@dunegpschedd02.fnal.gov |
| Workflow ID | 9431 |
| Stage ID | 1 |
| User name | drivera@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-10-29 12:48:33 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_brug_multicore |
| Last heartbeat | 2025-10-29 20:55:21 |
| From worker node | Hostname | wn-snel-004.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-10-29 13:10:13 |
| Input files | hd-protodune:np04hd_raw_run032935_0004_dataflow4_datawriter_0_20241204T003452.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 7h (27495s) |
| CPU time | 7h (26559s = 96%) |
| Max RSS bytes | 2184601600 (2083 MiB) |
| Outputting started | 2025-10-29 20:48:28 |
| Output files | |
| Finished | 2025-10-29 20:55:21 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
samples within desired window for channel 9418
wclsFrameSaver: no samples within desired window for channel 9419
wclsFrameSaver: no samples within desired window for channel 9420
wclsFrameSaver: no samples within desired window for channel 9420
wclsFrameSaver: no samples within desired window for channel 9420
wclsFrameSaver: no samples within desired window for channel 9421
wclsFrameSaver: no samples within desired window for channel 9422
wclsFrameSaver: no samples within desired window for channel 9422
wclsFrameSaver: no samples within desired window for channel 9423
wclsFrameSaver: no samples within desired window for channel 9423
wclsFrameSaver: no samples within desired window for channel 9424
wclsFrameSaver: no samples within desired window for channel 9425
wclsFrameSaver: no samples within desired window for channel 9425
wclsFrameSaver: no samples within desired window for channel 9426
wclsFrameSaver: no samples within desired window for channel 9426
wclsFrameSaver: no samples within desired window for channel 9427
wclsFrameSaver: no samples within desired window for channel 9428
wclsFrameSaver: no samples within desired window for channel 9428
wclsFrameSaver: no samples within desired window for channel 9429
wclsFrameSaver: no samples within desired window for channel 9429
wclsFrameSaver: no samples within desired window for channel 9430
wclsFrameSaver: no samples within desired window for channel 9431
wclsFrameSaver: no samples within desired window for channel 9432
wclsFrameSaver: no samples within desired window for channel 9432
wclsFrameSaver: no samples within desired window for channel 9433
wclsFrameSaver: no samples within desired window for channel 9434
wclsFrameSaver: no samples within desired window for channel 9434
wclsFrameSaver: no samples within desired window for channel 9435
wclsFrameSaver: no samples within desired window for channel 9436
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9438
wclsFrameSaver: no samples within desired window for channel 9438
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9440
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9441
wclsFrameSaver: no samples within desired window for channel 9442
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9444
wclsFrameSaver: no samples within desired window for channel 9445
wclsFrameSaver: no samples within desired window for channel 9446
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9447
wclsFrameSaver: no samples within desired window for channel 9448
wclsFrameSaver: no samples within desired window for channel 9448
wclsFrameSaver: no samples within desired window for channel 9449
wclsFrameSaver: no samples within desired window for channel 9449
wclsFrameSaver: no samples within desired window for channel 9449
wclsFrameSaver: no samples within desired window for channel 9450
wclsFrameSaver: no samples within desired window for channel 9451
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9452
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9453
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9454
wclsFrameSaver: no samples within desired window for channel 9455
wclsFrameSaver: no samples within desired window for channel 9455
wclsFrameSaver: no samples within desired window for channel 9456
wclsFrameSaver: no samples within desired window for channel 9457
wclsFrameSaver: no samples within desired window for channel 9458
wclsFrameSaver: no samples within desired window for channel 9458
wclsFrameSaver: no samples within desired window for channel 9459
wclsFrameSaver: no samples within desired window for channel 9460
wclsFrameSaver: no samples within desired window for channel 9461
wclsFrameSaver: no samples within desired window for channel 9520
wclsFrameSaver: no samples within desired window for channel 9620
wclsFrameSaver: no samples within desired window for channel 9626
wclsFrameSaver: no samples within desired window for channel 9685
wclsFrameSaver: no samples within desired window for channel 9685
wclsFrameSaver: no samples within desired window for channel 9686
wclsFrameSaver: no samples within desired window for channel 9686
wclsFrameSaver: no samples within desired window for channel 9752
FrameSaver: q=5.65889e+06 n=1021217 tag=wiener
29-Oct-2025 21:48:24 CET Closed output file "np04hd_raw_run032935_0004_dataflow4_datawriter_0_20241204T003452_1_234655_17_1761743431_deco_reco.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 202.919 700.28 2325.55 597.685 506.955 39
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.9998e-05 0.000165984 0.000430779 0.000151314 5.6454e-05 39
produce:tpcrawdecoder:PDHDTPCReader 18.7461 26.3415 68.8886 24.1891 8.20967 39
produce:fembfilter:PDHDFEMBFilter 0.000247145 0.00040789 0.00110659 0.000396194 0.000149022 39
produce:wclsdatahd:WireCellToolkit 92.8014 129.438 155.564 128.847 16.9574 39
produce:gaushit:GausHitFinder 0.792538 2.06524 3.26798 1.93266 0.609189 39
produce:nhitsfilter:NumberOfHitsFilter 0.00107745 0.00303177 0.00575215 0.00291218 0.00101665 39
produce:reco3d:SpacePointSolver 1.24402 62.5247 198.581 71.6252 50.6928 39
produce:hitpdune:DisambigFromSpacePoints 0.512344 8.66846 43.1788 7.57319 7.84162 39
produce:pandora:StandardPandora 32.6149 416.001 1879.14 304.168 439.14 39
produce:pandoraWriter:StandardPandora 0.429016 0.835813 1.36149 0.802344 0.219331 39
produce:pandoraTrack:LArPandoraTrackCreation 3.63241 17.0146 40.3992 17.1118 8.2635 39
produce:pandoraShower:LArPandoraShowerCreation 5.03086 18.077 43.8337 17.2381 8.39374 39
produce:pandoracalo:Calorimetry 2.40884 8.20258 19.4887 8.16578 3.99959 39
produce:pandoracalonosce:Calorimetry 1.89197 8.01236 22.0983 7.25016 4.22381 39
[art]:TriggerResults:TriggerResultInserter 6.1836e-05 0.000136309 0.000272351 0.000125185 3.98354e-05 39
end_path:out1:RootOutput 1.2744e-05 2.84956e-05 0.000118864 2.4707e-05 1.7318e-05 39
end_path:out1:RootOutput(write) 1.00276 2.25506 3.83427 2.15326 0.662347 39
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4099.45 MB
Peak resident set size usage (VmHWM): 2184.6 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'np04hd_raw_run032935_0004_dataflow4_datawriter_0_20241204T003452_1_234655_17_1761743431_deco_reco.root', 'start_time': 1761743431.0292287, 'end_time': 1761770906.6305711}
lsing
total 1.1G
-rw-r--r-- 1 dune090 dune 751M Oct 29 21:48 np04hd_raw_run032935_0004_dataflow4_datawriter_0_20241204T003452_1_234655_17_1761743431_deco_reco.root
-rw-r--r-- 1 dune090 dune 290M Oct 29 21:48 Pandora_Events.pndr
-rw-r--r-- 1 dune090 dune 6.1M Oct 29 21:48 jobscript.log
-rw-r--r-- 1 dune090 dune 6.0M Oct 29 21:48 np04hd_raw_run032935_0004_dataflow4_datawriter_0_20241204T003452_1_234655_17_1761743431_deco_reco.err
-rw-r--r-- 1 dune090 dune 280K Oct 29 21:48 mem.db
-rw-r--r-- 1 dune090 dune 56K Oct 29 21:48 time.db
-rw-r--r-- 1 dune090 dune 35K Oct 29 21:48 np04hd_raw_run032935_0004_dataflow4_datawriter_0_20241204T003452_1_234655_17_1761743431_deco_reco.log
-rw-r--r-- 1 dune090 dune 19K Oct 29 21:48 pdhd_keepup_decoder.root
-rw-r--r-- 1 dune090 dune 3.5K Oct 29 21:48 Pandora_Geometry.xml
-rw-r--r-- 1 dune090 dune 83 Oct 29 14:10 all-input-dids.txt
-rw-r--r-- 1 dune090 dune 0 Oct 29 14:10 debugprod.log
disk usage
1.1G . 