Jobsub ID 240229.138@dunegpschedd01.fnal.gov
| Jobsub ID | 240229.138@dunegpschedd01.fnal.gov |
| Workflow ID | 9431 |
| Stage ID | 1 |
| User name | drivera@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-10-29 12:46:29 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep206 |
| Last heartbeat | 2025-10-29 20:29:13 |
| From worker node | Hostname | heplnc147.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-10-29 13:30:28 |
| Input files | hd-protodune:np04hd_raw_run032942_0000_dataflow0_datawriter_0_20241204T073521.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 6h (24701s) |
| CPU time | 6h (23180s = 93%) |
| Max RSS bytes | 2317000704 (2209 MiB) |
| Outputting started | 2025-10-29 20:22:13 |
| Output files | |
| Finished | 2025-10-29 20:29:13 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
aver: no samples within desired window for channel 8287
wclsFrameSaver: no samples within desired window for channel 8288
wclsFrameSaver: no samples within desired window for channel 8289
wclsFrameSaver: no samples within desired window for channel 8290
wclsFrameSaver: no samples within desired window for channel 8290
wclsFrameSaver: no samples within desired window for channel 8291
wclsFrameSaver: no samples within desired window for channel 8292
wclsFrameSaver: no samples within desired window for channel 8292
wclsFrameSaver: no samples within desired window for channel 8292
wclsFrameSaver: no samples within desired window for channel 8293
wclsFrameSaver: no samples within desired window for channel 8293
wclsFrameSaver: no samples within desired window for channel 8294
wclsFrameSaver: no samples within desired window for channel 8294
wclsFrameSaver: no samples within desired window for channel 8295
wclsFrameSaver: no samples within desired window for channel 8295
wclsFrameSaver: no samples within desired window for channel 8296
wclsFrameSaver: no samples within desired window for channel 8297
wclsFrameSaver: no samples within desired window for channel 8298
wclsFrameSaver: no samples within desired window for channel 8298
wclsFrameSaver: no samples within desired window for channel 8299
wclsFrameSaver: no samples within desired window for channel 8300
wclsFrameSaver: no samples within desired window for channel 8301
wclsFrameSaver: no samples within desired window for channel 8312
wclsFrameSaver: no samples within desired window for channel 8403
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8628
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8629
wclsFrameSaver: no samples within desired window for channel 8630
wclsFrameSaver: no samples within desired window for channel 8959
wclsFrameSaver: no samples within desired window for channel 9481
wclsFrameSaver: no samples within desired window for channel 9533
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9719
wclsFrameSaver: no samples within desired window for channel 9719
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9730
wclsFrameSaver: no samples within desired window for channel 9731
wclsFrameSaver: no samples within desired window for channel 9732
wclsFrameSaver: no samples within desired window for channel 9733
FrameSaver: q=8.05691e+06 n=1252054 tag=wiener
29-Oct-2025 20:21:52 GMT Closed output file "np04hd_raw_run032942_0000_dataflow0_datawriter_0_20241204T073521_1_240229_138_1761744638_deco_reco.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 91.7871 630.431 5949.55 210.151 1070.57 39
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.5391e-05 0.000162136 0.00209054 0.000100921 0.000314635 39
produce:tpcrawdecoder:PDHDTPCReader 15.6874 16.39 19.8703 16.2875 0.665244 39
produce:fembfilter:PDHDFEMBFilter 0.000107453 0.000169969 0.000576649 0.000157637 7.07182e-05 39
produce:wclsdatahd:WireCellToolkit 58.8179 82.5751 107.035 85.8182 10.3296 39
produce:gaushit:GausHitFinder 0.429409 1.32024 3.25964 1.21012 0.658188 39
produce:nhitsfilter:NumberOfHitsFilter 0.000260502 0.000710551 0.00131566 0.000714669 0.000270377 39
produce:reco3d:SpacePointSolver 0.263581 28.8716 123.944 10.5343 34.1419 39
produce:hitpdune:DisambigFromSpacePoints 0.160104 5.26716 37.2882 2.65346 6.95668 39
produce:pandora:StandardPandora 8.54017 479.24 5697.87 90.9239 1036.95 39
produce:pandoraWriter:StandardPandora 0.126961 0.340321 0.685811 0.322521 0.141883 39
produce:pandoraTrack:LArPandoraTrackCreation 0.625709 4.7111 21.666 3.59964 4.02947 39
produce:pandoraShower:LArPandoraShowerCreation 0.678316 5.39684 20.9017 4.29617 4.17634 39
produce:pandoracalo:Calorimetry 0.321132 2.34203 9.20258 1.7711 1.84056 39
produce:pandoracalonosce:Calorimetry 0.282 2.1299 7.84359 1.67581 1.64989 39
[art]:TriggerResults:TriggerResultInserter 3.174e-05 7.14785e-05 0.00017998 6.8169e-05 2.73968e-05 39
end_path:out1:RootOutput 6.843e-06 1.8597e-05 4.5446e-05 1.7513e-05 8.58174e-06 39
end_path:out1:RootOutput(write) 0.565266 1.47834 2.78397 1.38671 0.600565 39
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4324.88 MB
Peak resident set size usage (VmHWM): 2317 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'np04hd_raw_run032942_0000_dataflow0_datawriter_0_20241204T073521_1_240229_138_1761744638_deco_reco.root', 'start_time': 1761744638.8384123, 'end_time': 1761769313.1994565}
lsing
total 994M
-rw-r--r-- 1 pltdune04 pltdune 706M Oct 29 20:21 np04hd_raw_run032942_0000_dataflow0_datawriter_0_20241204T073521_1_240229_138_1761744638_deco_reco.root
-rw-r--r-- 1 pltdune04 pltdune 267M Oct 29 20:21 Pandora_Events.pndr
-rw-r--r-- 1 pltdune04 pltdune 6.8M Oct 29 20:21 jobscript.log
-rw-r--r-- 1 pltdune04 pltdune 6.6M Oct 29 20:21 np04hd_raw_run032942_0000_dataflow0_datawriter_0_20241204T073521_1_240229_138_1761744638_deco_reco.err
-rw-r--r-- 1 pltdune04 pltdune 276K Oct 29 20:21 mem.db
-rw-r--r-- 1 pltdune04 pltdune 56K Oct 29 20:21 time.db
-rw-r--r-- 1 pltdune04 pltdune 49K Oct 29 20:21 np04hd_raw_run032942_0000_dataflow0_datawriter_0_20241204T073521_1_240229_138_1761744638_deco_reco.log
-rw-r--r-- 1 pltdune04 pltdune 19K Oct 29 20:21 pdhd_keepup_decoder.root
-rw-r--r-- 1 pltdune04 pltdune 3.5K Oct 29 20:21 Pandora_Geometry.xml
-rw-r--r-- 1 pltdune04 pltdune 83 Oct 29 13:30 all-input-dids.txt
-rw-r--r-- 1 pltdune04 pltdune 0 Oct 29 13:30 debugprod.log
disk usage
994M . 