Jobsub ID 240229.10@dunegpschedd01.fnal.gov
| Jobsub ID | 240229.10@dunegpschedd01.fnal.gov |
| Workflow ID | 9431 |
| Stage ID | 1 |
| User name | drivera@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6815744000 (6500 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-10-29 12:46:29 |
| Site | UK_Sheffield |
| Entry | DUNE_UK_Sheffield_lcgce2 |
| Last heartbeat | 2025-10-29 20:38:55 |
| From worker node | Hostname | wn039.hep |
| cpuinfo | AMD EPYC 7402 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Started | 2025-10-29 12:47:50 |
| Input files | hd-protodune:np04hd_raw_run032935_0001_dataflow5_datawriter_0_20241204T003309.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 7h (27857s) |
| CPU time | 7h (26275s = 94%) |
| Max RSS bytes | 2968436736 (2830 MiB) |
| Outputting started | 2025-10-29 20:32:08 |
| Output files | |
| Finished | 2025-10-29 20:38:55 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
within desired window for channel 9383
wclsFrameSaver: no samples within desired window for channel 9405
wclsFrameSaver: no samples within desired window for channel 9406
wclsFrameSaver: no samples within desired window for channel 9568
wclsFrameSaver: no samples within desired window for channel 9569
wclsFrameSaver: no samples within desired window for channel 9569
wclsFrameSaver: no samples within desired window for channel 9570
wclsFrameSaver: no samples within desired window for channel 9571
wclsFrameSaver: no samples within desired window for channel 9571
wclsFrameSaver: no samples within desired window for channel 9572
wclsFrameSaver: no samples within desired window for channel 9572
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9574
wclsFrameSaver: no samples within desired window for channel 9574
wclsFrameSaver: no samples within desired window for channel 9574
wclsFrameSaver: no samples within desired window for channel 9575
wclsFrameSaver: no samples within desired window for channel 9575
wclsFrameSaver: no samples within desired window for channel 9575
wclsFrameSaver: no samples within desired window for channel 9576
wclsFrameSaver: no samples within desired window for channel 9576
wclsFrameSaver: no samples within desired window for channel 9576
wclsFrameSaver: no samples within desired window for channel 9577
wclsFrameSaver: no samples within desired window for channel 9577
wclsFrameSaver: no samples within desired window for channel 9578
wclsFrameSaver: no samples within desired window for channel 9578
wclsFrameSaver: no samples within desired window for channel 9578
wclsFrameSaver: no samples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9580
wclsFrameSaver: no samples within desired window for channel 9580
wclsFrameSaver: no samples within desired window for channel 9581
wclsFrameSaver: no samples within desired window for channel 9581
wclsFrameSaver: no samples within desired window for channel 9583
wclsFrameSaver: no samples within desired window for channel 9584
wclsFrameSaver: no samples within desired window for channel 9585
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9726
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9727
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9728
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9729
wclsFrameSaver: no samples within desired window for channel 9730
wclsFrameSaver: no samples within desired window for channel 9730
wclsFrameSaver: no samples within desired window for channel 9731
wclsFrameSaver: no samples within desired window for channel 9732
wclsFrameSaver: no samples within desired window for channel 9732
wclsFrameSaver: no samples within desired window for channel 9732
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9733
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9734
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9736
FrameSaver: q=2.69956e+07 n=1747846 tag=wiener
29-Oct-2025 20:32:06 GMT Closed output file "np04hd_raw_run032935_0001_dataflow5_datawriter_0_20241204T003309_1_240229_10_1761742084_deco_reco.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 123.088 688.484 3406.38 522.319 608.73 40
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.0391e-05 0.000163215 0.0014186 0.000107649 0.000217234 40
produce:tpcrawdecoder:PDHDTPCReader 19.1866 21.1427 27.5369 20.5194 1.82173 40
produce:fembfilter:PDHDFEMBFilter 0.000116861 0.00019565 0.000570595 0.000176302 8.94686e-05 40
produce:wclsdatahd:WireCellToolkit 60.1266 82.2568 93.1741 83.9441 8.66468 40
produce:gaushit:GausHitFinder 0.635178 1.47021 2.35729 1.50995 0.35545 40
produce:nhitsfilter:NumberOfHitsFilter 0.000513609 0.00079211 0.00129517 0.000782851 0.000198026 40
produce:reco3d:SpacePointSolver 0.676529 113.975 398.006 104.434 80.0186 40
produce:hitpdune:DisambigFromSpacePoints 0.35657 6.63302 13.5358 7.09889 2.86997 40
produce:pandora:StandardPandora 8.6365 446.873 3105.25 320.686 562.708 40
produce:pandoraWriter:StandardPandora 0.168874 0.614555 0.975478 0.64153 0.182522 40
produce:pandoraTrack:LArPandoraTrackCreation 0.949853 4.28468 7.00466 4.21939 1.44181 40
produce:pandoraShower:LArPandoraShowerCreation 1.08085 4.13835 6.83814 4.09872 1.4062 40
produce:pandoracalo:Calorimetry 0.532465 2.04423 4.49793 2.01145 0.781908 40
produce:pandoracalonosce:Calorimetry 0.466315 1.98502 4.35512 1.93963 0.818806 40
[art]:TriggerResults:TriggerResultInserter 4.5997e-05 7.87284e-05 0.000144793 7.3338e-05 2.3606e-05 40
end_path:out1:RootOutput 5.48e-06 1.75358e-05 4.4183e-05 1.59255e-05 8.72492e-06 40
end_path:out1:RootOutput(write) 1.21875 2.74858 3.95283 2.76826 0.643505 40
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4870.58 MB
Peak resident set size usage (VmHWM): 2968.44 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'np04hd_raw_run032935_0001_dataflow5_datawriter_0_20241204T003309_1_240229_10_1761742084_deco_reco.root', 'start_time': 1761742084.0906768, 'end_time': 1761769927.1831}
lsing
total 1.2G
-rw-r--r--. 1 dune004 dune 871M Oct 29 20:32 np04hd_raw_run032935_0001_dataflow5_datawriter_0_20241204T003309_1_240229_10_1761742084_deco_reco.root
-rw-r--r--. 1 dune004 dune 315M Oct 29 20:31 Pandora_Events.pndr
-rw-r--r--. 1 dune004 dune 6.5M Oct 29 20:32 jobscript.log
-rw-r--r--. 1 dune004 dune 6.1M Oct 29 20:32 np04hd_raw_run032935_0001_dataflow5_datawriter_0_20241204T003309_1_240229_10_1761742084_deco_reco.err
-rw-r--r--. 1 dune004 dune 284K Oct 29 20:32 mem.db
-rw-r--r--. 1 dune004 dune 199K Oct 29 20:32 np04hd_raw_run032935_0001_dataflow5_datawriter_0_20241204T003309_1_240229_10_1761742084_deco_reco.log
-rw-r--r--. 1 dune004 dune 56K Oct 29 20:32 time.db
-rw-r--r--. 1 dune004 dune 20K Oct 29 20:32 pdhd_keepup_decoder.root
-rw-r--r--. 1 dune004 dune 3.5K Oct 29 20:32 Pandora_Geometry.xml
-rw-r--r--. 1 dune004 dune 83 Oct 29 12:48 all-input-dids.txt
-rw-r--r--. 1 dune004 dune 0 Oct 29 12:48 debugprod.log
disk usage
1.2G . 