Jobsub ID 292996.1@dunegpschedd02.fnal.gov
| Jobsub ID | 292996.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12192 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 19:35:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2026-01-21 19:39:41 |
| From worker node | Hostname | dunegli-8386330-0-fnpc23025.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 19:36:34 |
| Input files | hd-protodune:np04hd_raw_run027306_0000_dataflow2_datawriter_0_20240619T175409.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2m (157s) |
| CPU time | 2m (129s = 82%) |
| Max RSS bytes | 1627459584 (1552 MiB) |
| Outputting started | 2026-01-21 19:39:11 |
| Output files | |
| Finished | 2026-01-21 19:39:41 |
| Saved logs | justin-logs:292996.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
mples within desired window for channel 9034
wclsFrameSaver: no samples within desired window for channel 9034
wclsFrameSaver: no samples within desired window for channel 9035
wclsFrameSaver: no samples within desired window for channel 9035
wclsFrameSaver: no samples within desired window for channel 9044
wclsFrameSaver: no samples within desired window for channel 9064
wclsFrameSaver: no samples within desired window for channel 9086
wclsFrameSaver: no samples within desired window for channel 9093
wclsFrameSaver: no samples within desired window for channel 9115
wclsFrameSaver: no samples within desired window for channel 9127
wclsFrameSaver: no samples within desired window for channel 9142
wclsFrameSaver: no samples within desired window for channel 9196
wclsFrameSaver: no samples within desired window for channel 9197
wclsFrameSaver: no samples within desired window for channel 9208
wclsFrameSaver: no samples within desired window for channel 9234
wclsFrameSaver: no samples within desired window for channel 9254
wclsFrameSaver: no samples within desired window for channel 9255
wclsFrameSaver: no samples within desired window for channel 9266
wclsFrameSaver: no samples within desired window for channel 9292
wclsFrameSaver: no samples within desired window for channel 9649
wclsFrameSaver: no samples within desired window for channel 9689
wclsFrameSaver: no samples within desired window for channel 9693
wclsFrameSaver: no samples within desired window for channel 9694
wclsFrameSaver: no samples within desired window for channel 9695
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9698
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9710
wclsFrameSaver: no samples within desired window for channel 9710
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9719
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9720
wclsFrameSaver: no samples within desired window for channel 9721
wclsFrameSaver: no samples within desired window for channel 9722
wclsFrameSaver: no samples within desired window for channel 9723
wclsFrameSaver: no samples within desired window for channel 9724
wclsFrameSaver: no samples within desired window for channel 9725
wclsFrameSaver: no samples within desired window for channel 9729
FrameSaver: q=2.43438e+06 n=1114715 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 5302 XUs and 4325 XVs -> 62 XUVs
C:0 T:1 70804 XUs and 64335 XVs -> 2683 XUVs
C:0 T:2 75710 XUs and 87110 XVs -> 2827 XUVs
C:0 T:3 97 XUs and 57 XVs -> 2 XUVs
C:0 T:4 38 XUs and 51 XVs -> 1 XUVs
C:0 T:5 27246 XUs and 29778 XVs -> 1089 XUVs
C:0 T:6 27196 XUs and 35751 XVs -> 472 XUVs
C:0 T:7 763 XUs and 1342 XVs -> 61 XUVs
7197 XUVs total
3048 collection wire objects
7197 potential space points
Neighbour search...
278017 tests to find 127574 neighbours
Iterating with no regularization...
Begin: 3.70763e+07
0 3.38768e+07
1 3.36211e+07
2 3.35955e+07
Now with regularization...
Begin: 3.17758e+07
0 3.17698e+07
21-Jan-2026 19:39:08 UTC Opened output file with pattern "%ifb_%tc_keepup.root"
21-Jan-2026 19:39:10 UTC Closed output file "np04hd_raw_run027306_0000_dataflow2_datawriter_0_20240619T175409_20260121T193910_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 98.6921 98.6921 98.6921 98.6921 0 1
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000193908 0.000193908 0.000193908 0.000193908 0 1
produce:tpcrawdecoder:PDHDTPCReader 11.0863 11.0863 11.0863 11.0863 0 1
produce:triggerrawdecoder:PDHDTriggerReader3 0.0538814 0.0538814 0.0538814 0.0538814 0 1
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0266362 0.0266362 0.0266362 0.0266362 0 1
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.13217 0.13217 0.13217 0.13217 0 1
produce:beamevent:BeamEvent 0.400815 0.400815 0.400815 0.400815 0 1
produce:fembfilter:PDHDFEMBFilter 0.000537572 0.000537572 0.000537572 0.000537572 0 1
produce:wclsdatahd:WireCellToolkit 55.5371 55.5371 55.5371 55.5371 0 1
produce:gaushit:GausHitFinder 0.54688 0.54688 0.54688 0.54688 0 1
produce:nhitsfilter:NumberOfHitsFilter 0.000666858 0.000666858 0.000666858 0.000666858 0 1
produce:reco3d:SpacePointSolver 0.910364 0.910364 0.910364 0.910364 0 1
produce:hitpdune:DisambigFromSpacePoints 0.512729 0.512729 0.512729 0.512729 0 1
produce:pandora:StandardPandora 25.9889 25.9889 25.9889 25.9889 0 1
produce:pandoraWriter:StandardPandora 0.142674 0.142674 0.142674 0.142674 0 1
produce:pandoraTrack:LArPandoraTrackCreation 1.22073 1.22073 1.22073 1.22073 0 1
produce:pandoraShower:LArPandoraShowerCreation 1.3279 1.3279 1.3279 1.3279 0 1
[art]:TriggerResults:TriggerResultInserter 9.2596e-05 9.2596e-05 9.2596e-05 9.2596e-05 0 1
end_path:out1:RootOutput 3.2212e-05 3.2212e-05 3.2212e-05 3.2212e-05 0 1
end_path:out1:RootOutput(write) 0.739354 0.739354 0.739354 0.739354 0 1
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 20649.2 MB
Peak resident set size usage (VmHWM): 1627.46 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 19M
-rw-r--r-- 1 dunegli fnalgrid 14M Jan 21 19:39 np04hd_raw_run027306_0000_dataflow2_datawriter_0_20240619T175409_20260121T193910_keepup.root
-rw-r--r-- 1 dunegli fnalgrid 5.3M Jan 21 19:39 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 119K Jan 21 19:39 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 44K Jan 21 19:39 mem.db
-rw-r--r-- 1 dunegli fnalgrid 16K Jan 21 19:39 time.db
-rw-r--r-- 1 dunegli fnalgrid 7.2K Jan 21 19:39 np04hd_raw_run027306_0000_dataflow2_datawriter_0_20240619T175409.hdf5_calibana.root
-rw-r--r-- 1 dunegli fnalgrid 3.5K Jan 21 19:39 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 83 Jan 21 19:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 21 19:37 debugprod.log
disk usage
19M .