Jobsub ID 292996.0@dunegpschedd02.fnal.gov
| Jobsub ID | 292996.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12192 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 19:35:07 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce03_mcore_op_duneonly |
| Last heartbeat | 2026-01-21 19:39:48 |
| From worker node | Hostname | dunegli-8231278-0-fnpc23043.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 19:36:41 |
| Input files | hd-protodune:np04hd_raw_run027306_0001_dataflow2_datawriter_0_20240619T175445.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2m (156s) |
| CPU time | 2m (129s = 82%) |
| Max RSS bytes | 1602969600 (1528 MiB) |
| Outputting started | 2026-01-21 19:39:18 |
| Output files | |
| Finished | 2026-01-21 19:39:48 |
| Saved logs | justin-logs:292996.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
er: no samples within desired window for channel 8561
wclsFrameSaver: no samples within desired window for channel 8580
wclsFrameSaver: no samples within desired window for channel 8581
wclsFrameSaver: no samples within desired window for channel 8599
wclsFrameSaver: no samples within desired window for channel 8601
wclsFrameSaver: no samples within desired window for channel 8606
wclsFrameSaver: no samples within desired window for channel 8610
wclsFrameSaver: no samples within desired window for channel 8612
wclsFrameSaver: no samples within desired window for channel 8631
wclsFrameSaver: no samples within desired window for channel 8633
wclsFrameSaver: no samples within desired window for channel 8637
wclsFrameSaver: no samples within desired window for channel 8639
wclsFrameSaver: no samples within desired window for channel 8653
wclsFrameSaver: no samples within desired window for channel 8658
wclsFrameSaver: no samples within desired window for channel 8658
wclsFrameSaver: no samples within desired window for channel 8659
wclsFrameSaver: no samples within desired window for channel 8663
wclsFrameSaver: no samples within desired window for channel 8675
wclsFrameSaver: no samples within desired window for channel 8676
wclsFrameSaver: no samples within desired window for channel 8689
wclsFrameSaver: no samples within desired window for channel 8716
wclsFrameSaver: no samples within desired window for channel 8720
wclsFrameSaver: no samples within desired window for channel 8732
wclsFrameSaver: no samples within desired window for channel 8762
wclsFrameSaver: no samples within desired window for channel 8766
wclsFrameSaver: no samples within desired window for channel 8778
wclsFrameSaver: no samples within desired window for channel 8780
wclsFrameSaver: no samples within desired window for channel 8781
wclsFrameSaver: no samples within desired window for channel 8787
wclsFrameSaver: no samples within desired window for channel 8795
wclsFrameSaver: no samples within desired window for channel 8804
wclsFrameSaver: no samples within desired window for channel 8811
wclsFrameSaver: no samples within desired window for channel 8817
wclsFrameSaver: no samples within desired window for channel 8820
wclsFrameSaver: no samples within desired window for channel 8838
wclsFrameSaver: no samples within desired window for channel 8855
wclsFrameSaver: no samples within desired window for channel 8857
wclsFrameSaver: no samples within desired window for channel 8860
wclsFrameSaver: no samples within desired window for channel 8860
wclsFrameSaver: no samples within desired window for channel 8870
wclsFrameSaver: no samples within desired window for channel 8884
wclsFrameSaver: no samples within desired window for channel 8887
wclsFrameSaver: no samples within desired window for channel 8888
wclsFrameSaver: no samples within desired window for channel 8888
wclsFrameSaver: no samples within desired window for channel 8894
wclsFrameSaver: no samples within desired window for channel 8894
wclsFrameSaver: no samples within desired window for channel 8899
wclsFrameSaver: no samples within desired window for channel 8908
wclsFrameSaver: no samples within desired window for channel 8912
wclsFrameSaver: no samples within desired window for channel 8914
wclsFrameSaver: no samples within desired window for channel 8965
wclsFrameSaver: no samples within desired window for channel 9025
wclsFrameSaver: no samples within desired window for channel 9027
wclsFrameSaver: no samples within desired window for channel 9067
wclsFrameSaver: no samples within desired window for channel 9107
wclsFrameSaver: no samples within desired window for channel 9125
wclsFrameSaver: no samples within desired window for channel 9129
wclsFrameSaver: no samples within desired window for channel 9132
wclsFrameSaver: no samples within desired window for channel 9133
wclsFrameSaver: no samples within desired window for channel 9142
wclsFrameSaver: no samples within desired window for channel 9151
wclsFrameSaver: no samples within desired window for channel 9160
wclsFrameSaver: no samples within desired window for channel 9174
wclsFrameSaver: no samples within desired window for channel 9187
wclsFrameSaver: no samples within desired window for channel 9229
wclsFrameSaver: no samples within desired window for channel 9251
wclsFrameSaver: no samples within desired window for channel 9659
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9744
wclsFrameSaver: no samples within desired window for channel 10089
FrameSaver: q=1.51249e+06 n=788432 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 3970 XUs and 2385 XVs -> 23 XUVs
C:0 T:1 82397 XUs and 47200 XVs -> 2492 XUVs
C:0 T:2 3725 XUs and 6126 XVs -> 185 XUVs
C:0 T:3 34 XUs and 9 XVs -> 1 XUVs
C:0 T:4 295 XUs and 285 XVs -> 17 XUVs
C:0 T:5 28792 XUs and 21446 XVs -> 333 XUVs
C:0 T:6 2737 XUs and 2246 XVs -> 190 XUVs
C:0 T:7 90 XUs and 62 XVs -> 4 XUVs
3245 XUVs total
1306 collection wire objects
3245 potential space points
Neighbour search...
116131 tests to find 59694 neighbours
Iterating with no regularization...
Begin: 1.60234e+07
0 1.53455e+07
1 1.52983e+07
2 1.52922e+07
Now with regularization...
Begin: 1.47661e+07
0 1.47642e+07
21-Jan-2026 19:39:14 UTC Opened output file with pattern "%ifb_%tc_keepup.root"
21-Jan-2026 19:39:17 UTC Closed output file "np04hd_raw_run027306_0001_dataflow2_datawriter_0_20240619T175445_20260121T193917_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 104.581 104.581 104.581 104.581 0 1
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.00014791 0.00014791 0.00014791 0.00014791 0 1
produce:tpcrawdecoder:PDHDTPCReader 11.1961 11.1961 11.1961 11.1961 0 1
produce:triggerrawdecoder:PDHDTriggerReader3 0.0543956 0.0543956 0.0543956 0.0543956 0 1
produce:timingrawdecoder:PDHDTimingRawDecoder 0.026971 0.026971 0.026971 0.026971 0 1
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.132609 0.132609 0.132609 0.132609 0 1
produce:beamevent:BeamEvent 3.86827 3.86827 3.86827 3.86827 0 1
produce:fembfilter:PDHDFEMBFilter 0.000868818 0.000868818 0.000868818 0.000868818 0 1
produce:wclsdatahd:WireCellToolkit 68.8835 68.8835 68.8835 68.8835 0 1
produce:gaushit:GausHitFinder 0.592876 0.592876 0.592876 0.592876 0 1
produce:nhitsfilter:NumberOfHitsFilter 0.000953699 0.000953699 0.000953699 0.000953699 0 1
produce:reco3d:SpacePointSolver 0.526342 0.526342 0.526342 0.526342 0 1
produce:hitpdune:DisambigFromSpacePoints 0.317033 0.317033 0.317033 0.317033 0 1
produce:pandora:StandardPandora 16.7105 16.7105 16.7105 16.7105 0 1
produce:pandoraWriter:StandardPandora 0.146993 0.146993 0.146993 0.146993 0 1
produce:pandoraTrack:LArPandoraTrackCreation 0.678587 0.678587 0.678587 0.678587 0 1
produce:pandoraShower:LArPandoraShowerCreation 0.714736 0.714736 0.714736 0.714736 0 1
[art]:TriggerResults:TriggerResultInserter 0.000107914 0.000107914 0.000107914 0.000107914 0 1
end_path:out1:RootOutput 4.0276e-05 4.0276e-05 4.0276e-05 4.0276e-05 0 1
end_path:out1:RootOutput(write) 0.702852 0.702852 0.702852 0.702852 0 1
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 20628.9 MB
Peak resident set size usage (VmHWM): 1602.97 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 13M
-rw-r--r-- 1 dunegli fnalgrid 9.3M Jan 21 19:39 np04hd_raw_run027306_0001_dataflow2_datawriter_0_20240619T175445_20260121T193917_keepup.root
-rw-r--r-- 1 dunegli fnalgrid 3.4M Jan 21 19:39 Pandora_Events.pndr
-rw-r--r-- 1 dunegli fnalgrid 292K Jan 21 19:39 jobscript.log
-rw-r--r-- 1 dunegli fnalgrid 44K Jan 21 19:39 mem.db
-rw-r--r-- 1 dunegli fnalgrid 16K Jan 21 19:39 time.db
-rw-r--r-- 1 dunegli fnalgrid 7.2K Jan 21 19:39 np04hd_raw_run027306_0001_dataflow2_datawriter_0_20240619T175445.hdf5_calibana.root
-rw-r--r-- 1 dunegli fnalgrid 3.5K Jan 21 19:39 Pandora_Geometry.xml
-rw-r--r-- 1 dunegli fnalgrid 83 Jan 21 19:36 all-input-dids.txt
-rw-r--r-- 1 dunegli fnalgrid 0 Jan 21 19:37 debugprod.log
disk usage
13M .
