Jobsub ID 293047.35@dunegpschedd02.fnal.gov
| Jobsub ID | 293047.35@dunegpschedd02.fnal.gov |
| Workflow ID | 12206 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 21:56:16 |
| Site | US_UChicago |
| Entry | Engage_US_MWT2_uct2_gk02_condce_mcore |
| Last heartbeat | 2026-01-22 01:46:32 |
| From worker node | Hostname | mwt2-c177.campuscluster.illinois.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 21:57:32 |
| Input files | hd-protodune:np04hd_raw_run027308_0005_dataflow3_datawriter_0_20240619T182457.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13723s) |
| CPU time | 3h (12815s = 93%) |
| Max RSS bytes | 2043420672 (1948 MiB) |
| Outputting started | 2026-01-22 01:46:16 |
| Output files | |
| Finished | 2026-01-22 01:46:32 |
| Saved logs | justin-logs:293047.35-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
red window for channel 8982
wclsFrameSaver: no samples within desired window for channel 8983
wclsFrameSaver: no samples within desired window for channel 9016
wclsFrameSaver: no samples within desired window for channel 9044
wclsFrameSaver: no samples within desired window for channel 9057
wclsFrameSaver: no samples within desired window for channel 9061
wclsFrameSaver: no samples within desired window for channel 9065
wclsFrameSaver: no samples within desired window for channel 9065
wclsFrameSaver: no samples within desired window for channel 9065
wclsFrameSaver: no samples within desired window for channel 9106
wclsFrameSaver: no samples within desired window for channel 9109
wclsFrameSaver: no samples within desired window for channel 9121
wclsFrameSaver: no samples within desired window for channel 9124
wclsFrameSaver: no samples within desired window for channel 9179
wclsFrameSaver: no samples within desired window for channel 9188
wclsFrameSaver: no samples within desired window for channel 9202
wclsFrameSaver: no samples within desired window for channel 9275
wclsFrameSaver: no samples within desired window for channel 9471
wclsFrameSaver: no samples within desired window for channel 9610
wclsFrameSaver: no samples within desired window for channel 9682
wclsFrameSaver: no samples within desired window for channel 9682
wclsFrameSaver: no samples within desired window for channel 9683
wclsFrameSaver: no samples within desired window for channel 9684
wclsFrameSaver: no samples within desired window for channel 9685
wclsFrameSaver: no samples within desired window for channel 9686
wclsFrameSaver: no samples within desired window for channel 9687
wclsFrameSaver: no samples within desired window for channel 9687
wclsFrameSaver: no samples within desired window for channel 9688
wclsFrameSaver: no samples within desired window for channel 9689
wclsFrameSaver: no samples within desired window for channel 9690
wclsFrameSaver: no samples within desired window for channel 9690
wclsFrameSaver: no samples within desired window for channel 9691
wclsFrameSaver: no samples within desired window for channel 9692
wclsFrameSaver: no samples within desired window for channel 9693
wclsFrameSaver: no samples within desired window for channel 9694
wclsFrameSaver: no samples within desired window for channel 9695
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9698
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9710
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9735
wclsFrameSaver: no samples within desired window for channel 9740
wclsFrameSaver: no samples within desired window for channel 9769
FrameSaver: q=2.62434e+06 n=1116054 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4603 XUs and 3586 XVs -> 77 XUVs
C:0 T:1 88827 XUs and 70951 XVs -> 4191 XUVs
C:0 T:2 16976 XUs and 10653 XVs -> 179 XUVs
C:0 T:3 109 XUs and 52 XVs -> 4 XUVs
C:0 T:4 204 XUs and 340 XVs -> 11 XUVs
C:0 T:5 68229 XUs and 55568 XVs -> 1864 XUVs
C:0 T:6 46258 XUs and 26979 XVs -> 2083 XUVs
C:0 T:7 2404 XUs and 2705 XVs -> 82 XUVs
8491 XUVs total
3462 collection wire objects
8491 potential space points
Neighbour search...
554137 tests to find 183552 neighbours
Iterating with no regularization...
Begin: 6.00989e+07
0 5.29776e+07
1 5.2267e+07
2 5.22075e+07
3 5.21951e+07
Now with regularization...
Begin: 4.95712e+07
0 4.95616e+07
21-Jan-2026 19:46:14 CST Closed output file "np04hd_raw_run027308_0005_dataflow3_datawriter_0_20240619T182457_20260122T014614_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 161.513 388.651 953.321 298.091 191.361 35
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.5523e-05 0.000121764 0.000286599 0.000112606 3.36534e-05 35
produce:tpcrawdecoder:PDHDTPCReader 14.5644 16.4832 17.6327 16.6406 0.63886 35
produce:triggerrawdecoder:PDHDTriggerReader3 0.0494335 0.0506015 0.0589821 0.0497953 0.00208078 35
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0248529 0.0260379 0.0565418 0.0250492 0.00524303 35
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.122852 0.124742 0.132964 0.12377 0.00238843 35
produce:beamevent:BeamEvent 0.0194195 0.0616689 0.734138 0.0268865 0.13266 35
produce:fembfilter:PDHDFEMBFilter 0.000159916 0.000223412 0.000762753 0.000181843 0.000115971 35
produce:wclsdatahd:WireCellToolkit 128.021 141.503 159.425 139.225 8.46762 35
produce:gaushit:GausHitFinder 0.928275 1.76735 2.53724 1.82587 0.411665 35
produce:nhitsfilter:NumberOfHitsFilter 0.000464735 0.000816674 0.00122018 0.000820937 0.000172764 35
produce:reco3d:SpacePointSolver 0.983024 4.03718 11.6912 3.28694 2.54882 34
produce:hitpdune:DisambigFromSpacePoints 0.642327 2.92205 5.53645 2.36241 1.47198 34
produce:pandora:StandardPandora 26.3659 202.481 730.27 112.61 179.839 34
produce:pandoraWriter:StandardPandora 0.279677 0.419038 0.567791 0.4222 0.075136 34
produce:pandoraTrack:LArPandoraTrackCreation 3.80022 11.9581 21.3621 10.7698 4.40267 34
produce:pandoraShower:LArPandoraShowerCreation 3.97048 11.4996 24.9984 10.0363 5.41847 34
[art]:TriggerResults:TriggerResultInserter 6.9006e-05 9.31363e-05 0.000201546 8.4774e-05 2.34067e-05 35
end_path:out1:RootOutput 1.5572e-05 2.19279e-05 6.9251e-05 2.0614e-05 8.57173e-06 35
end_path:out1:RootOutput(write) 0.971415 1.65519 2.42156 1.65417 0.343072 35
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14538.3 MB
Peak resident set size usage (VmHWM): 2043.42 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 684M
-rw-r--r-- 1 dune osgvo 490M Jan 21 19:46 np04hd_raw_run027308_0005_dataflow3_datawriter_0_20240619T182457_20260122T014614_keepup.root
-rw-r--r-- 1 dune osgvo 186M Jan 21 19:45 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo 7.4M Jan 21 19:46 jobscript.log
-rw-r--r-- 1 dune osgvo 272K Jan 21 19:46 mem.db
-rw-r--r-- 1 dune osgvo 56K Jan 21 19:46 time.db
-rw-r--r-- 1 dune osgvo 18K Jan 21 19:46 np04hd_raw_run027308_0005_dataflow3_datawriter_0_20240619T182457.hdf5_calibana.root
-rw-r--r-- 1 dune osgvo 3.5K Jan 21 19:46 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo 83 Jan 21 15:57 all-input-dids.txt
-rw-r--r-- 1 dune osgvo 0 Jan 21 15:58 debugprod.log
disk usage
684M .
