Jobsub ID 298724.1@dunegpschedd01.fnal.gov
| Jobsub ID | 298724.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12195 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 19:54:08 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2026-01-21 23:24:24 |
| From worker node | Hostname | mh-7763-12.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 19:55:27 |
| Input files | hd-protodune:np04hd_raw_run027306_0002_dataflow0_datawriter_0_20240619T175558.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12511s) |
| CPU time | 1h (4460s = 35%) |
| Max RSS bytes | 2372276224 (2262 MiB) |
| Outputting started | 2026-01-21 23:23:59 |
| Output files | |
| Finished | 2026-01-21 23:24:24 |
| Saved logs | justin-logs:298724.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
sired window for channel 9659
wclsFrameSaver: no samples within desired window for channel 9659
wclsFrameSaver: no samples within desired window for channel 9660
wclsFrameSaver: no samples within desired window for channel 9660
wclsFrameSaver: no samples within desired window for channel 9661
wclsFrameSaver: no samples within desired window for channel 9661
wclsFrameSaver: no samples within desired window for channel 9662
wclsFrameSaver: no samples within desired window for channel 9663
wclsFrameSaver: no samples within desired window for channel 9664
wclsFrameSaver: no samples within desired window for channel 9665
wclsFrameSaver: no samples within desired window for channel 9665
wclsFrameSaver: no samples within desired window for channel 9665
wclsFrameSaver: no samples within desired window for channel 9666
wclsFrameSaver: no samples within desired window for channel 9666
wclsFrameSaver: no samples within desired window for channel 9667
wclsFrameSaver: no samples within desired window for channel 9667
wclsFrameSaver: no samples within desired window for channel 9668
wclsFrameSaver: no samples within desired window for channel 9669
wclsFrameSaver: no samples within desired window for channel 9670
wclsFrameSaver: no samples within desired window for channel 9671
wclsFrameSaver: no samples within desired window for channel 9672
wclsFrameSaver: no samples within desired window for channel 9673
wclsFrameSaver: no samples within desired window for channel 9674
wclsFrameSaver: no samples within desired window for channel 9675
wclsFrameSaver: no samples within desired window for channel 9676
wclsFrameSaver: no samples within desired window for channel 9676
wclsFrameSaver: no samples within desired window for channel 9677
wclsFrameSaver: no samples within desired window for channel 9678
wclsFrameSaver: no samples within desired window for channel 9679
wclsFrameSaver: no samples within desired window for channel 9680
wclsFrameSaver: no samples within desired window for channel 9681
wclsFrameSaver: no samples within desired window for channel 9682
wclsFrameSaver: no samples within desired window for channel 9683
wclsFrameSaver: no samples within desired window for channel 9684
wclsFrameSaver: no samples within desired window for channel 9685
wclsFrameSaver: no samples within desired window for channel 9686
wclsFrameSaver: no samples within desired window for channel 9687
wclsFrameSaver: no samples within desired window for channel 9688
wclsFrameSaver: no samples within desired window for channel 9689
wclsFrameSaver: no samples within desired window for channel 9690
wclsFrameSaver: no samples within desired window for channel 9691
wclsFrameSaver: no samples within desired window for channel 9692
wclsFrameSaver: no samples within desired window for channel 9693
wclsFrameSaver: no samples within desired window for channel 9694
wclsFrameSaver: no samples within desired window for channel 9695
wclsFrameSaver: no samples within desired window for channel 9696
wclsFrameSaver: no samples within desired window for channel 9697
wclsFrameSaver: no samples within desired window for channel 9698
wclsFrameSaver: no samples within desired window for channel 9699
wclsFrameSaver: no samples within desired window for channel 9700
wclsFrameSaver: no samples within desired window for channel 9701
wclsFrameSaver: no samples within desired window for channel 9702
wclsFrameSaver: no samples within desired window for channel 9703
wclsFrameSaver: no samples within desired window for channel 9704
wclsFrameSaver: no samples within desired window for channel 9705
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9707
wclsFrameSaver: no samples within desired window for channel 9708
wclsFrameSaver: no samples within desired window for channel 9709
wclsFrameSaver: no samples within desired window for channel 9710
wclsFrameSaver: no samples within desired window for channel 9711
wclsFrameSaver: no samples within desired window for channel 9712
wclsFrameSaver: no samples within desired window for channel 9713
wclsFrameSaver: no samples within desired window for channel 9714
wclsFrameSaver: no samples within desired window for channel 9715
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9716
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
FrameSaver: q=2.49568e+06 n=1146631 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 7147 XUs and 4557 XVs -> 55 XUVs
C:0 T:1 112832 XUs and 63479 XVs -> 2031 XUVs
C:0 T:2 22210 XUs and 71089 XVs -> 2329 XUVs
C:0 T:3 109 XUs and 219 XVs -> 6 XUVs
C:0 T:4 440 XUs and 897 XVs -> 19 XUVs
C:0 T:5 68848 XUs and 66508 XVs -> 3237 XUVs
C:0 T:6 16940 XUs and 23006 XVs -> 355 XUVs
C:0 T:7 97 XUs and 155 XVs -> 1 XUVs
8033 XUVs total
3327 collection wire objects
8033 potential space points
Neighbour search...
454305 tests to find 204862 neighbours
Iterating with no regularization...
Begin: 6.81053e+07
0 5.9912e+07
1 5.91644e+07
2 5.91032e+07
3 5.90881e+07
Now with regularization...
Begin: 5.7057e+07
0 5.70471e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
94 86 87
-0.0015 -0.0095 -0.00995
124 121 125
0.0285 0.0255 0.02805
116 118 120
0.0205 0.0225 0.02305
21-Jan-2026 15:23:53 PST Closed output file "np04hd_raw_run027306_0002_dataflow0_datawriter_0_20240619T175558_20260121T232353_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 162.794 364.936 607.245 354.937 103.431 34
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.5999e-05 0.000212668 0.00132566 0.000166874 0.000203972 34
produce:tpcrawdecoder:PDHDTPCReader 111.789 235.363 413.362 198.976 86.5053 34
produce:triggerrawdecoder:PDHDTriggerReader3 0.13319 0.144753 0.407975 0.134972 0.0467247 34
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0667157 0.0763822 0.341126 0.0673459 0.0462643 34
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.332105 0.362852 0.749711 0.336292 0.0895729 34
produce:beamevent:BeamEvent 0.00481524 3.00633 101.607 0.00885027 17.1643 34
produce:fembfilter:PDHDFEMBFilter 5.2779e-05 0.000140094 0.000679773 0.000122813 9.98563e-05 34
produce:wclsdatahd:WireCellToolkit 68.1726 85.7188 98.2221 87.1592 7.19948 26
produce:gaushit:GausHitFinder 0.496383 1.19787 1.71066 1.21861 0.317924 26
produce:nhitsfilter:NumberOfHitsFilter 0.000192938 0.000434856 0.000616334 0.000436015 9.62039e-05 26
produce:reco3d:SpacePointSolver 0.522212 2.45722 8.54462 1.96524 1.76628 26
produce:hitpdune:DisambigFromSpacePoints 0.304871 1.27778 2.60208 1.24258 0.543042 26
produce:pandora:StandardPandora 13.9385 66.1256 229.928 57.8974 48.7626 26
produce:pandoraWriter:StandardPandora 0.135003 0.264111 0.408002 0.274369 0.0722079 26
produce:pandoraTrack:LArPandoraTrackCreation 1.01291 3.23589 5.37272 3.35549 1.25438 26
produce:pandoraShower:LArPandoraShowerCreation 0.728384 3.02389 5.41879 2.9504 1.09562 26
[art]:TriggerResults:TriggerResultInserter 2.136e-05 5.79501e-05 0.000215448 4.98145e-05 3.4755e-05 34
end_path:out1:RootOutput 4.411e-06 1.33969e-05 3.9559e-05 1.2415e-05 8.19335e-06 34
end_path:out1:RootOutput(write) 0.0124075 0.918794 1.82744 1.08613 0.562673 34
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 38500.1 MB
Peak resident set size usage (VmHWM): 2372.28 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 511M
-rw-r--r--. 1 cuser cuser 364M Jan 21 15:23 np04hd_raw_run027306_0002_dataflow0_datawriter_0_20240619T175558_20260121T232353_keepup.root
-rw-r--r--. 1 cuser cuser 141M Jan 21 15:11 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 5.7M Jan 21 15:23 jobscript.log
-rw-r--r--. 1 cuser cuser 240K Jan 21 15:23 mem.db
-rw-r--r--. 1 cuser cuser 48K Jan 21 15:23 time.db
-rw-r--r--. 1 cuser cuser 18K Jan 21 15:23 np04hd_raw_run027306_0002_dataflow0_datawriter_0_20240619T175558.hdf5_calibana.root
-rw-r--r--. 1 cuser cuser 3.5K Jan 21 15:23 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 83 Jan 21 11:55 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 0 Jan 21 11:55 debugprod.log
disk usage
511M .
