Jobsub ID 293047.3@dunegpschedd02.fnal.gov
| Jobsub ID | 293047.3@dunegpschedd02.fnal.gov |
| Workflow ID | 12206 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 21:56:16 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2026-01-22 01:36:39 |
| From worker node | Hostname | mh-7763-8.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 21:57:43 |
| Input files | hd-protodune:np04hd_raw_run027308_0019_dataflow1_datawriter_0_20240619T184007.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13109s) |
| CPU time | 2h (7486s = 57%) |
| Max RSS bytes | 2120335360 (2022 MiB) |
| Outputting started | 2026-01-22 01:36:12 |
| Output files | |
| Finished | 2026-01-22 01:36:39 |
| Saved logs | justin-logs:293047.3-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
es within desired window for channel 9561
wclsFrameSaver: no samples within desired window for channel 9562
wclsFrameSaver: no samples within desired window for channel 9562
wclsFrameSaver: no samples within desired window for channel 9563
wclsFrameSaver: no samples within desired window for channel 9563
wclsFrameSaver: no samples within desired window for channel 9564
wclsFrameSaver: no samples within desired window for channel 9565
wclsFrameSaver: no samples within desired window for channel 9566
wclsFrameSaver: no samples within desired window for channel 9566
wclsFrameSaver: no samples within desired window for channel 9566
wclsFrameSaver: no samples within desired window for channel 9567
wclsFrameSaver: no samples within desired window for channel 9568
wclsFrameSaver: no samples within desired window for channel 9569
wclsFrameSaver: no samples within desired window for channel 9570
wclsFrameSaver: no samples within desired window for channel 9571
wclsFrameSaver: no samples within desired window for channel 9571
wclsFrameSaver: no samples within desired window for channel 9571
wclsFrameSaver: no samples within desired window for channel 9572
wclsFrameSaver: no samples within desired window for channel 9572
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9573
wclsFrameSaver: no samples within desired window for channel 9574
wclsFrameSaver: no samples within desired window for channel 9575
wclsFrameSaver: no samples within desired window for channel 9576
wclsFrameSaver: no samples within desired window for channel 9577
wclsFrameSaver: no samples within desired window for channel 9577
wclsFrameSaver: no samples within desired window for channel 9578
wclsFrameSaver: no samples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9583
wclsFrameSaver: no samples within desired window for channel 9584
wclsFrameSaver: no samples within desired window for channel 9894
wclsFrameSaver: no samples within desired window for channel 9911
wclsFrameSaver: no samples within desired window for channel 10235
FrameSaver: q=2.90154e+06 n=1215636 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 24613 XUs and 16983 XVs -> 818 XUVs
C:0 T:1 275343 XUs and 245886 XVs -> 17749 XUVs
C:0 T:2 58870 XUs and 107791 XVs -> 4537 XUVs
C:0 T:3 70 XUs and 37 XVs -> 0 XUVs
C:0 T:4 568 XUs and 1074 XVs -> 19 XUVs
C:0 T:5 10138 XUs and 15088 XVs -> 686 XUVs
C:0 T:6 45591 XUs and 45608 XVs -> 1903 XUVs
C:0 T:7 64 XUs and 60 XVs -> 3 XUVs
25715 XUVs total
5847 collection wire objects
25715 potential space points
Neighbour search...
2696989 tests to find 938408 neighbours
Iterating with no regularization...
Begin: 1.08234e+08
0 8.54602e+07
1 8.32522e+07
2 8.30607e+07
3 8.30189e+07
Now with regularization...
Begin: 7.96039e+07
0 7.95792e+07
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05
----view 1: 0.00226784 0.0019033 0.00252199 0.00879455 0.00584686 0.00564218 0.00649107 0.00186598 0.000872612 0.00781739 0.00378442 0.00587416 0.0001266
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05
----view 1: 0.0019033 0.00252199 0.00879455 0.00584686 0.00564218 0.00649107 0.00186598 0.000872612 0.00781739 0.00378442 0.00587416 0.0001266 0.000126541
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05
----view 1: 0.00226784 0.0019033 0.00252199 0.00879455 0.00584686 0.00564218 0.00649107 0.00186598 0.000872612 0.00781739 0.00378442
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05
----view 1: 0.0019033 0.00252199 0.00879455 0.00584686 0.00564218 0.00649107 0.00186598 0.000872612 0.00781739 0.00378442 0.00587416
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05
----view 1: 0.00252199 0.00879455 0.00584686 0.00564218 0.00649107 0.00186598 0.000872612 0.00781739 0.00378442 0.00587416 0.0001266
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05 1.84178e-05 1.84774e-05 1.84178e-05 1.84178e-05
----view 1: 0.00879455 0.00584686 0.00564218 0.00649107 0.00186598 0.000872612 0.00781739 0.00378442 0.00587416 0.0001266 0.000126541
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
21-Jan-2026 17:36:04 PST Closed output file "np04hd_raw_run027308_0019_dataflow1_datawriter_0_20240619T184007_20260122T013604_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 197.226 371.111 1107.35 335.404 155.459 35
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.3989e-05 0.000138114 0.000317037 0.000115528 5.40211e-05 35
produce:tpcrawdecoder:PDHDTPCReader 87.4448 150.813 249.537 142.338 38.6074 35
produce:triggerrawdecoder:PDHDTriggerReader3 0.132273 0.141688 0.399133 0.13309 0.0442884 35
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0661378 0.0671619 0.0701343 0.0669272 0.000960828 35
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.330791 0.340332 0.549662 0.332038 0.0361497 35
produce:beamevent:BeamEvent 0.00749876 2.20662 76.0554 0.015965 12.6652 35
produce:fembfilter:PDHDFEMBFilter 0.000102569 0.000168572 0.000715223 0.000156329 0.000100751 35
produce:wclsdatahd:WireCellToolkit 65.7088 81.8034 95.5188 81.8094 8.11211 35
produce:gaushit:GausHitFinder 0.676859 1.10654 1.95398 1.03673 0.335615 35
produce:nhitsfilter:NumberOfHitsFilter 0.000269347 0.000451767 0.000776472 0.000419816 0.000127094 35
produce:reco3d:SpacePointSolver 0.397219 2.43996 5.83305 2.21792 1.34969 34
produce:hitpdune:DisambigFromSpacePoints 0.256094 1.43928 3.53969 1.45312 0.667793 34
produce:pandora:StandardPandora 10.4908 125.763 852.394 72.5014 148.796 34
produce:pandoraWriter:StandardPandora 0.123785 0.253731 0.39618 0.260817 0.0651324 34
produce:pandoraTrack:LArPandoraTrackCreation 1.31164 3.72137 7.31631 3.64271 1.62131 34
produce:pandoraShower:LArPandoraShowerCreation 0.927234 3.57987 7.65898 3.51541 1.71653 34
[art]:TriggerResults:TriggerResultInserter 2.303e-05 5.34994e-05 0.000187429 4.0889e-05 3.20506e-05 35
end_path:out1:RootOutput 6.4e-06 1.3072e-05 3.896e-05 1.154e-05 6.61948e-06 35
end_path:out1:RootOutput(write) 0.668835 1.14078 1.8625 1.07761 0.319275 35
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 38277.6 MB
Peak resident set size usage (VmHWM): 2120.34 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 736M
-rw-r--r--. 1 cuser cuser 526M Jan 21 17:36 np04hd_raw_run027308_0019_dataflow1_datawriter_0_20240619T184007_20260122T013604_keepup.root
-rw-r--r--. 1 cuser cuser 201M Jan 21 17:35 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 7.0M Jan 21 17:36 jobscript.log
-rw-r--r--. 1 cuser cuser 272K Jan 21 17:36 mem.db
-rw-r--r--. 1 cuser cuser 56K Jan 21 17:36 time.db
-rw-r--r--. 1 cuser cuser 18K Jan 21 17:36 np04hd_raw_run027308_0019_dataflow1_datawriter_0_20240619T184007.hdf5_calibana.root
-rw-r--r--. 1 cuser cuser 3.5K Jan 21 17:36 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 83 Jan 21 13:57 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 0 Jan 21 13:58 debugprod.log
disk usage
736M .
