Jobsub ID 293089.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293089.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12206 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 22:58:18 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2026-01-22 02:03:06 |
| From worker node | Hostname | sdsc-49.t2.ucsd.edu |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 22:59:33 |
| Input files | hd-protodune:np04hd_raw_run027308_0017_dataflow0_datawriter_0_20240619T183825.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (10994s) |
| CPU time | 2h (9925s = 90%) |
| Max RSS bytes | 2098233344 (2001 MiB) |
| Outputting started | 2026-01-22 02:02:48 |
| Output files | |
| Finished | 2026-01-22 02:03:06 |
| Saved logs | justin-logs:293089.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ed window for channel 9154
wclsFrameSaver: no samples within desired window for channel 9175
wclsFrameSaver: no samples within desired window for channel 9188
wclsFrameSaver: no samples within desired window for channel 9314
wclsFrameSaver: no samples within desired window for channel 9315
wclsFrameSaver: no samples within desired window for channel 9316
wclsFrameSaver: no samples within desired window for channel 9317
wclsFrameSaver: no samples within desired window for channel 9318
wclsFrameSaver: no samples within desired window for channel 9319
wclsFrameSaver: no samples within desired window for channel 9319
wclsFrameSaver: no samples within desired window for channel 9320
wclsFrameSaver: no samples within desired window for channel 9320
wclsFrameSaver: no samples within desired window for channel 9321
wclsFrameSaver: no samples within desired window for channel 9321
wclsFrameSaver: no samples within desired window for channel 9321
wclsFrameSaver: no samples within desired window for channel 9322
wclsFrameSaver: no samples within desired window for channel 9323
wclsFrameSaver: no samples within desired window for channel 9323
wclsFrameSaver: no samples within desired window for channel 9324
wclsFrameSaver: no samples within desired window for channel 9325
wclsFrameSaver: no samples within desired window for channel 9326
wclsFrameSaver: no samples within desired window for channel 9326
wclsFrameSaver: no samples within desired window for channel 9326
wclsFrameSaver: no samples within desired window for channel 9327
wclsFrameSaver: no samples within desired window for channel 9328
wclsFrameSaver: no samples within desired window for channel 9328
wclsFrameSaver: no samples within desired window for channel 9328
wclsFrameSaver: no samples within desired window for channel 9329
wclsFrameSaver: no samples within desired window for channel 9330
wclsFrameSaver: no samples within desired window for channel 9331
wclsFrameSaver: no samples within desired window for channel 9331
wclsFrameSaver: no samples within desired window for channel 9332
wclsFrameSaver: no samples within desired window for channel 9332
wclsFrameSaver: no samples within desired window for channel 9333
wclsFrameSaver: no samples within desired window for channel 9333
wclsFrameSaver: no samples within desired window for channel 9334
wclsFrameSaver: no samples within desired window for channel 9334
wclsFrameSaver: no samples within desired window for channel 9335
wclsFrameSaver: no samples within desired window for channel 9336
wclsFrameSaver: no samples within desired window for channel 9336
wclsFrameSaver: no samples within desired window for channel 9337
wclsFrameSaver: no samples within desired window for channel 9337
wclsFrameSaver: no samples within desired window for channel 9338
wclsFrameSaver: no samples within desired window for channel 9338
wclsFrameSaver: no samples within desired window for channel 9339
wclsFrameSaver: no samples within desired window for channel 9339
wclsFrameSaver: no samples within desired window for channel 9340
wclsFrameSaver: no samples within desired window for channel 9340
wclsFrameSaver: no samples within desired window for channel 9340
wclsFrameSaver: no samples within desired window for channel 9341
wclsFrameSaver: no samples within desired window for channel 9342
wclsFrameSaver: no samples within desired window for channel 9343
wclsFrameSaver: no samples within desired window for channel 9344
wclsFrameSaver: no samples within desired window for channel 9344
wclsFrameSaver: no samples within desired window for channel 9344
wclsFrameSaver: no samples within desired window for channel 9345
wclsFrameSaver: no samples within desired window for channel 9345
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9346
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9347
wclsFrameSaver: no samples within desired window for channel 9348
wclsFrameSaver: no samples within desired window for channel 9349
wclsFrameSaver: no samples within desired window for channel 9350
wclsFrameSaver: no samples within desired window for channel 9351
wclsFrameSaver: no samples within desired window for channel 9352
wclsFrameSaver: no samples within desired window for channel 9591
wclsFrameSaver: no samples within desired window for channel 9636
wclsFrameSaver: no samples within desired window for channel 9636
wclsFrameSaver: no samples within desired window for channel 9636
wclsFrameSaver: no samples within desired window for channel 9637
wclsFrameSaver: no samples within desired window for channel 9674
FrameSaver: q=1.94114e+06 n=960842 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 10772 XUs and 8269 XVs -> 312 XUVs
C:0 T:1 110437 XUs and 108469 XVs -> 5444 XUVs
C:0 T:2 7111 XUs and 5100 XVs -> 110 XUVs
C:0 T:3 163 XUs and 241 XVs -> 12 XUVs
C:0 T:4 50 XUs and 160 XVs -> 1 XUVs
C:0 T:5 21628 XUs and 34707 XVs -> 1555 XUVs
C:0 T:6 6405 XUs and 12693 XVs -> 282 XUVs
C:0 T:7 134 XUs and 224 XVs -> 2 XUVs
7718 XUVs total
2749 collection wire objects
7718 potential space points
Neighbour search...
354770 tests to find 116598 neighbours
Iterating with no regularization...
Begin: 3.57993e+07
0 3.12532e+07
1 3.08597e+07
2 3.08338e+07
Now with regularization...
Begin: 2.94817e+07
0 2.94767e+07
21-Jan-2026 18:02:45 PST Closed output file "np04hd_raw_run027308_0017_dataflow0_datawriter_0_20240619T183825_20260122T020245_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 169.456 310.303 493.702 272.931 99.166 35
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.2411e-05 0.000124863 0.000256423 0.000110067 3.94858e-05 35
produce:tpcrawdecoder:PDHDTPCReader 27.077 28.0792 40.8469 27.3886 2.44522 35
produce:triggerrawdecoder:PDHDTriggerReader3 0.132795 0.134842 0.172163 0.133128 0.00669454 35
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0664424 0.0677669 0.087205 0.066734 0.00356316 35
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.331652 0.337155 0.440503 0.332244 0.0185477 35
produce:beamevent:BeamEvent 0.0162222 0.0963805 1.95683 0.0213511 0.327222 35
produce:fembfilter:PDHDFEMBFilter 0.00015927 0.000331943 0.00397155 0.000184513 0.000635725 35
produce:wclsdatahd:WireCellToolkit 106.468 128.264 153.94 130.635 12.1813 35
produce:gaushit:GausHitFinder 0.94172 1.57687 2.29954 1.604 0.355766 35
produce:nhitsfilter:NumberOfHitsFilter 0.000377202 0.000660905 0.001228 0.000649011 0.000186613 35
produce:reco3d:SpacePointSolver 0.485041 3.33727 7.38423 2.99773 1.90673 35
produce:hitpdune:DisambigFromSpacePoints 0.551231 2.7849 5.38795 2.78605 1.32287 35
produce:pandora:StandardPandora 17.8302 126.467 281.82 90.3346 82.9276 35
produce:pandoraWriter:StandardPandora 0.183676 0.35939 0.559932 0.370533 0.0984213 35
produce:pandoraTrack:LArPandoraTrackCreation 1.99955 8.57717 18.2636 7.43358 4.37716 35
produce:pandoraShower:LArPandoraShowerCreation 1.43196 8.50722 22.4763 7.40617 4.93236 35
[art]:TriggerResults:TriggerResultInserter 2.4267e-05 8.11771e-05 0.000594792 6.9416e-05 8.99907e-05 35
end_path:out1:RootOutput 5.394e-06 1.57523e-05 3.8056e-05 1.5406e-05 6.05603e-06 35
end_path:out1:RootOutput(write) 0.66815 1.46404 2.20478 1.44911 0.415176 35
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 11344.8 MB
Peak resident set size usage (VmHWM): 2098.23 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 699M
-rw-r--r--. 1 cuser cuser 497M Jan 21 18:02 np04hd_raw_run027308_0017_dataflow0_datawriter_0_20240619T183825_20260122T020245_keepup.root
-rw-r--r--. 1 cuser cuser 193M Jan 21 18:02 Pandora_Events.pndr
-rw-r--r--. 1 cuser cuser 9.1M Jan 21 18:02 jobscript.log
-rw-r--r--. 1 cuser cuser 272K Jan 21 18:02 mem.db
-rw-r--r--. 1 cuser cuser 56K Jan 21 18:02 time.db
-rw-r--r--. 1 cuser cuser 18K Jan 21 18:02 np04hd_raw_run027308_0017_dataflow0_datawriter_0_20240619T183825.hdf5_calibana.root
-rw-r--r--. 1 cuser cuser 3.5K Jan 21 18:02 Pandora_Geometry.xml
-rw-r--r--. 1 cuser cuser 83 Jan 21 14:59 all-input-dids.txt
-rw-r--r--. 1 cuser cuser 0 Jan 21 15:00 debugprod.log
disk usage
699M .
