Jobsub ID 293047.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293047.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12206 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 21:56:16 |
| Site | US_UChicago |
| Entry | Engage_US_MWT2_uct2_gk02_condce_mcore |
| Last heartbeat | 2026-01-22 02:25:45 |
| From worker node | Hostname | mwt2-c173.campuscluster.illinois.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 21:57:35 |
| Input files | hd-protodune:np04hd_raw_run027308_0008_dataflow3_datawriter_0_20240619T182715.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 4h (16073s) |
| CPU time | 4h (15343s = 95%) |
| Max RSS bytes | 2127962112 (2029 MiB) |
| Outputting started | 2026-01-22 02:25:28 |
| Output files | |
| Finished | 2026-01-22 02:25:45 |
| Saved logs | justin-logs:293047.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
within desired window for channel 8604
wclsFrameSaver: no samples within desired window for channel 8604
wclsFrameSaver: no samples within desired window for channel 8614
wclsFrameSaver: no samples within desired window for channel 8646
wclsFrameSaver: no samples within desired window for channel 8684
wclsFrameSaver: no samples within desired window for channel 8715
wclsFrameSaver: no samples within desired window for channel 8728
wclsFrameSaver: no samples within desired window for channel 8751
wclsFrameSaver: no samples within desired window for channel 8803
wclsFrameSaver: no samples within desired window for channel 8861
wclsFrameSaver: no samples within desired window for channel 8900
wclsFrameSaver: no samples within desired window for channel 8993
wclsFrameSaver: no samples within desired window for channel 9037
wclsFrameSaver: no samples within desired window for channel 9037
wclsFrameSaver: no samples within desired window for channel 9037
wclsFrameSaver: no samples within desired window for channel 9038
wclsFrameSaver: no samples within desired window for channel 9038
wclsFrameSaver: no samples within desired window for channel 9040
wclsFrameSaver: no samples within desired window for channel 9040
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9041
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9043
wclsFrameSaver: no samples within desired window for channel 9043
wclsFrameSaver: no samples within desired window for channel 9101
wclsFrameSaver: no samples within desired window for channel 9105
wclsFrameSaver: no samples within desired window for channel 9113
wclsFrameSaver: no samples within desired window for channel 9113
wclsFrameSaver: no samples within desired window for channel 9161
wclsFrameSaver: no samples within desired window for channel 9166
wclsFrameSaver: no samples within desired window for channel 9485
wclsFrameSaver: no samples within desired window for channel 9485
wclsFrameSaver: no samples within desired window for channel 9487
wclsFrameSaver: no samples within desired window for channel 9488
wclsFrameSaver: no samples within desired window for channel 9489
wclsFrameSaver: no samples within desired window for channel 9489
wclsFrameSaver: no samples within desired window for channel 9489
wclsFrameSaver: no samples within desired window for channel 9490
wclsFrameSaver: no samples within desired window for channel 9491
wclsFrameSaver: no samples within desired window for channel 9491
wclsFrameSaver: no samples within desired window for channel 9492
wclsFrameSaver: no samples within desired window for channel 9493
wclsFrameSaver: no samples within desired window for channel 9493
wclsFrameSaver: no samples within desired window for channel 9494
wclsFrameSaver: no samples within desired window for channel 9494
wclsFrameSaver: no samples within desired window for channel 9495
wclsFrameSaver: no samples within desired window for channel 9495
wclsFrameSaver: no samples within desired window for channel 9496
wclsFrameSaver: no samples within desired window for channel 9497
wclsFrameSaver: no samples within desired window for channel 9497
wclsFrameSaver: no samples within desired window for channel 9498
wclsFrameSaver: no samples within desired window for channel 9498
wclsFrameSaver: no samples within desired window for channel 9499
wclsFrameSaver: no samples within desired window for channel 9500
wclsFrameSaver: no samples within desired window for channel 9501
wclsFrameSaver: no samples within desired window for channel 9524
wclsFrameSaver: no samples within desired window for channel 9547
wclsFrameSaver: no samples within desired window for channel 9570
wclsFrameSaver: no samples within desired window for channel 9647
wclsFrameSaver: no samples within desired window for channel 9717
wclsFrameSaver: no samples within desired window for channel 9718
wclsFrameSaver: no samples within desired window for channel 9718
FrameSaver: q=3.76913e+06 n=1507533 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 11029 XUs and 9999 XVs -> 225 XUVs
C:0 T:1 186267 XUs and 161754 XVs -> 7788 XUVs
C:0 T:2 30073 XUs and 24662 XVs -> 816 XUVs
C:0 T:3 667 XUs and 564 XVs -> 23 XUVs
C:0 T:4 51 XUs and 54 XVs -> 1 XUVs
C:0 T:5 22804 XUs and 19989 XVs -> 616 XUVs
C:0 T:6 71593 XUs and 54520 XVs -> 1524 XUVs
C:0 T:7 182 XUs and 183 XVs -> 3 XUVs
10996 XUVs total
5061 collection wire objects
10996 potential space points
Neighbour search...
485852 tests to find 205084 neighbours
Iterating with no regularization...
Begin: 1.31392e+08
0 1.20983e+08
1 1.20222e+08
2 1.20166e+08
Now with regularization...
Begin: 1.14885e+08
0 1.14851e+08
21-Jan-2026 20:25:27 CST Closed output file "np04hd_raw_run027308_0008_dataflow3_datawriter_0_20240619T182715_20260122T022527_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 153.67 456.602 2602.75 314.05 449.007 35
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.4343e-05 0.000130946 0.000256155 0.000122523 2.92781e-05 35
produce:tpcrawdecoder:PDHDTPCReader 12.6567 15.7271 18.8124 16.0508 1.45372 35
produce:triggerrawdecoder:PDHDTriggerReader3 0.0497584 0.0507612 0.0576996 0.0501007 0.00169615 35
produce:timingrawdecoder:PDHDTimingRawDecoder 0.024898 0.0254458 0.0300963 0.0252182 0.000866912 35
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.123511 0.124769 0.128138 0.124366 0.00111878 35
produce:beamevent:BeamEvent 0.0200297 0.0794038 0.77008 0.0311264 0.147409 35
produce:fembfilter:PDHDFEMBFilter 0.000137488 0.00028845 0.00112097 0.000196487 0.000230567 35
produce:wclsdatahd:WireCellToolkit 110.849 138.03 157.95 138.805 11.7574 35
produce:gaushit:GausHitFinder 0.891798 1.84432 2.83147 1.85649 0.38711 35
produce:nhitsfilter:NumberOfHitsFilter 0.000577348 0.000878346 0.00170845 0.00083561 0.000220241 35
produce:reco3d:SpacePointSolver 0.839426 4.38937 12.035 3.47274 2.54836 32
produce:hitpdune:DisambigFromSpacePoints 0.885884 3.12903 5.93331 2.74735 1.56085 32
produce:pandora:StandardPandora 29.0039 291.495 2380.15 127.545 452.097 32
produce:pandoraWriter:StandardPandora 0.263573 0.424495 0.57865 0.428959 0.0792871 32
produce:pandoraTrack:LArPandoraTrackCreation 4.27998 13.9509 33.3279 13.6986 6.17186 32
produce:pandoraShower:LArPandoraShowerCreation 6.68049 13.2729 28.5545 12.7639 5.1808 32
[art]:TriggerResults:TriggerResultInserter 7.0656e-05 0.000100679 0.000224291 9.2317e-05 3.31156e-05 35
end_path:out1:RootOutput 1.4152e-05 2.39577e-05 5.7403e-05 2.1773e-05 8.01154e-06 35
end_path:out1:RootOutput(write) 1.04269 1.72613 2.49851 1.70623 0.342391 35
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14621.9 MB
Peak resident set size usage (VmHWM): 2127.96 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 710M
-rw-r--r-- 1 dune osgvo 516M Jan 21 20:25 np04hd_raw_run027308_0008_dataflow3_datawriter_0_20240619T182715_20260122T022527_keepup.root
-rw-r--r-- 1 dune osgvo 188M Jan 21 20:24 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo 6.9M Jan 21 20:25 jobscript.log
-rw-r--r-- 1 dune osgvo 268K Jan 21 20:25 mem.db
-rw-r--r-- 1 dune osgvo 52K Jan 21 20:25 time.db
-rw-r--r-- 1 dune osgvo 18K Jan 21 20:25 np04hd_raw_run027308_0008_dataflow3_datawriter_0_20240619T182715.hdf5_calibana.root
-rw-r--r-- 1 dune osgvo 3.5K Jan 21 20:25 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo 83 Jan 21 15:57 all-input-dids.txt
-rw-r--r-- 1 dune osgvo 0 Jan 21 15:58 debugprod.log
disk usage
710M .
