Jobsub ID 293089.3@dunegpschedd02.fnal.gov
| Jobsub ID | 293089.3@dunegpschedd02.fnal.gov |
| Workflow ID | 12206 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 22:58:18 |
| Site | US_UChicago |
| Entry | Engage_US_MWT2_uct2_gk02_condce_mcore |
| Last heartbeat | 2026-01-22 02:08:59 |
| From worker node | Hostname | uct2-c494.mwt2.org |
| cpuinfo | Intel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 22:59:14 |
| Input files | hd-protodune:np04hd_raw_run027308_0014_dataflow1_datawriter_0_20240619T183538.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11369s) |
| CPU time | 3h (10804s = 95%) |
| Max RSS bytes | 2123313152 (2024 MiB) |
| Outputting started | 2026-01-22 02:08:43 |
| Output files | |
| Finished | 2026-01-22 02:08:59 |
| Saved logs | justin-logs:293089.3-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
within desired window for channel 8737
wclsFrameSaver: no samples within desired window for channel 8740
wclsFrameSaver: no samples within desired window for channel 8740
wclsFrameSaver: no samples within desired window for channel 8741
wclsFrameSaver: no samples within desired window for channel 8741
wclsFrameSaver: no samples within desired window for channel 8742
wclsFrameSaver: no samples within desired window for channel 8742
wclsFrameSaver: no samples within desired window for channel 8743
wclsFrameSaver: no samples within desired window for channel 8743
wclsFrameSaver: no samples within desired window for channel 8743
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8744
wclsFrameSaver: no samples within desired window for channel 8748
wclsFrameSaver: no samples within desired window for channel 8749
wclsFrameSaver: no samples within desired window for channel 8749
wclsFrameSaver: no samples within desired window for channel 8754
wclsFrameSaver: no samples within desired window for channel 8763
wclsFrameSaver: no samples within desired window for channel 8767
wclsFrameSaver: no samples within desired window for channel 8791
wclsFrameSaver: no samples within desired window for channel 8792
wclsFrameSaver: no samples within desired window for channel 8795
wclsFrameSaver: no samples within desired window for channel 8904
wclsFrameSaver: no samples within desired window for channel 8906
wclsFrameSaver: no samples within desired window for channel 8907
wclsFrameSaver: no samples within desired window for channel 8960
wclsFrameSaver: no samples within desired window for channel 8960
wclsFrameSaver: no samples within desired window for channel 8963
wclsFrameSaver: no samples within desired window for channel 8968
wclsFrameSaver: no samples within desired window for channel 8970
wclsFrameSaver: no samples within desired window for channel 8971
wclsFrameSaver: no samples within desired window for channel 8980
wclsFrameSaver: no samples within desired window for channel 8982
wclsFrameSaver: no samples within desired window for channel 8985
wclsFrameSaver: no samples within desired window for channel 8997
wclsFrameSaver: no samples within desired window for channel 9024
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9049
wclsFrameSaver: no samples within desired window for channel 9050
wclsFrameSaver: no samples within desired window for channel 9057
wclsFrameSaver: no samples within desired window for channel 9058
wclsFrameSaver: no samples within desired window for channel 9103
wclsFrameSaver: no samples within desired window for channel 9125
wclsFrameSaver: no samples within desired window for channel 9149
wclsFrameSaver: no samples within desired window for channel 9160
wclsFrameSaver: no samples within desired window for channel 9169
wclsFrameSaver: no samples within desired window for channel 9187
wclsFrameSaver: no samples within desired window for channel 9200
wclsFrameSaver: no samples within desired window for channel 9201
wclsFrameSaver: no samples within desired window for channel 9208
wclsFrameSaver: no samples within desired window for channel 9209
wclsFrameSaver: no samples within desired window for channel 9213
wclsFrameSaver: no samples within desired window for channel 9228
wclsFrameSaver: no samples within desired window for channel 9231
wclsFrameSaver: no samples within desired window for channel 9244
wclsFrameSaver: no samples within desired window for channel 9269
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9438
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9439
wclsFrameSaver: no samples within desired window for channel 9471
wclsFrameSaver: no samples within desired window for channel 9509
wclsFrameSaver: no samples within desired window for channel 9541
wclsFrameSaver: no samples within desired window for channel 9612
wclsFrameSaver: no samples within desired window for channel 9621
wclsFrameSaver: no samples within desired window for channel 9622
wclsFrameSaver: no samples within desired window for channel 9660
wclsFrameSaver: no samples within desired window for channel 9660
wclsFrameSaver: no samples within desired window for channel 9660
wclsFrameSaver: no samples within desired window for channel 9661
wclsFrameSaver: no samples within desired window for channel 9662
FrameSaver: q=2.28027e+06 n=1081159 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 8159 XUs and 6974 XVs -> 96 XUVs
C:0 T:1 123963 XUs and 121329 XVs -> 4881 XUVs
C:0 T:2 21497 XUs and 35413 XVs -> 747 XUVs
C:0 T:3 85 XUs and 186 XVs -> 3 XUVs
C:0 T:4 65 XUs and 48 XVs -> 1 XUVs
C:0 T:5 9964 XUs and 8834 XVs -> 121 XUVs
C:0 T:6 17283 XUs and 37621 XVs -> 1957 XUVs
C:0 T:7 205 XUs and 298 XVs -> 3 XUVs
7809 XUVs total
3246 collection wire objects
7809 potential space points
Neighbour search...
327805 tests to find 139396 neighbours
Iterating with no regularization...
Begin: 4.16005e+07
0 3.69616e+07
1 3.66382e+07
2 3.66132e+07
Now with regularization...
Begin: 3.48476e+07
0 3.48407e+07
21-Jan-2026 20:08:41 CST Closed output file "np04hd_raw_run027308_0014_dataflow1_datawriter_0_20240619T183538_20260122T020841_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 167.093 321.872 752.586 279.752 125.345 35
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.7175e-05 0.0001385 0.000401721 0.000128199 4.85962e-05 35
produce:tpcrawdecoder:PDHDTPCReader 11.0128 11.9904 13.394 11.9273 0.367348 35
produce:triggerrawdecoder:PDHDTriggerReader3 0.0447429 0.0453187 0.0465745 0.0452682 0.000353354 35
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0225154 0.0228235 0.0231675 0.0228007 0.000149565 35
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.111607 0.113259 0.121599 0.11276 0.00210515 35
produce:beamevent:BeamEvent 0.0197256 0.0756715 0.786029 0.029369 0.145754 35
produce:fembfilter:PDHDFEMBFilter 0.000151775 0.000243171 0.00104267 0.000191105 0.000158687 35
produce:wclsdatahd:WireCellToolkit 125.177 146.07 163.902 147.779 10.8709 35
produce:gaushit:GausHitFinder 1.09339 1.82229 3.17342 1.72873 0.480771 35
produce:nhitsfilter:NumberOfHitsFilter 0.000509004 0.00081531 0.00128511 0.000754228 0.000196735 35
produce:reco3d:SpacePointSolver 1.07015 3.68435 8.49422 3.51148 1.72106 32
produce:hitpdune:DisambigFromSpacePoints 0.840732 2.53637 5.30241 2.25354 1.16 32
produce:pandora:StandardPandora 27.5772 144.966 570.798 98.3309 111.242 32
produce:pandoraWriter:StandardPandora 0.275826 0.40382 0.566298 0.381404 0.0815582 32
produce:pandoraTrack:LArPandoraTrackCreation 4.67436 11.4575 26.4942 10.215 5.31841 32
produce:pandoraShower:LArPandoraShowerCreation 3.53059 11.698 28.1971 9.96726 5.65677 32
[art]:TriggerResults:TriggerResultInserter 7.5786e-05 9.67943e-05 0.00019686 8.6838e-05 2.72852e-05 35
end_path:out1:RootOutput 1.363e-05 2.34986e-05 8.3415e-05 2.0732e-05 1.16466e-05 35
end_path:out1:RootOutput(write) 1.13175 1.65023 2.74041 1.56555 0.362345 35
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14621.8 MB
Peak resident set size usage (VmHWM): 2123.31 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 681M
-rw-r--r--. 1 dune osgvo 496M Jan 21 20:08 np04hd_raw_run027308_0014_dataflow1_datawriter_0_20240619T183538_20260122T020841_keepup.root
-rw-r--r--. 1 dune osgvo 176M Jan 21 20:08 Pandora_Events.pndr
-rw-r--r--. 1 dune osgvo 8.1M Jan 21 20:08 jobscript.log
-rw-r--r--. 1 dune osgvo 264K Jan 21 20:08 mem.db
-rw-r--r--. 1 dune osgvo 52K Jan 21 20:08 time.db
-rw-r--r--. 1 dune osgvo 18K Jan 21 20:08 np04hd_raw_run027308_0014_dataflow1_datawriter_0_20240619T183538.hdf5_calibana.root
-rw-r--r--. 1 dune osgvo 3.5K Jan 21 20:08 Pandora_Geometry.xml
-rw-r--r--. 1 dune osgvo 83 Jan 21 16:59 all-input-dids.txt
-rw-r--r--. 1 dune osgvo 0 Jan 21 16:59 debugprod.log
disk usage
681M .
