Jobsub ID 293047.4@dunegpschedd02.fnal.gov
| Jobsub ID | 293047.4@dunegpschedd02.fnal.gov |
| Workflow ID | 12206 |
| Stage ID | 1 |
| User name | msiden@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 2096103424 (1999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2026-01-21 21:56:16 |
| Site | US_UChicago |
| Entry | Engage_US_MWT2_uct2_gk02_condce_mcore |
| Last heartbeat | 2026-01-22 01:51:38 |
| From worker node | Hostname | mwt2-c173.campuscluster.illinois.edu |
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 2097152000 (2000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-21 21:57:28 |
| Input files | hd-protodune:np04hd_raw_run027308_0005_dataflow1_datawriter_0_20240619T182457.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (14032s) |
| CPU time | 3h (13325s = 94%) |
| Max RSS bytes | 2091433984 (1994 MiB) |
| Outputting started | 2026-01-22 01:51:21 |
| Output files | |
| Finished | 2026-01-22 01:51:38 |
| Saved logs | justin-logs:293047.4-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
sired window for channel 8485
wclsFrameSaver: no samples within desired window for channel 8506
wclsFrameSaver: no samples within desired window for channel 8521
wclsFrameSaver: no samples within desired window for channel 8554
wclsFrameSaver: no samples within desired window for channel 8557
wclsFrameSaver: no samples within desired window for channel 8562
wclsFrameSaver: no samples within desired window for channel 8586
wclsFrameSaver: no samples within desired window for channel 8588
wclsFrameSaver: no samples within desired window for channel 8595
wclsFrameSaver: no samples within desired window for channel 8605
wclsFrameSaver: no samples within desired window for channel 8679
wclsFrameSaver: no samples within desired window for channel 8680
wclsFrameSaver: no samples within desired window for channel 8698
wclsFrameSaver: no samples within desired window for channel 8698
wclsFrameSaver: no samples within desired window for channel 8699
wclsFrameSaver: no samples within desired window for channel 8699
wclsFrameSaver: no samples within desired window for channel 8701
wclsFrameSaver: no samples within desired window for channel 8709
wclsFrameSaver: no samples within desired window for channel 8721
wclsFrameSaver: no samples within desired window for channel 8742
wclsFrameSaver: no samples within desired window for channel 8750
wclsFrameSaver: no samples within desired window for channel 8893
wclsFrameSaver: no samples within desired window for channel 8893
wclsFrameSaver: no samples within desired window for channel 8894
wclsFrameSaver: no samples within desired window for channel 8894
wclsFrameSaver: no samples within desired window for channel 8894
wclsFrameSaver: no samples within desired window for channel 8895
wclsFrameSaver: no samples within desired window for channel 8930
wclsFrameSaver: no samples within desired window for channel 8988
wclsFrameSaver: no samples within desired window for channel 9030
wclsFrameSaver: no samples within desired window for channel 9042
wclsFrameSaver: no samples within desired window for channel 9071
wclsFrameSaver: no samples within desired window for channel 9072
wclsFrameSaver: no samples within desired window for channel 9094
wclsFrameSaver: no samples within desired window for channel 9096
wclsFrameSaver: no samples within desired window for channel 9126
wclsFrameSaver: no samples within desired window for channel 9135
wclsFrameSaver: no samples within desired window for channel 9141
wclsFrameSaver: no samples within desired window for channel 9144
wclsFrameSaver: no samples within desired window for channel 9144
wclsFrameSaver: no samples within desired window for channel 9167
wclsFrameSaver: no samples within desired window for channel 9176
wclsFrameSaver: no samples within desired window for channel 9182
wclsFrameSaver: no samples within desired window for channel 9185
wclsFrameSaver: no samples within desired window for channel 9190
wclsFrameSaver: no samples within desired window for channel 9223
wclsFrameSaver: no samples within desired window for channel 9230
wclsFrameSaver: no samples within desired window for channel 9249
wclsFrameSaver: no samples within desired window for channel 9332
wclsFrameSaver: no samples within desired window for channel 9436
wclsFrameSaver: no samples within desired window for channel 9437
wclsFrameSaver: no samples within desired window for channel 9570
wclsFrameSaver: no samples within desired window for channel 9605
wclsFrameSaver: no samples within desired window for channel 9763
FrameSaver: q=3.37656e+06 n=1460862 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 8240 XUs and 6285 XVs -> 119 XUVs
C:0 T:1 234287 XUs and 183696 XVs -> 8427 XUVs
C:0 T:2 13751 XUs and 20323 XVs -> 1128 XUVs
C:0 T:3 226 XUs and 591 XVs -> 4 XUVs
C:0 T:4 335 XUs and 467 XVs -> 13 XUVs
C:0 T:5 80457 XUs and 81905 XVs -> 2366 XUVs
C:0 T:6 15052 XUs and 28404 XVs -> 802 XUVs
C:0 T:7 63 XUs and 153 XVs -> 0 XUVs
12859 XUVs total
5853 collection wire objects
12859 potential space points
Neighbour search...
577247 tests to find 251780 neighbours
Iterating with no regularization...
Begin: 8.779e+07
0 7.78122e+07
1 7.71214e+07
2 7.70536e+07
Now with regularization...
Begin: 7.30554e+07
0 7.30325e+07
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05
----view 1: 0.00564116 0.00338131 0.00703388 0.00689906 0.00819921 0.0101515 0.000737388 0.000425335 0.000392262 0.00108753 0.00108178
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 4.46802e-05 0.00014003
----view 1: 0.00338131 0.00703388 0.00689906 0.00819921 0.0101515 0.000737388 0.000425335 0.000392262 0.00108753 0.00108178 0.00103657
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 4.03328e-05 4.03328e-05 4.03337e-05 4.03328e-05 4.03328e-05 4.03337e-05 4.03328e-05 4.03328e-05 4.03337e-05 4.03328e-05 4.03337e-05 4.1713e-05 0.000143278
----view 1: 0.00692338 0.00309503 0.00496012 0.00850213 0.00815487 0.0121811 0.000147924 0.00102124 0.000194196 0.000485286 0.00119285 0.00103141 0.00124027
21-Jan-2026 19:51:20 CST Closed output file "np04hd_raw_run027308_0005_dataflow1_datawriter_0_20240619T182457_20260122T015120_keepup.root"
====================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
====================================================================================================================================
Full event 172.881 398.362 1578.58 317.234 255.996 35
------------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.8722e-05 0.000141345 0.000288383 0.000130645 4.52198e-05 35
produce:tpcrawdecoder:PDHDTPCReader 12.1517 15.7652 18.029 16.2892 1.42478 35
produce:triggerrawdecoder:PDHDTriggerReader3 0.0495061 0.0503453 0.0597846 0.0499143 0.00169839 35
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0249221 0.0254111 0.0315011 0.0251343 0.00111131 35
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.123241 0.125312 0.153031 0.124162 0.00492451 35
produce:beamevent:BeamEvent 0.0209057 0.0586809 0.8024 0.0297587 0.131367 35
produce:fembfilter:PDHDFEMBFilter 0.000162049 0.000236665 0.000579412 0.000195907 0.000101554 35
produce:wclsdatahd:WireCellToolkit 108.461 135.442 159.717 137.597 13.6496 35
produce:gaushit:GausHitFinder 1.06913 1.90363 2.92643 1.84827 0.419695 35
produce:nhitsfilter:NumberOfHitsFilter 0.000482215 0.000891938 0.0013874 0.000852205 0.000196522 35
produce:reco3d:SpacePointSolver 1.01643 4.48293 10.6891 4.27264 2.54815 34
produce:hitpdune:DisambigFromSpacePoints 0.538459 3.13411 5.75659 3.05392 1.47079 34
produce:pandora:StandardPandora 15.7507 213.734 1368.42 137.482 249.798 34
produce:pandoraWriter:StandardPandora 0.244435 0.438262 0.59921 0.444493 0.0945948 34
produce:pandoraTrack:LArPandoraTrackCreation 3.95092 13.9281 29.6948 13.1809 5.61668 34
produce:pandoraShower:LArPandoraShowerCreation 4.54202 14.2875 25.5639 12.5175 5.64272 34
[art]:TriggerResults:TriggerResultInserter 6.8701e-05 9.71204e-05 0.000224267 8.3398e-05 3.22973e-05 35
end_path:out1:RootOutput 1.3419e-05 2.23658e-05 5.8887e-05 1.9969e-05 9.26852e-06 35
end_path:out1:RootOutput(write) 0.999747 1.76733 2.47043 1.7023 0.360081 35
====================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14575.6 MB
Peak resident set size usage (VmHWM): 2091.43 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lsing
total 739M
-rw-r--r-- 1 dune osgvo 529M Jan 21 19:51 np04hd_raw_run027308_0005_dataflow1_datawriter_0_20240619T182457_20260122T015120_keepup.root
-rw-r--r-- 1 dune osgvo 202M Jan 21 19:50 Pandora_Events.pndr
-rw-r--r-- 1 dune osgvo 8.0M Jan 21 19:51 jobscript.log
-rw-r--r-- 1 dune osgvo 272K Jan 21 19:51 mem.db
-rw-r--r-- 1 dune osgvo 56K Jan 21 19:51 time.db
-rw-r--r-- 1 dune osgvo 18K Jan 21 19:51 np04hd_raw_run027308_0005_dataflow1_datawriter_0_20240619T182457.hdf5_calibana.root
-rw-r--r-- 1 dune osgvo 3.5K Jan 21 19:51 Pandora_Geometry.xml
-rw-r--r-- 1 dune osgvo 83 Jan 21 15:57 all-input-dids.txt
-rw-r--r-- 1 dune osgvo 0 Jan 21 15:57 debugprod.log
disk usage
739M .
