Jobsub ID 258531.11@dunegpschedd01.fnal.gov
Jobscript log (last 10,000 characters)
=gauss
wclsFrameSaver: saving 92737 traces tagged "wiener"
FrameSaver: q=2.48813e+06 n=960451 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 6062 XUs and 5991 XVs -> 13 XUVs
C:0 T:1 27036 XUs and 28332 XVs -> 347 XUVs
C:0 T:2 27405 XUs and 28155 XVs -> 1219 XUVs
C:0 T:3 2 XUs and 4 XVs -> 1 XUVs
C:0 T:4 5 XUs and 21 XVs -> 0 XUVs
C:0 T:5 97226 XUs and 74815 XVs -> 5325 XUVs
C:0 T:6 23488 XUs and 19042 XVs -> 509 XUVs
7414 XUVs total
2120 collection wire objects
7414 potential space points
Neighbour search...
613302 tests to find 251284 neighbours
Iterating with no regularization...
Begin: 3.79425e+07
0 3.31873e+07
1 3.2737e+07
2 3.26402e+07
3 3.26049e+07
4 3.25878e+07
Now with regularization...
Begin: 3.06858e+07
0 3.06708e+07
26-Nov-2025 12:49:36 CET Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root"
26-Nov-2025 12:49:36 CET Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 163.472 197.207 224.073 199.272 21.6541 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00164203 0.0111971 0.0250067 0.0112882 0.00704807 10
reco:opdec:Deconvolution 0.869792 1.01529 1.16813 0.999298 0.0866012 10
reco:ophitspe:OpHitFinderDeco 0.234581 0.266246 0.30294 0.262418 0.0253599 10
reco:opflash:OpFlashFinder 0.0763928 0.101804 0.130065 0.104491 0.0143803 10
reco:opslicer:OpSlicer 0.247786 0.325157 0.420889 0.314163 0.0504801 10
reco:wclsdatahd:WireCellToolkit 51.1354 53.1111 54.363 53.3526 0.868284 10
reco:gaushit:GausHitFinder 0.940635 1.16067 1.44042 1.18293 0.157825 10
reco:nhitsfilter:NumberOfHitsFilter 0.000353465 0.000481624 0.000768322 0.000462034 0.000111785 10
reco:reco3d:SpacePointSolver 1.22112 1.92574 3.15487 1.84111 0.567535 10
reco:hitpdune:DisambigFromSpacePoints 0.661396 1.00081 1.32222 0.998881 0.200038 10
reco:pandora:StandardPandora 24.4648 40.9126 68.385 38.6482 12.7601 10
reco:pandoraWriter:StandardPandora 0.346282 0.412395 0.534961 0.401503 0.0535457 10
reco:pandoraTrack:LArPandoraTrackCreation 2.66004 4.27804 5.94927 4.22911 1.01452 10
reco:pandoraShower:LArPandoraShowerCreation 3.33814 5.05629 7.3336 4.67278 1.31943 10
reco:pandoracalo:Calorimetry 1.26281 2.13018 3.00501 2.03695 0.587106 10
reco:pandoracalonosce:Calorimetry 1.28624 2.06723 3.16974 1.96082 0.61134 10
reco:pandoraShowercalo:ShowerCalorimetry 2.90106 4.54363 8.0091 3.99852 1.4392 10
reco:pandoraShowercalonosce:ShowerCalorimetry 2.69035 4.1246 7.07679 3.63605 1.36355 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0694499 0.0930675 0.147205 0.0857538 0.0219378 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0721409 0.0881139 0.135176 0.083686 0.017344 10
reco:emtrkmichelid:EmTrackMichelId 30.3413 39.5596 46.8277 38.7323 4.62223 10
reco:crttag:SingleCRTMatchingProducer 0.00871575 0.011845 0.0166898 0.0114591 0.00224492 10
reco:crtreco:TwoCRTMatchingProducer 0.0078296 0.0103972 0.0130562 0.0103072 0.00163819 10
reco:pandora2Track:LArPandoraTrackCreation 6.98997 10.3297 15.3487 9.93943 2.48279 10
reco:pandora2calo:ShowerCalorimetry 2.08387 3.6892 5.52984 3.76232 0.992261 10
reco:pandora2calonosce:ShowerCalorimetry 2.15331 3.41629 5.00043 3.19925 0.880433 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0679378 0.0868032 0.107047 0.0857817 0.0106952 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.05264 0.0858232 0.115116 0.0841053 0.0186452 10
reco:pandora2Shower:LArPandoraShowerCreation 3.13968 4.77827 7.05168 5.02785 1.17483 10
reco:pandora2Showercalo:ShowerCalorimetry 3.51102 4.96434 7.78144 4.65617 1.20435 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.87479 4.5964 7.22993 4.59734 1.1706 10
[art]:TriggerResults:TriggerResultInserter 2.8844e-05 6.74665e-05 0.000127599 5.72e-05 3.12146e-05 10
end_path:out1:RootOutput 5.238e-06 1.92553e-05 6.2508e-05 1.21875e-05 1.64573e-05 10
end_path:out1:RootOutput(write) 2.36279 2.82083 3.23791 2.7923 0.280259 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6103.28 MB
Peak resident set size usage (VmHWM): 3876.23 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.temp.json ====
.:
total 5888424
-rw-r--r-- 1 dune001 lbno 40766 Nov 26 12:49 jobscript.log
-rw-r--r-- 1 dune001 lbno 206 Nov 26 12:49 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Nov 26 12:49 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.json
-rw-r--r-- 1 dune001 lbno 0 Nov 26 12:49 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 dune001 lbno 31 Nov 26 12:49 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 dune001 lbno 25 Nov 26 12:49 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 519 Nov 26 12:49 reco_protodunehd_hist.root
-rw-r--r-- 1 dune001 lbno 3574 Nov 26 12:49 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 204800 Nov 26 12:49 mem.db
-rw-r--r-- 1 dune001 lbno 36864 Nov 26 12:49 time.db
-rw-r--r-- 1 dune001 lbno 5975360487 Nov 26 12:49 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258531_11_1_20251126T094839Z_detsim_reco1.root
-rw-r--r-- 1 dune001 lbno 54073930 Nov 26 12:48 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 0 Nov 26 12:18 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Nov 26 12:15 debugprod.log
-rw-r--r-- 1 dune001 lbno 519 Nov 26 12:14 detsim_single_protodunehd_hist.root 