Jobsub ID 258514.3@dunegpschedd01.fnal.gov
Jobscript log (last 10,000 characters)
FrameSaver: q=1.80353e+06 n=954547 tag=gauss
wclsFrameSaver: saving 84205 traces tagged "wiener"
FrameSaver: q=2.16718e+06 n=901757 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 4330 XUs and 5368 XVs -> 12 XUVs
C:0 T:1 13691 XUs and 13179 XVs -> 316 XUVs
C:0 T:2 11566 XUs and 11969 XVs -> 397 XUVs
C:0 T:3 0 XUs and 3 XVs -> 0 XUVs
C:0 T:5 16538 XUs and 9292 XVs -> 269 XUVs
C:0 T:6 44819 XUs and 40909 XVs -> 2033 XUVs
C:0 T:7 105 XUs and 112 XVs -> 12 XUVs
3039 XUVs total
1384 collection wire objects
3039 potential space points
Neighbour search...
83895 tests to find 48404 neighbours
Iterating with no regularization...
Begin: 2.72548e+07
0 2.58563e+07
1 2.56995e+07
2 2.5674e+07
Now with regularization...
Begin: 2.44177e+07
0 2.44114e+07
26-Nov-2025 12:26:53 CET Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root"
26-Nov-2025 12:26:53 CET Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 108.42 187.331 266.137 189.265 40.5085 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00164461 0.0121048 0.0331116 0.0108363 0.00891109 10
reco:opdec:Deconvolution 0.865558 1.07391 1.33597 1.08514 0.149465 10
reco:ophitspe:OpHitFinderDeco 0.159758 0.232864 0.315304 0.230148 0.0376913 10
reco:opflash:OpFlashFinder 0.0579163 0.094644 0.129138 0.0972568 0.0220863 10
reco:opslicer:OpSlicer 0.243977 0.307378 0.363337 0.324793 0.0455785 10
reco:wclsdatahd:WireCellToolkit 51.2892 62.2884 69.1742 63.1064 4.96862 10
reco:gaushit:GausHitFinder 0.665262 1.04647 1.40425 1.09609 0.232423 10
reco:nhitsfilter:NumberOfHitsFilter 0.000321056 0.000649147 0.00111871 0.000581623 0.000260133 10
reco:reco3d:SpacePointSolver 0.554087 1.40546 2.62944 1.30215 0.627922 10
reco:hitpdune:DisambigFromSpacePoints 0.339319 1.11073 1.95469 1.12495 0.457168 10
reco:pandora:StandardPandora 7.95895 38.2342 71.9957 38.6317 18.9032 10
reco:pandoraWriter:StandardPandora 0.263294 0.424704 0.575277 0.449848 0.0900955 10
reco:pandoraTrack:LArPandoraTrackCreation 0.667678 3.30743 7.70353 3.3403 1.78713 10
reco:pandoraShower:LArPandoraShowerCreation 0.642911 3.0973 6.45094 3.0703 1.62083 10
reco:pandoracalo:Calorimetry 0.442354 1.58903 2.9503 1.71015 0.680536 10
reco:pandoracalonosce:Calorimetry 0.400285 1.44804 2.67766 1.48855 0.615236 10
reco:pandoraShowercalo:ShowerCalorimetry 0.684586 2.5779 3.96534 2.57196 1.07018 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.681046 2.50918 4.20163 2.45463 1.0923 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0550562 0.0819564 0.0998675 0.0827324 0.0132416 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.053308 0.0791023 0.0947271 0.0813905 0.0118296 10
reco:emtrkmichelid:EmTrackMichelId 24.2188 42.6179 61.4735 41.7143 8.77726 10
reco:crttag:SingleCRTMatchingProducer 0.00567393 0.00862652 0.0126518 0.00894564 0.00233233 10
reco:crtreco:TwoCRTMatchingProducer 0.00467273 0.00824769 0.0155443 0.00802248 0.00313263 10
reco:pandora2Track:LArPandoraTrackCreation 1.61192 7.37382 11.7712 8.34767 3.05274 10
reco:pandora2calo:ShowerCalorimetry 0.597737 2.17553 3.4487 2.20407 0.907961 10
reco:pandora2calonosce:ShowerCalorimetry 0.574545 2.10309 3.41208 2.04418 0.919023 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0554635 0.0806817 0.116742 0.0739696 0.0192984 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0573343 0.0779617 0.110299 0.072064 0.0188348 10
reco:pandora2Shower:LArPandoraShowerCreation 0.66121 3.07628 5.13 3.13327 1.31995 10
reco:pandora2Showercalo:ShowerCalorimetry 0.781238 2.96479 4.68455 3.25602 1.20753 10
reco:pandora2Showercalonosce:ShowerCalorimetry 0.763392 2.9583 4.63488 3.13627 1.24391 10
[art]:TriggerResults:TriggerResultInserter 2.8244e-05 6.11023e-05 0.000123773 5.15525e-05 2.80504e-05 10
end_path:out1:RootOutput 1.0059e-05 1.50514e-05 3.8683e-05 1.19125e-05 8.13516e-06 10
end_path:out1:RootOutput(write) 2.00928 2.77611 3.35874 2.90334 0.409968 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6228.84 MB
Peak resident set size usage (VmHWM): 4008.13 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.temp.json ====
.:
total 6161008
-rw-r--r-- 1 dune001 lbno 44294 Nov 26 12:27 jobscript.log
-rw-r--r-- 1 dune001 lbno 185 Nov 26 12:27 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Nov 26 12:27 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.json
-rw-r--r-- 1 dune001 lbno 0 Nov 26 12:27 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 dune001 lbno 31 Nov 26 12:27 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 dune001 lbno 25 Nov 26 12:26 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 519 Nov 26 12:26 reco_protodunehd_hist.root
-rw-r--r-- 1 dune001 lbno 3574 Nov 26 12:26 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 204800 Nov 26 12:26 mem.db
-rw-r--r-- 1 dune001 lbno 36864 Nov 26 12:26 time.db
-rw-r--r-- 1 dune001 lbno 6252482742 Nov 26 12:26 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258514_3_1_20251126T092254Z_detsim_reco1.root
-rw-r--r-- 1 dune001 lbno 56070980 Nov 26 12:25 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:57 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:53 debugprod.log
-rw-r--r-- 1 dune001 lbno 519 Nov 26 11:53 detsim_single_protodunehd_hist.root 