Jobsub ID 258781.0@dunegpschedd01.fnal.gov
Jobscript log (last 10,000 characters)
n=1158750 tag=gauss
wclsFrameSaver: saving 87639 traces tagged "wiener"
FrameSaver: q=2.96012e+06 n=1144717 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 16866 XUs and 13847 XVs -> 161 XUVs
C:0 T:1 109824 XUs and 103166 XVs -> 3459 XUVs
C:0 T:2 14684 XUs and 7969 XVs -> 232 XUVs
C:0 T:5 9367 XUs and 6391 XVs -> 201 XUVs
C:0 T:6 19661 XUs and 15369 XVs -> 629 XUVs
4682 XUVs total
2567 collection wire objects
4682 potential space points
Neighbour search...
93114 tests to find 42724 neighbours
Iterating with no regularization...
Begin: 3.29749e+07
0 3.13695e+07
1 3.12673e+07
2 3.12581e+07
Now with regularization...
Begin: 2.98096e+07
0 2.98073e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
26-Nov-2025 14:23:23 -03 Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root"
26-Nov-2025 14:23:23 -03 Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 188.283 277.588 556.091 244.034 105.853 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00144004 0.0123539 0.0232195 0.0133731 0.00737928 10
reco:opdec:Deconvolution 1.11884 1.54057 1.94548 1.52694 0.252955 10
reco:ophitspe:OpHitFinderDeco 0.304317 0.342941 0.380607 0.34449 0.0226351 10
reco:opflash:OpFlashFinder 0.0933372 0.169352 0.259705 0.167069 0.0528395 10
reco:opslicer:OpSlicer 0.309793 0.497343 0.748164 0.490008 0.12049 10
reco:wclsdatahd:WireCellToolkit 67.7624 72.5533 75.6961 73.5206 2.38514 10
reco:gaushit:GausHitFinder 1.00724 1.74415 2.90682 1.58696 0.564381 10
reco:nhitsfilter:NumberOfHitsFilter 0.000455128 0.000701006 0.00113133 0.000733194 0.000200802 10
reco:reco3d:SpacePointSolver 1.38334 2.30088 4.63425 2.02907 0.952247 10
reco:hitpdune:DisambigFromSpacePoints 1.00528 1.97442 4.4618 1.64123 0.985697 10
reco:pandora:StandardPandora 24.7969 66.4908 219.289 47.4314 53.5273 10
reco:pandoraWriter:StandardPandora 0.48834 0.875474 1.76375 0.63794 0.454262 10
reco:pandoraTrack:LArPandoraTrackCreation 2.40788 4.68982 10.4498 3.60193 2.57597 10
reco:pandoraShower:LArPandoraShowerCreation 2.46805 5.08922 11.5211 3.76492 2.75996 10
reco:pandoracalo:Calorimetry 1.1421 2.46682 6.13973 1.63494 1.67705 10
reco:pandoracalonosce:Calorimetry 0.851011 2.24589 5.28075 1.64719 1.41983 10
reco:pandoraShowercalo:ShowerCalorimetry 2.01563 5.10755 11.3049 3.37508 3.20539 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.88218 4.71488 9.74033 3.34607 2.79456 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0438432 0.113151 0.203929 0.104964 0.052386 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0469129 0.109364 0.194156 0.102639 0.04978 10
reco:emtrkmichelid:EmTrackMichelId 45.2414 58.1487 83.9061 54.1698 12.3777 10
reco:crttag:SingleCRTMatchingProducer 0.00527042 0.0126278 0.0171261 0.0133821 0.00341985 10
reco:crtreco:TwoCRTMatchingProducer 0.0050696 0.00899407 0.0123999 0.00912498 0.00196759 10
reco:pandora2Track:LArPandoraTrackCreation 6.08326 13.6802 35.7486 9.64715 8.82894 10
reco:pandora2calo:ShowerCalorimetry 2.03679 4.58584 9.49409 3.28508 2.56883 10
reco:pandora2calonosce:ShowerCalorimetry 1.94002 4.56382 10.5714 3.25263 2.70373 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0821105 0.129102 0.201915 0.124451 0.0351721 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0836855 0.129432 0.208886 0.125944 0.0356813 10
reco:pandora2Shower:LArPandoraShowerCreation 2.7923 5.53528 13.6905 4.39436 3.28405 10
reco:pandora2Showercalo:ShowerCalorimetry 3.00412 5.82904 14.7839 4.23752 3.51646 10
reco:pandora2Showercalonosce:ShowerCalorimetry 2.5422 5.54439 13.2481 4.10521 3.33647 10
[art]:TriggerResults:TriggerResultInserter 2.6941e-05 4.846e-05 0.000123065 3.9572e-05 2.64805e-05 10
end_path:out1:RootOutput 5.4e-06 9.5724e-06 3.3342e-05 7.1255e-06 7.97241e-06 10
end_path:out1:RootOutput(write) 3.96757 6.15513 8.91639 5.94122 1.45575 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6576.13 MB
Peak resident set size usage (VmHWM): 4116.33 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.temp.json ====
.:
total 6709972
-rw-r--r-- 1 nobody nobody 52243 Nov 26 14:23 jobscript.log
-rw-r--r-- 1 nobody nobody 204 Nov 26 14:23 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 0 Nov 26 14:23 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.json
-rw-r--r-- 1 nobody nobody 0 Nov 26 14:23 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 nobody nobody 31 Nov 26 14:23 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 nobody nobody 25 Nov 26 14:23 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 519 Nov 26 14:23 reco_protodunehd_hist.root
-rw-r--r-- 1 nobody nobody 3574 Nov 26 14:23 Pandora_Geometry.xml
-rw-r--r-- 1 nobody nobody 204800 Nov 26 14:23 mem.db
-rw-r--r-- 1 nobody nobody 36864 Nov 26 14:23 time.db
-rw-r--r-- 1 nobody nobody 6809572623 Nov 26 14:23 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258781_0_1_20251126T135455Z_detsim_reco1.root
-rw-r--r-- 1 nobody nobody 61108760 Nov 26 14:21 Pandora_Events.pndr
-rw-r--r-- 1 nobody nobody 0 Nov 26 13:38 ProtoDUNE.log
-rw-r--r-- 1 nobody nobody 0 Nov 26 13:34 debugprod.log
-rw-r--r-- 1 nobody nobody 519 Nov 26 13:33 detsim_single_protodunehd_hist.root 