Jobsub ID 252800.32@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
gauss"
FrameSaver: q=2.06135e+06 n=1116445 tag=gauss
wclsFrameSaver: saving 85067 traces tagged "wiener"
FrameSaver: q=2.61055e+06 n=1092083 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 12695 XUs and 10299 XVs -> 146 XUVs
C:0 T:1 96049 XUs and 78066 XVs -> 3651 XUVs
C:0 T:2 17977 XUs and 17420 XVs -> 1025 XUVs
C:0 T:5 8492 XUs and 7027 XVs -> 226 XUVs
C:0 T:6 21019 XUs and 23020 XVs -> 1011 XUVs
C:0 T:7 4 XUs and 11 XVs -> 1 XUVs
6060 XUVs total
2765 collection wire objects
6060 potential space points
Neighbour search...
217638 tests to find 80030 neighbours
Iterating with no regularization...
Begin: 3.38169e+07
0 3.09695e+07
1 3.07237e+07
2 3.06903e+07
3 3.06836e+07
Now with regularization...
Begin: 2.9036e+07
0 2.90312e+07
26-Nov-2025 11:41:06 CET Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root"
26-Nov-2025 11:41:06 CET Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 145.446 223.98 401.836 206.479 69.2503 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00634884 0.0148295 0.038231 0.0126579 0.00892704 10
reco:opdec:Deconvolution 0.873665 1.10579 1.23849 1.12641 0.111393 10
reco:ophitspe:OpHitFinderDeco 0.222933 0.254304 0.321434 0.247916 0.0276589 10
reco:opflash:OpFlashFinder 0.0623114 0.106517 0.158453 0.103408 0.0258853 10
reco:opslicer:OpSlicer 0.233861 0.332312 0.40468 0.336042 0.0495044 10
reco:wclsdatahd:WireCellToolkit 60.271 66.2853 72.5518 65.9524 3.64289 10
reco:gaushit:GausHitFinder 0.799914 1.17874 1.65967 1.20892 0.237865 10
reco:nhitsfilter:NumberOfHitsFilter 0.000403812 0.00071276 0.00114556 0.00068615 0.000198616 10
reco:reco3d:SpacePointSolver 0.655158 1.96231 4.63605 1.66822 1.2073 10
reco:hitpdune:DisambigFromSpacePoints 0.500928 1.43128 2.85993 1.4063 0.671374 10
reco:pandora:StandardPandora 21.3714 54.4482 143.194 43.5818 33.6201 10
reco:pandoraWriter:StandardPandora 0.274796 0.462184 0.604314 0.450808 0.0953041 10
reco:pandoraTrack:LArPandoraTrackCreation 1.4045 3.73803 8.01712 3.59213 1.69676 10
reco:pandoraShower:LArPandoraShowerCreation 1.31051 3.34057 7.24204 2.92948 1.58196 10
reco:pandoracalo:Calorimetry 0.736455 1.7689 3.91614 1.64011 0.846565 10
reco:pandoracalonosce:Calorimetry 0.669933 1.65807 3.5034 1.52984 0.742845 10
reco:pandoraShowercalo:ShowerCalorimetry 1.41773 3.18956 6.86728 2.97619 1.42777 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.10441 2.89807 6.22755 2.48873 1.31711 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0418386 0.0843579 0.117294 0.0837395 0.0199745 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0486138 0.0827584 0.11937 0.0815584 0.017855 10
reco:emtrkmichelid:EmTrackMichelId 33.0024 51.797 82.3155 50.716 13.6594 10
reco:crttag:SingleCRTMatchingProducer 0.0068664 0.00938071 0.0145764 0.00864876 0.00248391 10
reco:crtreco:TwoCRTMatchingProducer 0.00554798 0.00770528 0.0107703 0.0069709 0.00169153 10
reco:pandora2Track:LArPandoraTrackCreation 3.15913 8.59214 18.6585 7.90453 4.04663 10
reco:pandora2calo:ShowerCalorimetry 1.04063 2.61763 5.93701 2.22138 1.27742 10
reco:pandora2calonosce:ShowerCalorimetry 0.999982 2.57859 5.9045 2.18377 1.27614 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0589943 0.0848144 0.123616 0.0841239 0.0173701 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0553737 0.0840623 0.117402 0.0816433 0.0168845 10
reco:pandora2Shower:LArPandoraShowerCreation 1.36309 3.56077 7.46681 3.359 1.64165 10
reco:pandora2Showercalo:ShowerCalorimetry 1.29364 3.57306 7.181 3.10425 1.57657 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.28952 3.45806 7.24045 2.89535 1.60604 10
[art]:TriggerResults:TriggerResultInserter 4.0676e-05 7.40789e-05 0.000144002 6.52635e-05 3.11232e-05 10
end_path:out1:RootOutput 6.983e-06 1.2771e-05 4.6237e-05 8.942e-06 1.12453e-05 10
end_path:out1:RootOutput(write) 2.17148 3.04891 4.08066 3.05805 0.50255 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6303.53 MB
Peak resident set size usage (VmHWM): 4079.32 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.temp.json ====
.:
total 6353472
-rw-r--r-- 1 dune001 lbno 41333 Nov 26 11:41 jobscript.log
-rw-r--r-- 1 dune001 lbno 205 Nov 26 11:41 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:41 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.json
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:41 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 dune001 lbno 31 Nov 26 11:41 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 dune001 lbno 25 Nov 26 11:41 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 519 Nov 26 11:41 reco_protodunehd_hist.root
-rw-r--r-- 1 dune001 lbno 3574 Nov 26 11:41 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 204800 Nov 26 11:41 mem.db
-rw-r--r-- 1 dune001 lbno 36864 Nov 26 11:41 time.db
-rw-r--r-- 1 dune001 lbno 6448197654 Nov 26 11:41 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252800_32_1_20251126T082323Z_detsim_reco1.root
-rw-r--r-- 1 dune001 lbno 57440150 Nov 26 11:39 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:05 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:01 debugprod.log
-rw-r--r-- 1 dune001 lbno 519 Nov 26 11:01 detsim_single_protodunehd_hist.root 