Jobsub ID 253038.5@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
"
FrameSaver: q=2.37103e+06 n=1217085 tag=gauss
wclsFrameSaver: saving 97731 traces tagged "wiener"
FrameSaver: q=3.10543e+06 n=1180790 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 12172 XUs and 11120 XVs -> 157 XUVs
C:0 T:1 80765 XUs and 70098 XVs -> 4029 XUVs
C:0 T:2 33873 XUs and 57370 XVs -> 992 XUVs
C:0 T:5 20354 XUs and 26888 XVs -> 1795 XUVs
C:0 T:6 18451 XUs and 12224 XVs -> 296 XUVs
C:0 T:7 8 XUs and 10 XVs -> 0 XUVs
7269 XUVs total
2619 collection wire objects
7269 potential space points
Neighbour search...
270077 tests to find 149952 neighbours
Iterating with no regularization...
Begin: 2.71652e+07
0 2.4356e+07
1 2.40959e+07
2 2.4058e+07
3 2.40466e+07
Now with regularization...
Begin: 2.23613e+07
0 2.23544e+07
26-Nov-2025 14:15:25 -03 Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root"
26-Nov-2025 14:15:25 -03 Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 272.002 477.636 584.639 480.823 84.3847 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00595875 0.0199504 0.0761771 0.0142689 0.0195727 10
reco:opdec:Deconvolution 1.41403 1.7475 2.30198 1.65656 0.285821 10
reco:ophitspe:OpHitFinderDeco 0.385914 0.740471 1.26046 0.710181 0.279387 10
reco:opflash:OpFlashFinder 0.106466 0.140439 0.191944 0.132567 0.0259425 10
reco:opslicer:OpSlicer 0.337506 0.458764 0.626327 0.454651 0.100184 10
reco:wclsdatahd:WireCellToolkit 103.7 142.179 187.58 141.057 25.3567 10
reco:gaushit:GausHitFinder 0.797158 1.70017 2.27908 1.64276 0.44364 10
reco:nhitsfilter:NumberOfHitsFilter 0.00162807 0.00517634 0.0103588 0.00470638 0.00256248 10
reco:reco3d:SpacePointSolver 1.08301 2.82353 4.62633 2.72825 0.890391 10
reco:hitpdune:DisambigFromSpacePoints 0.507404 1.61582 2.03923 1.78038 0.470258 10
reco:pandora:StandardPandora 28.9466 53.7396 85.7146 51.6456 14.8919 10
reco:pandoraWriter:StandardPandora 0.707664 0.999561 1.21971 1.01038 0.142974 10
reco:pandoraTrack:LArPandoraTrackCreation 4.43033 11.9796 15.9441 12.4734 3.3801 10
reco:pandoraShower:LArPandoraShowerCreation 2.44321 11.135 15.2245 13.1877 4.31998 10
reco:pandoracalo:Calorimetry 1.68191 4.42311 6.41313 4.30353 1.45358 10
reco:pandoracalonosce:Calorimetry 1.55819 5.00708 8.1658 5.07606 1.74405 10
reco:pandoraShowercalo:ShowerCalorimetry 2.09861 8.36657 11.3293 8.28768 2.41788 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.7805 7.69125 11.9829 7.67509 2.63503 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0801835 0.138895 0.178917 0.147479 0.0317601 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0744765 0.13041 0.173754 0.13249 0.0292957 10
reco:emtrkmichelid:EmTrackMichelId 95.3918 130.145 164.288 129.742 17.3297 10
reco:crttag:SingleCRTMatchingProducer 0.0155932 0.0284456 0.0543956 0.0257741 0.0104715 10
reco:crtreco:TwoCRTMatchingProducer 0.0135765 0.0304495 0.0567031 0.0302275 0.0115848 10
reco:pandora2Track:LArPandoraTrackCreation 5.73728 34.4582 50.7711 35.7152 12.6048 10
reco:pandora2calo:ShowerCalorimetry 1.25598 8.1781 15.1341 7.59738 4.26329 10
reco:pandora2calonosce:ShowerCalorimetry 1.09824 8.38948 15.0854 7.34912 4.17737 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0699226 0.191322 0.670872 0.142524 0.162542 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0718109 0.139823 0.194538 0.138621 0.0308734 10
reco:pandora2Shower:LArPandoraShowerCreation 1.60011 13.3571 22.8497 14.56 5.86945 10
reco:pandora2Showercalo:ShowerCalorimetry 1.49309 10.607 19.4055 9.7482 6.24986 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.49864 10.4463 22.882 8.8202 6.73155 10
[art]:TriggerResults:TriggerResultInserter 4.6251e-05 0.000102963 0.000315223 7.5178e-05 7.77042e-05 10
end_path:out1:RootOutput 9.7e-06 2.16988e-05 8.2704e-05 1.45605e-05 2.07917e-05 10
end_path:out1:RootOutput(write) 3.19841 6.12785 14.5724 4.73292 3.27527 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6137.72 MB
Peak resident set size usage (VmHWM): 3873.76 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.temp.json ====
.:
total 6063068
-rw-r--r-- 1 nobody nobody 40493 Nov 26 14:15 jobscript.log
-rw-r--r-- 1 nobody nobody 204 Nov 26 14:15 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 0 Nov 26 14:15 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.json
-rw-r--r-- 1 nobody nobody 0 Nov 26 14:15 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 nobody nobody 31 Nov 26 14:15 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 nobody nobody 25 Nov 26 14:15 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 519 Nov 26 14:15 reco_protodunehd_hist.root
-rw-r--r-- 1 nobody nobody 3574 Nov 26 14:15 Pandora_Geometry.xml
-rw-r--r-- 1 nobody nobody 204800 Nov 26 14:15 mem.db
-rw-r--r-- 1 nobody nobody 36864 Nov 26 14:15 time.db
-rw-r--r-- 1 nobody nobody 6154333324 Nov 26 14:15 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_253038_5_1_20251126T122644Z_detsim_reco1.root
-rw-r--r-- 1 nobody nobody 53937420 Nov 26 14:11 Pandora_Events.pndr
-rw-r--r-- 1 nobody nobody 0 Nov 26 12:59 ProtoDUNE.log
-rw-r--r-- 1 nobody nobody 0 Nov 26 12:50 debugprod.log
-rw-r--r-- 1 nobody nobody 519 Nov 26 12:49 detsim_single_protodunehd_hist.root 