Jobsub ID 252825.8@dunegpschedd02.fnal.gov
Jobscript log (last 10,000 characters)
s tagged "gauss"
FrameSaver: q=2.48594e+06 n=1249706 tag=gauss
wclsFrameSaver: saving 103169 traces tagged "wiener"
FrameSaver: q=3.25103e+06 n=1183984 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 12573 XUs and 10606 XVs -> 198 XUVs
C:0 T:1 69980 XUs and 65593 XVs -> 3548 XUVs
C:0 T:2 22819 XUs and 54168 XVs -> 2096 XUVs
C:0 T:4 30 XUs and 22 XVs -> 0 XUVs
C:0 T:5 30739 XUs and 31795 XVs -> 533 XUVs
C:0 T:6 5641 XUs and 9495 XVs -> 588 XUVs
6963 XUVs total
2341 collection wire objects
6963 potential space points
Neighbour search...
247051 tests to find 151812 neighbours
Iterating with no regularization...
Begin: 2.88648e+07
0 2.6738e+07
1 2.65364e+07
2 2.65077e+07
3 2.64988e+07
Now with regularization...
Begin: 2.4727e+07
0 2.47206e+07
26-Nov-2025 11:32:04 CET Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root"
26-Nov-2025 11:32:04 CET Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 115.848 162.613 221.297 163.136 29.8368 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00169587 0.0179853 0.0328347 0.0192106 0.0115683 10
reco:opdec:Deconvolution 0.838778 0.970377 1.0877 0.976081 0.094202 10
reco:ophitspe:OpHitFinderDeco 0.23014 0.246565 0.261281 0.247883 0.0105673 10
reco:opflash:OpFlashFinder 0.072804 0.101558 0.130832 0.0982066 0.0188058 10
reco:opslicer:OpSlicer 0.256239 0.297053 0.358954 0.282371 0.0352019 10
reco:wclsdatahd:WireCellToolkit 51.3448 53.1211 54.3591 53.1031 1.02407 10
reco:gaushit:GausHitFinder 0.706162 1.01096 1.32266 1.08932 0.199326 10
reco:nhitsfilter:NumberOfHitsFilter 0.000317826 0.00045761 0.000753753 0.000438888 0.000120794 10
reco:reco3d:SpacePointSolver 0.542536 1.24821 2.03405 1.28216 0.438694 10
reco:hitpdune:DisambigFromSpacePoints 0.326968 0.762396 1.16079 0.842043 0.28183 10
reco:pandora:StandardPandora 13.505 28.2985 49.3275 26.2218 10.541 10
reco:pandoraWriter:StandardPandora 0.261958 0.335455 0.415715 0.326429 0.0520997 10
reco:pandoraTrack:LArPandoraTrackCreation 1.90316 3.42665 4.49104 3.6086 0.785809 10
reco:pandoraShower:LArPandoraShowerCreation 1.66233 3.43928 5.91786 2.95083 1.28262 10
reco:pandoracalo:Calorimetry 0.868193 1.7325 2.53693 1.79247 0.536586 10
reco:pandoracalonosce:Calorimetry 0.8435 1.65491 2.44788 1.69565 0.430761 10
reco:pandoraShowercalo:ShowerCalorimetry 1.42229 2.92012 5.45161 2.56402 1.1657 10
reco:pandoraShowercalonosce:ShowerCalorimetry 1.21697 2.68198 5.6015 2.42819 1.18378 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0526107 0.0781941 0.104615 0.0778863 0.01719 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0521357 0.0766974 0.107058 0.0742798 0.0183231 10
reco:emtrkmichelid:EmTrackMichelId 25.8997 34.5355 46.4063 34.8942 6.30282 10
reco:crttag:SingleCRTMatchingProducer 0.00654147 0.0103839 0.0136745 0.0100425 0.00222685 10
reco:crtreco:TwoCRTMatchingProducer 0.00587583 0.00922489 0.0133436 0.00928708 0.0019637 10
reco:pandora2Track:LArPandoraTrackCreation 3.38096 7.53151 13.36 7.09013 2.80049 10
reco:pandora2calo:ShowerCalorimetry 1.10207 2.59241 6.2162 2.07985 1.40365 10
reco:pandora2calonosce:ShowerCalorimetry 1.07315 2.45209 5.58037 2.22263 1.22934 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.050801 0.074261 0.0991231 0.0729516 0.0164813 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0518229 0.0722255 0.093696 0.0724269 0.0148062 10
reco:pandora2Shower:LArPandoraShowerCreation 1.59703 3.40554 5.70546 3.12769 1.12865 10
reco:pandora2Showercalo:ShowerCalorimetry 1.6824 3.56544 6.04217 3.69887 1.23753 10
reco:pandora2Showercalonosce:ShowerCalorimetry 1.56624 3.22324 6.45481 2.84174 1.34772 10
[art]:TriggerResults:TriggerResultInserter 3.2301e-05 6.92891e-05 0.000132859 5.91915e-05 3.17794e-05 10
end_path:out1:RootOutput 4.408e-06 1.19334e-05 3.5777e-05 9.8285e-06 8.59303e-06 10
end_path:out1:RootOutput(write) 2.03146 2.53602 3.02952 2.5688 0.334611 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6123.56 MB
Peak resident set size usage (VmHWM): 3897.58 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.temp.json ====
.:
total 5764384
-rw-r--r-- 1 dune001 lbno 40425 Nov 26 11:32 jobscript.log
-rw-r--r-- 1 dune001 lbno 202 Nov 26 11:32 justin-processed-pfns.txt
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:32 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.json
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:32 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 dune001 lbno 31 Nov 26 11:32 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 dune001 lbno 25 Nov 26 11:32 all-input-dids.txt
-rw-r--r-- 1 dune001 lbno 519 Nov 26 11:32 reco_protodunehd_hist.root
-rw-r--r-- 1 dune001 lbno 3574 Nov 26 11:32 Pandora_Geometry.xml
-rw-r--r-- 1 dune001 lbno 204800 Nov 26 11:32 mem.db
-rw-r--r-- 1 dune001 lbno 36864 Nov 26 11:32 time.db
-rw-r--r-- 1 dune001 lbno 5854751047 Nov 26 11:32 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_252825_8_1_20251126T084505Z_detsim_reco1.root
-rw-r--r-- 1 dune001 lbno 47665550 Nov 26 11:30 Pandora_Events.pndr
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:06 ProtoDUNE.log
-rw-r--r-- 1 dune001 lbno 0 Nov 26 11:03 debugprod.log
-rw-r--r-- 1 dune001 lbno 519 Nov 26 11:02 detsim_single_protodunehd_hist.root 