Jobsub ID 258670.8@dunegpschedd01.fnal.gov
Jobscript log (last 10,000 characters)
71 tag=gauss
wclsFrameSaver: saving 94644 traces tagged "wiener"
FrameSaver: q=2.67767e+06 n=1140475 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 6067 XUs and 6189 XVs -> 57 XUVs
C:0 T:1 50867 XUs and 39514 XVs -> 1252 XUVs
C:0 T:2 28537 XUs and 32593 XVs -> 1423 XUVs
C:0 T:3 0 XUs and 25 XVs -> 0 XUVs
C:0 T:4 41 XUs and 30 XVs -> 2 XUVs
C:0 T:5 45756 XUs and 52550 XVs -> 2849 XUVs
C:0 T:6 25938 XUs and 20158 XVs -> 324 XUVs
5907 XUVs total
2786 collection wire objects
5907 potential space points
Neighbour search...
260173 tests to find 136612 neighbours
Iterating with no regularization...
Begin: 2.82283e+07
0 2.5436e+07
1 2.52389e+07
2 2.52129e+07
3 2.52063e+07
Now with regularization...
Begin: 2.32003e+07
0 2.31947e+07
26-Nov-2025 11:28:45 -03 Closed output file "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root"
26-Nov-2025 11:28:45 -03 Closed input file "temp_detsim.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 126.643 209.801 356.07 195.597 61.225 10
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00186494 0.00833044 0.0135743 0.00890044 0.00403778 10
reco:opdec:Deconvolution 0.799504 1.30148 1.66488 1.35449 0.220261 10
reco:ophitspe:OpHitFinderDeco 0.165903 0.32731 0.434533 0.335005 0.0623906 10
reco:opflash:OpFlashFinder 0.0717158 0.12791 0.199551 0.121128 0.0363349 10
reco:opslicer:OpSlicer 0.209879 0.398869 0.485726 0.429461 0.0879546 10
reco:wclsdatahd:WireCellToolkit 67.8631 71.5549 74.5289 71.9599 1.79815 10
reco:gaushit:GausHitFinder 0.820765 1.35966 1.84837 1.41273 0.323497 10
reco:nhitsfilter:NumberOfHitsFilter 0.000331152 0.000614572 0.00105889 0.000576185 0.000241938 10
reco:reco3d:SpacePointSolver 0.488455 1.58896 3.34027 1.27775 0.936547 10
reco:hitpdune:DisambigFromSpacePoints 0.28886 1.22411 2.68854 1.1375 0.636288 10
reco:pandora:StandardPandora 9.32349 40.202 115.697 28.1094 31.5797 10
reco:pandoraWriter:StandardPandora 0.490776 0.782519 1.0209 0.790275 0.190241 10
reco:pandoraTrack:LArPandoraTrackCreation 0.854784 3.49879 8.36477 3.01251 1.98942 10
reco:pandoraShower:LArPandoraShowerCreation 0.737669 2.9319 7.36385 2.62671 1.69607 10
reco:pandoracalo:Calorimetry 0.491174 1.65399 2.93775 1.55402 0.680512 10
reco:pandoracalonosce:Calorimetry 0.500399 1.65213 3.46687 1.48223 0.79592 10
reco:pandoraShowercalo:ShowerCalorimetry 0.666148 2.73514 6.19357 2.61335 1.41156 10
reco:pandoraShowercalonosce:ShowerCalorimetry 0.655996 2.68463 6.14375 2.60117 1.4177 10
reco:pandoraGnocchiCalo:GnocchiCalorimetry 0.0632698 0.106137 0.141553 0.108876 0.0256534 10
reco:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0604223 0.106519 0.150532 0.109138 0.0269921 10
reco:emtrkmichelid:EmTrackMichelId 29.3305 47.9044 67.4637 47.6023 9.66348 10
reco:crttag:SingleCRTMatchingProducer 0.00589428 0.0095093 0.013537 0.00926185 0.00207206 10
reco:crtreco:TwoCRTMatchingProducer 0.00494547 0.00760336 0.0122924 0.00747739 0.00183149 10
reco:pandora2Track:LArPandoraTrackCreation 2.06525 7.7765 15.7655 7.49544 3.5272 10
reco:pandora2calo:ShowerCalorimetry 0.603727 2.29978 4.73642 2.12769 1.04022 10
reco:pandora2calonosce:ShowerCalorimetry 0.571846 2.28749 5.32389 1.99641 1.18344 10
reco:pandora2GnocchiCalo:GnocchiCalorimetry 0.0583407 0.100048 0.153375 0.101498 0.0300818 10
reco:pandora2GnocchiCalonosce:GnocchiCalorimetry 0.0599776 0.100325 0.154008 0.099527 0.029097 10
reco:pandora2Shower:LArPandoraShowerCreation 0.875145 3.22156 6.6973 2.93359 1.50927 10
reco:pandora2Showercalo:ShowerCalorimetry 0.840511 3.37855 8.12406 2.98504 1.85034 10
reco:pandora2Showercalonosce:ShowerCalorimetry 0.809766 3.14522 8.17827 2.6751 1.86732 10
[art]:TriggerResults:TriggerResultInserter 3.0831e-05 4.67787e-05 0.000157235 3.30565e-05 3.70312e-05 10
end_path:out1:RootOutput 4.92e-06 9.5614e-06 4.0182e-05 6.145e-06 1.02193e-05 10
end_path:out1:RootOutput(write) 4.05274 5.14334 6.32926 4.98625 0.719424 10
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6151.06 MB
Peak resident set size usage (VmHWM): 3922.57 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Reco returns 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_10_04d00/bin/extractor_prod.py", line 379, in main
arbjson = json.load(injson)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 12 column 1 (char 454)
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.ext.json ====
Error loading input json file.
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.ext.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.json ====
==== Start pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.temp.json ====
==== End pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.temp.json ====
.:
total 5675964
-rw-r--r-- 1 nobody nobody 41337 Nov 26 11:28 jobscript.log
-rw-r--r-- 1 nobody nobody 203 Nov 26 11:28 justin-processed-pfns.txt
-rw-r--r-- 1 nobody nobody 0 Nov 26 11:28 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.json
-rw-r--r-- 1 nobody nobody 0 Nov 26 11:28 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.temp.json
-rw-r--r-- 1 nobody nobody 31 Nov 26 11:28 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root.ext.json
-rw-r--r-- 1 nobody nobody 25 Nov 26 11:28 all-input-dids.txt
-rw-r--r-- 1 nobody nobody 519 Nov 26 11:28 reco_protodunehd_hist.root
-rw-r--r-- 1 nobody nobody 3574 Nov 26 11:28 Pandora_Geometry.xml
-rw-r--r-- 1 nobody nobody 204800 Nov 26 11:28 mem.db
-rw-r--r-- 1 nobody nobody 36864 Nov 26 11:28 time.db
-rw-r--r-- 1 nobody nobody 5761619712 Nov 26 11:28 pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258670_8_1_20251126T113310Z_detsim_reco1.root
-rw-r--r-- 1 nobody nobody 50246150 Nov 26 11:27 Pandora_Events.pndr
-rw-r--r-- 1 nobody nobody 0 Nov 26 10:56 ProtoDUNE.log
-rw-r--r-- 1 nobody nobody 0 Nov 26 10:51 debugprod.log
-rw-r--r-- 1 nobody nobody 519 Nov 26 10:50 detsim_single_protodunehd_hist.root 