Jobsub ID 17624.46@dunegpschedd01.fnal.gov

Jobsub ID	17624.46@dunegpschedd01.fnal.gov
Workflow ID	55
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-24 09:29:52
Site	US_FNAL-T1
Entry	CMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat	2025-07-24 22:40:15
From worker node	Hostname	dunegli-44332-0-cmswn3007.fnal.gov
	cpuinfo	AMD EPYC 7542 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-24 13:04:00
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco.root
Jobscript	Exit code	0
	Real time	9h (34463s)
	CPU time	9h (34109s = 98%)
	Max RSS bytes	1728094208 (1648 MiB)
Outputting started	2025-07-24 22:38:24
Output files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root
Finished	2025-07-24 22:40:15
Saved logs	justin-logs:17624.46-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
Printing U view candidate length: 30
Printing V view candidate length: 42
Printing W view candidate length: 22
Printing 2D view candidate length: 94
Printing background CaloHitList length: 665
Printing New CaloHitList Names: 
SCaloHitListU | SCaloHitListV | SCaloHitListW | SCaloHitList2D | BBCaloHitList
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
Printing U view candidate length: 28
Printing V view candidate length: 30
Printing W view candidate length: 20
Printing 2D view candidate length: 78
Printing background CaloHitList length: 5
Printing New CaloHitList Names: 
CaloHitListU | CaloHitListV | CaloHitListW | CaloHitList2D | BCaloHitList
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:33:28 UTC run: 5082 subRun: 0 event: 179600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:33:28 UTC run: 5082 subRun: 0 event: 179600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:33:28 UTC run: 5082 subRun: 0 event: 179600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:33:28 UTC run: 5082 subRun: 0 event: 179600
Comparing two wires in the same plane: return failure
%MSG
54976
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 71419!
Genrating OpFlash 0 with 3 hits
Genrating OpFlash 1 with 5 hits
Genrating OpFlash 2 with 3 hits
Genrating OpFlash 3 with 3 hits
Genrating OpFlash 4 with 3 hits
Genrating OpFlash 5 with 3 hits
Genrating OpFlash 6 with 6 hits
Genrating OpFlash 7 with 3 hits
Genrating OpFlash 8 with 5 hits
Genrating OpFlash 9 with 4 hits
...
Generated 2160 OpFlashes
24-Jul-2025 22:38:17 UTC  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root"
24-Jul-2025 22:38:17 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/3f/7b/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              533.494       684.24        786.363       688.169       57.6168        50     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00488959     0.0219285     0.116246      0.0187074     0.0154027       50     
reco:linecluster:LineCluster                           0.0346517     0.0672911     0.124269      0.0661714     0.0155599       50     
reco:trajcluster:TrajCluster                           0.0103168     0.0195858      0.12636      0.0162366     0.0163015       50     
reco:pandora:StandardPandora                            269.61        401.147       493.819       406.066       55.8621        50     
reco:pandoraTrack:LArPandoraTrackCreation             0.000439671    0.0207741     0.0376283     0.0208864     0.010411        50     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000404213    0.0027589     0.0127056    0.00223592    0.00194912       50     
reco:pandoracalo:Calorimetry                          0.00025081    0.000990821   0.00408892    0.000759898   0.000792443      50     
reco:pandorapid:Chi2ParticleID                        7.5845e-05    0.000283792   0.00155482    0.00020918    0.00023078       50     
reco:pmtracktc:PMAlgTrackMaker                        0.00440674     0.0520899     0.234918      0.0345071     0.055198        50     
reco:pmtracktccalo:Calorimetry                        0.000281959   0.00103829    0.00390278    0.000870976   0.000619289      50     
reco:pmtracktcpid:Chi2ParticleID                      7.0024e-05    0.000242696   0.000931652   0.000196681   0.000161492      50     
reco:emtrkmichelid:EmTrackMichelId                      10.0094       30.1272       43.4428       31.2997       6.31934        50     
reco:opdec:Deconvolution                                18.4457       27.1925       35.6476       27.1057       4.49361        50     
reco:ophitspe:OpHitFinderDeco                           145.226       173.82        200.462       173.045       13.0582        50     
reco:opflash:OpFlashFinder                              23.0261       50.9387       70.3711       52.3712       11.1934        50     
reco:solarflash:SolarOpFlash                           0.351422       0.55157       0.96823      0.517913      0.147903        50     
reco:rns:RandomNumberSaver                             8.355e-05    0.000164627   0.00106828    0.000131947   0.000139769      50     
[art]:TriggerResults:TriggerResultInserter            3.3704e-05    6.17847e-05   0.000171127   5.04065e-05   3.15846e-05      50     
end_path:out1:RootOutput                               8.196e-06    2.30882e-05   0.000180215    1.811e-05    2.37252e-05      50     
end_path:out1:RootOutput(write)                         0.19492      0.273218      0.423633      0.264422      0.0518561       50     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3253.04 MB
  Peak resident set size usage (VmHWM): 1728.09 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root
Extracted metadata
checking file====== fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250206T134857Z_gen_003592_supernova_g4_detsim_reco_20250724T130410Z_reco2.root.temp.json
reco2_hist.root