Jobsub ID 17624.43@dunegpschedd01.fnal.gov

Jobsub ID	17624.43@dunegpschedd01.fnal.gov
Workflow ID	55
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-24 09:29:52
Site	US_FNAL-T1
Entry	CMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat	2025-07-24 22:50:31
From worker node	Hostname	dunegli-44332-0-cmswn3007.fnal.gov
	cpuinfo	AMD EPYC 7542 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-24 13:04:08
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco.root
Jobscript	Exit code	0
	Real time	9h (35055s)
	CPU time	9h (34670s = 98%)
	Max RSS bytes	1724600320 (1644 MiB)
Outputting started	2025-07-24 22:48:24
Output files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root
Finished	2025-07-24 22:50:31
Saved logs	justin-logs:17624.43-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
Printing U view candidate length: 25
Printing V view candidate length: 26
Printing W view candidate length: 18
Printing 2D view candidate length: 69
Printing background CaloHitList length: 684
Printing New CaloHitList Names: 
SCaloHitListU | SCaloHitListV | SCaloHitListW | SCaloHitList2D | BBCaloHitList
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
Printing U view candidate length: 25
Printing V view candidate length: 24
Printing W view candidate length: 15
Printing 2D view candidate length: 64
Printing background CaloHitList length: 5
Printing New CaloHitList Names: 
CaloHitListU | CaloHitListV | CaloHitListW | CaloHitList2D | BCaloHitList
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:43:49 UTC run: 5089 subRun: 0 event: 80850
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:43:49 UTC run: 5089 subRun: 0 event: 80850
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 22:43:49 UTC run: 5089 subRun: 0 event: 80850
Comparing two wires in the same plane: return failure
%MSG
55250
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 71930!
Genrating OpFlash 0 with 5 hits
Genrating OpFlash 1 with 3 hits
Genrating OpFlash 2 with 3 hits
Genrating OpFlash 3 with 3 hits
Genrating OpFlash 4 with 3 hits
Genrating OpFlash 5 with 4 hits
Genrating OpFlash 6 with 4 hits
Genrating OpFlash 7 with 3 hits
Genrating OpFlash 8 with 3 hits
Genrating OpFlash 9 with 5 hits
...
Generated 2250 OpFlashes
24-Jul-2025 22:48:13 UTC  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root"
24-Jul-2025 22:48:13 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/05/cd/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              459.392       696.563       791.114       712.566       66.1601        50     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00409466     0.0384366     0.329747      0.0256072     0.0465599       50     
reco:linecluster:LineCluster                           0.0366427     0.109634      0.544199      0.080247      0.0995303       50     
reco:trajcluster:TrajCluster                          0.00994742     0.0220422     0.113166      0.0171381     0.0163256       50     
reco:pandora:StandardPandora                            164.574       407.431       490.055       418.647       56.6019        50     
reco:pandoraTrack:LArPandoraTrackCreation             0.000951259    0.0201432     0.040814      0.0206973    0.00834894       50     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000981047   0.00354837     0.0256164    0.00276504    0.00361721       50     
reco:pandoracalo:Calorimetry                          0.000429772    0.0013506     0.0111419    0.000924919   0.00157369       50     
reco:pandorapid:Chi2ParticleID                        9.7185e-05    0.000414772    0.006872     0.000236192   0.000934176      50     
reco:pmtracktc:PMAlgTrackMaker                        0.00411039     0.0581834     0.628912      0.0298608     0.0931879       50     
reco:pmtracktccalo:Calorimetry                        0.000311376   0.00106744    0.00238229    0.00101659    0.000495568      50     
reco:pmtracktcpid:Chi2ParticleID                      7.1657e-05    0.00022764    0.000497201   0.000200067   0.000109601      50     
reco:emtrkmichelid:EmTrackMichelId                      14.4624       29.5054       42.6337       29.9116       6.04847        50     
reco:opdec:Deconvolution                                20.3279       27.6601       38.0906       27.1213       5.00924        50     
reco:ophitspe:OpHitFinderDeco                           148.87        178.278       207.249       178.098        13.56         50     
reco:opflash:OpFlashFinder                              21.1255       52.5761       78.9649       54.238        12.1661        50     
reco:solarflash:SolarOpFlash                           0.286867      0.572916       1.21849      0.561682      0.172913        50     
reco:rns:RandomNumberSaver                            8.1075e-05    0.000253096   0.00258665    0.000163613    0.0003755       50     
[art]:TriggerResults:TriggerResultInserter             3.127e-05    0.000128741   0.00311914    5.8342e-05    0.000428301      50     
end_path:out1:RootOutput                              1.1462e-05    2.48104e-05   7.2849e-05    2.2348e-05    1.18984e-05      50     
end_path:out1:RootOutput(write)                         0.16505      0.280289      0.431779      0.271843      0.0590786       50     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3256.24 MB
  Peak resident set size usage (VmHWM): 1724.6 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root
Extracted metadata
checking file====== fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250207T091612Z_gen_001617_supernova_g4_detsim_reco_20250724T130419Z_reco2.root.temp.json
reco2_hist.root