Jobsub ID 17672.64@dunegpschedd01.fnal.gov

Jobsub ID	17672.64@dunegpschedd01.fnal.gov
Workflow ID	58
Stage ID	1
User name	epennacc@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-24 12:32:04
Site	BR_CBPF
Entry	DUNE_BR_CBPF_ce01
Last heartbeat	2025-07-25 03:49:51
From worker node	Hostname	wn59
	cpuinfo	Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-24 13:27:20
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco.root
Jobscript	Exit code	0
	Real time	13h (48975s)
	CPU time	10h (38391s = 78%)
	Max RSS bytes	1761378304 (1679 MiB)
Outputting started	2025-07-25 03:03:37
Output files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root
Finished	2025-07-25 03:49:51
Saved logs	justin-logs:17672.64-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

fied*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
*Signal Pixel identified*
Printing U view candidate length: 28
Printing V view candidate length: 29
Printing W view candidate length: 25
Printing 2D view candidate length: 82
Printing background CaloHitList length: 739
Printing New CaloHitList Names: 
SCaloHitListU | SCaloHitListV | SCaloHitListW | SCaloHitList2D | BBCaloHitList
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Photon identified*
*Photon identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
*Electron identified*
Printing U view candidate length: 27
Printing V view candidate length: 28
Printing W view candidate length: 25
Printing 2D view candidate length: 80
Printing background CaloHitList length: 2
Printing New CaloHitList Names: 
CaloHitListU | CaloHitListV | CaloHitListW | CaloHitList2D | BCaloHitList
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 23:53:36 -03 run: 5064 subRun: 0 event: 16950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  24-Jul-2025 23:53:36 -03 run: 5064 subRun: 0 event: 16950
Comparing two wires in the same plane: return failure
%MSG
56039
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 73446!
Genrating OpFlash 0 with 3 hits
Genrating OpFlash 1 with 9 hits
Genrating OpFlash 2 with 6 hits
Genrating OpFlash 3 with 6 hits
Genrating OpFlash 4 with 3 hits
Genrating OpFlash 5 with 3 hits
Genrating OpFlash 6 with 4 hits
Genrating OpFlash 7 with 5 hits
Genrating OpFlash 8 with 6 hits
Genrating OpFlash 9 with 3 hits
...
Generated 2240 OpFlashes
25-Jul-2025 00:00:09 -03  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root"
25-Jul-2025 00:00:09 -03  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e5/12/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              524.878       888.928       4733.72       737.063       597.002        50     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                  0.16091      0.311683       1.69398       0.21708      0.243543        50     
reco:linecluster:LineCluster                            1.52795        1.997        3.73494       1.77692      0.518941        50     
reco:trajcluster:TrajCluster                           0.483461      0.670696       3.19661       0.53607      0.491308        50     
reco:pandora:StandardPandora                            181.494       375.724       4206.26       288.136       554.473        50     
reco:pandoraTrack:LArPandoraTrackCreation             0.00080115     0.0171758      0.13743      0.0100532     0.0217704       50     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000532972    0.0215441     0.552908     0.00493898     0.0802844       50     
reco:pandoracalo:Calorimetry                          0.000480444   0.00850089     0.178909     0.00162261     0.0271727       50     
reco:pandorapid:Chi2ParticleID                        6.4964e-05    0.00274148     0.0749763    0.000397247    0.0109076       50     
reco:pmtracktc:PMAlgTrackMaker                        0.00841937     0.166469       1.58093      0.0929452     0.240287        50     
reco:pmtracktccalo:Calorimetry                        0.000579525   0.00483473     0.109537     0.00175618     0.0151941       50     
reco:pmtracktcpid:Chi2ParticleID                      0.000106785   0.00137346     0.0448846    0.000275903    0.0062394       50     
reco:emtrkmichelid:EmTrackMichelId                      14.2733       26.6233       56.9761       24.8853       8.73911        50     
reco:opdec:Deconvolution                                42.4699       59.6013       156.376       56.1496       16.9317        50     
reco:ophitspe:OpHitFinderDeco                           233.236       342.434       516.765       337.674       67.8586        50     
reco:opflash:OpFlashFinder                              16.6631       78.3232       825.711       28.6864       178.949        50     
reco:solarflash:SolarOpFlash                           0.421438       1.49282       9.49818       1.02122       1.74994        50     
reco:rns:RandomNumberSaver                            0.000103522   0.00206929     0.0353943    0.000382521   0.00650461       50     
[art]:TriggerResults:TriggerResultInserter            1.6353e-05    0.000190278   0.00161785    9.93615e-05   0.00027034       50     
end_path:out1:RootOutput                              1.7686e-05    0.000226118   0.00832996    4.1307e-05    0.00115955       50     
end_path:out1:RootOutput(write)                        0.304885       1.48334       15.9025      0.974592       2.17275        50     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3258.32 MB
  Peak resident set size usage (VmHWM): 1761.38 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root
Extracted metadata
checking file====== fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root.json
prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_centralAPA_20250205T102313Z_gen_000339_supernova_g4_detsim_reco_20250724T133304Z_reco2.root.temp.json
reco2_hist.root