Jobsub ID 13231.35@dunegpschedd02.fnal.gov

Jobsub ID	13231.35@dunegpschedd02.fnal.gov
Workflow ID	163
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-31 08:20:38
Site	BR_CBPF
Entry	DUNE_BR_CBPF_ce02
Last heartbeat	2025-07-31 16:40:30
From worker node	Hostname	wn31
	cpuinfo	Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-31 08:22:57
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	8h (29369s)
	CPU time	7h (26999s = 91%)
	Max RSS bytes	2571796480 (2452 MiB)
Outputting started	2025-07-31 16:32:27
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco_20250731T082304Z_reco2.root
Finished	2025-07-31 16:40:30
Saved logs	justin-logs:13231.35-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:28 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 13:27:29 -03 run: 4901 subRun: 0 event: 33630
Comparing two wires in the same plane: return failure
%MSG
31-Jul-2025 13:32:19 -03  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco_20250731T082304Z_reco2.root"
31-Jul-2025 13:32:20 -03  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/12/7c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2601.85       2742.27       2897.71       2732.07       90.235         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00516126     0.0402707     0.167027     0.00897743     0.0605448       10     
reco:pandora:StandardPandora                            2292.2        2433.4        2574.64       2430.6        85.691         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000387115   0.00924424     0.0699311    0.00147393     0.0203581       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000412813   0.00386568     0.0219125    0.00214497    0.00608194       10     
reco:pandoracalo:Calorimetry                          0.000293136   0.00163366    0.00631129    0.000879341   0.00188812       10     
reco:pandorapid:Chi2ParticleID                        7.9646e-05    0.000403879   0.00242245    0.000192233   0.000675553      10     
reco:linecluster:LineCluster                            1.88969       2.18087       3.0039        2.09102      0.309284        10     
reco:trajcluster:TrajCluster                           0.592635      0.665271      0.709633      0.675148      0.0329363       10     
reco:pmtracktc:PMAlgTrackMaker                          9.36318       12.3328       13.6783       12.9516       1.54398        10     
reco:emtrkmichelid:EmTrackMichelId                      252.364       290.274       305.658       294.787       15.9851        10     
reco:solarflash:SolarOpFlash                            2.72504       2.88004       3.1311        2.83568      0.112053        10     
[art]:TriggerResults:TriggerResultInserter            4.9412e-05    5.89549e-05   0.00010142    5.37125e-05   1.43725e-05      10     
end_path:out1:RootOutput                              1.1718e-05    1.44367e-05   3.2451e-05    1.25805e-05   6.01806e-06      10     
end_path:out1:RootOutput(write)                        0.434374      0.472825      0.559829      0.471426      0.0346237       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4042.92 MB
  Peak resident set size usage (VmHWM): 2571.8 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco_20250731T082304Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco_20250731T082304Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco_20250731T082304Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T233434Z_gen_003363_supernova_g4stage1_g4stage2_detsim_reco_20250731T082304Z_reco2.root.json
reco2_hist.root