Jobsub ID 12303.11@dunegpschedd02.fnal.gov

Jobsub ID	12303.11@dunegpschedd02.fnal.gov
Workflow ID	100
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-29 10:10:10
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_brug
Last heartbeat	2025-07-29 16:22:49
From worker node	Hostname	wn-snel-029.farm.nikhef.nl
	cpuinfo	AMD EPYC 7H12 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	jobscript_error
Started	2025-07-29 10:11:59
Input files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T015627Z_gen_002747_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-07-29 16:22:49
Saved logs	justin-logs:12303.11-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs
Jobscript log (last 10,000 characters)

0
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:09 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 18:20:10 CEST run: 5185 subRun: 0 event: 27470
Comparing two wires in the same plane: return failure
%MSG
29-Jul-2025 18:22:19 CEST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T015627Z_gen_002747_supernova_g4stage1_g4stage2_detsim_reco_20250729T101204Z_reco2.root"
29-Jul-2025 18:22:19 CEST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/f1/a6/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T015627Z_gen_002747_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1830.22       2195.92       3450.14       1963.37       481.711        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00567235     0.0391728     0.175451     0.00820679     0.0627021       10     
reco:pandora:StandardPandora                            1696.27       2030.07       3178.17       1819.23       444.513        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000152495    0.010506      0.0960176    0.000229925    0.0285254       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000173495   0.00122828    0.00694132    0.000222691   0.00201744       10     
reco:pandoracalo:Calorimetry                          0.000146545   0.00219487    0.00833298     0.0016524    0.00237673       10     
reco:pandorapid:Chi2ParticleID                        3.4053e-05    0.000131607   0.000476061   5.31645e-05   0.000164302      10     
reco:linecluster:LineCluster                           0.571184      0.769713      0.989255      0.710451      0.156897        10     
reco:trajcluster:TrajCluster                            0.38762      0.452428      0.550748      0.446091      0.0450343       10     
reco:pmtracktc:PMAlgTrackMaker                          4.54669       5.20896       5.83777       5.21109      0.341387        10     
reco:emtrkmichelid:EmTrackMichelId                      126.505       158.044       263.557       142.822       37.9616        10     
reco:solarflash:SolarOpFlash                            0.87477       1.05679       1.31143       1.04987      0.134578        10     
[art]:TriggerResults:TriggerResultInserter            1.7503e-05    2.42051e-05   6.2026e-05    2.0308e-05    1.27515e-05      10     
end_path:out1:RootOutput                               3.376e-06     6.388e-06    2.5718e-05    3.9625e-06    6.4864e-06       10     
end_path:out1:RootOutput(write)                        0.196756      0.265261       0.37885      0.254837      0.048327        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4028.63 MB
  Peak resident set size usage (VmHWM): 2570.08 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T015627Z_gen_002747_supernova_g4stage1_g4stage2_detsim_reco_20250729T101204Z_reco2.root
Failed to extract md