Jobsub ID 18710.12@dunegpschedd01.fnal.gov

Jobsub ID	18710.12@dunegpschedd01.fnal.gov
Workflow ID	100
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-28 21:39:07
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce03
Last heartbeat	2025-07-29 03:08:03
From worker node	Hostname	ccwcondor0694
	cpuinfo	AMD EPYC 7302 16-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	aborted
Started	2025-07-28 21:40:21
Input files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco.root
Outputting started	2025-07-29 02:55:03
Output files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco_20250728T214026Z_reco2.root
Finished	2025-07-29 03:08:03
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:13 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 04:52:14 CEST run: 5181 subRun: 0 event: 33510
Comparing two wires in the same plane: return failure
%MSG
29-Jul-2025 04:54:58 CEST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco_20250728T214026Z_reco2.root"
29-Jul-2025 04:54:58 CEST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/ad/7f/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1803.57       1860.98       1909.55       1856.86       30.3891        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00283177     0.0190019     0.0755247     0.0073277     0.0251152       10     
reco:pandora:StandardPandora                            1647.5        1690.11        1741         1689.86       26.7082        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000310143   0.00831835     0.0598546    0.00312338     0.0172928       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000305424   0.00258539    0.00678058    0.00135985    0.00242496       10     
reco:pandoracalo:Calorimetry                          0.000189206   0.00114341    0.00410352    0.00043473    0.00124915       10     
reco:pandorapid:Chi2ParticleID                        4.9323e-05    0.00020323    0.000554404   0.000117756   0.000160183      10     
reco:linecluster:LineCluster                           0.384102       0.45381      0.725836       0.43005      0.093913        10     
reco:trajcluster:TrajCluster                           0.259644      0.335139      0.438816      0.342963      0.049153        10     
reco:pmtracktc:PMAlgTrackMaker                          5.10407       6.70229       8.9219        6.68345       1.14101        10     
reco:emtrkmichelid:EmTrackMichelId                      145.652       162.33        190.64        160.424       12.4507        10     
reco:solarflash:SolarOpFlash                           0.680097      0.756701      0.835958      0.745627      0.046291        10     
[art]:TriggerResults:TriggerResultInserter            2.9255e-05    4.06678e-05   8.0321e-05    3.4736e-05    1.43429e-05      10     
end_path:out1:RootOutput                               4.98e-06     8.1721e-06    2.2211e-05    6.7525e-06    4.7626e-06       10     
end_path:out1:RootOutput(write)                         0.20108      0.260041      0.345341      0.261816      0.0376091       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4039.76 MB
  Peak resident set size usage (VmHWM): 2558.62 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco_20250728T214026Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco_20250728T214026Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco_20250728T214026Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T185646Z_gen_003351_supernova_g4stage1_g4stage2_detsim_reco_20250728T214026Z_reco2.root.json
reco2_hist.root