Jobsub ID 19468.56@dunegpschedd01.fnal.gov

Jobsub ID	19468.56@dunegpschedd01.fnal.gov
Workflow ID	111
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-30 17:08:35
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce01
Last heartbeat	2025-07-30 23:07:31
From worker node	Hostname	ccwcondor0757
	cpuinfo	AMD EPYC 7302 16-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-30 17:09:26
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	5h (21182s)
	CPU time	5h (20007s = 94%)
	Max RSS bytes	2560765952 (2442 MiB)
Outputting started	2025-07-30 23:02:29
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco_20250730T170931Z_reco2.root
Finished	2025-07-30 23:07:31
Saved logs	justin-logs:19468.56-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

res in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:01 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 00:59:02 CEST run: 4847 subRun: 0 event: 3050
Comparing two wires in the same plane: return failure
%MSG
31-Jul-2025 01:02:24 CEST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco_20250730T170931Z_reco2.root"
31-Jul-2025 01:02:24 CEST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/fb/d5/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1913.43       2051.57       2348.93       2018.97       115.732        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00341933     0.0291937      0.11718     0.00707793     0.0437144       10     
reco:pandora:StandardPandora                            1739.83       1862.31       2163.27       1827.46       115.475        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000337015   0.00800908     0.0569583    0.00304485     0.0163864       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000318289    0.0020924     0.0117051     0.0011507    0.00322379       10     
reco:pandoracalo:Calorimetry                          0.000251814   0.00116121    0.00464232    0.000471538   0.00148819       10     
reco:pandorapid:Chi2ParticleID                        6.6224e-05    0.000286632   0.00189074    0.000114456   0.000535013      10     
reco:linecluster:LineCluster                            1.05972       1.14275       1.61759       1.09452      0.159027        10     
reco:trajcluster:TrajCluster                           0.278591      0.345403      0.385427      0.354173      0.0312467       10     
reco:pmtracktc:PMAlgTrackMaker                          6.97593       7.76994       9.16786       7.68843      0.650692        10     
reco:emtrkmichelid:EmTrackMichelId                      162.714       178.276       197.714       176.468       9.11422        10     
reco:solarflash:SolarOpFlash                            1.22529       1.41233       1.67731       1.37948      0.111461        10     
[art]:TriggerResults:TriggerResultInserter            3.5106e-05    4.41791e-05   6.4721e-05    4.18645e-05   9.77772e-06      10     
end_path:out1:RootOutput                               5.791e-06    8.7795e-06    2.0849e-05    7.8295e-06    4.16813e-06      10     
end_path:out1:RootOutput(write)                        0.243413      0.274075      0.285717      0.278555      0.013165        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4040.19 MB
  Peak resident set size usage (VmHWM): 2560.77 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco_20250730T170931Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco_20250730T170931Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco_20250730T170931Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250123T234927Z_gen_000305_supernova_g4stage1_g4stage2_detsim_reco_20250730T170931Z_reco2.root.json
reco2_hist.root