Jobsub ID 19349.27@dunegpschedd01.fnal.gov

Jobsub ID	19349.27@dunegpschedd01.fnal.gov
Workflow ID	111
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-30 12:28:36
Site	UK_Sheffield
Entry	DUNE_UK_Sheffield_lcgce2
Last heartbeat	2025-07-30 17:01:51
From worker node	Hostname	wn015.hep
	cpuinfo	Intel(R) Core(TM) i7-5960X CPU @ 3.00GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-30 12:31:16
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (14482s)
	CPU time	3h (13464s = 92%)
	Max RSS bytes	2561568768 (2442 MiB)
Outputting started	2025-07-30 16:33:39
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco_20250730T123118Z_reco2.root
Finished	2025-07-30 17:01:51
Saved logs	justin-logs:19349.27-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  30-Jul-2025 17:30:03 BST run: 4871 subRun: 0 event: 5140
Comparing two wires in the same plane: return failure
%MSG
30-Jul-2025 17:32:35 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco_20250730T123118Z_reco2.root"
30-Jul-2025 17:32:35 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d7/82/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1338.16       1356.92       1385.35       1353.39       12.7928        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00201578     0.0432675     0.154431     0.00702367     0.0588147       10     
reco:pandora:StandardPandora                            1196.75       1208.71       1229.02       1206.79       9.91389        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000137302   0.00452417     0.0315475    0.000783786   0.00916785       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000154019   0.00143265    0.00616116    0.000436186   0.00191581       10     
reco:pandoracalo:Calorimetry                          0.000122731   0.00110604    0.00231968     0.0011453    0.000731037      10     
reco:pandorapid:Chi2ParticleID                        3.2551e-05    0.000174615    0.0006244    4.65635e-05   0.000209259      10     
reco:linecluster:LineCluster                            1.08768       1.20678       1.58415       1.10155       0.19015        10     
reco:trajcluster:TrajCluster                           0.231114      0.266483      0.333128      0.260437      0.0261137       10     
reco:pmtracktc:PMAlgTrackMaker                          3.69677       4.21139       4.88738       4.22174      0.308404        10     
reco:emtrkmichelid:EmTrackMichelId                      133.314       140.978       148.509       141.03        4.24793        10     
reco:solarflash:SolarOpFlash                            1.21751       1.3005        1.47475       1.22918      0.0991685       10     
[art]:TriggerResults:TriggerResultInserter            1.3129e-05    1.69639e-05   3.9459e-05    1.39565e-05   7.75667e-06      10     
end_path:out1:RootOutput                               2.35e-06      4.296e-06    1.3354e-05    2.7915e-06    3.44785e-06      10     
end_path:out1:RootOutput(write)                        0.175515      0.189712       0.21602      0.187543      0.0108969       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4039.63 MB
  Peak resident set size usage (VmHWM): 2561.57 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco_20250730T123118Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco_20250730T123118Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco_20250730T123118Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250124T130008Z_gen_000514_supernova_g4stage1_g4stage2_detsim_reco_20250730T123118Z_reco2.root.json
reco2_hist.root