Jobsub ID 19954.127@dunegpschedd01.fnal.gov

Jobsub ID	19954.127@dunegpschedd01.fnal.gov
Workflow ID	166
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-31 21:11:18
Site	UK_RAL-PPD
Entry	CMSHTPC_T2_UK_SGrid_RALPP_hep207
Last heartbeat	2025-08-01 04:21:36
From worker node	Hostname	heplnc134.pp.rl.ac.uk
	cpuinfo	Intel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-31 21:13:05
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	7h (25554s)
	CPU time	6h (24460s = 95%)
	Max RSS bytes	2561679360 (2443 MiB)
Outputting started	2025-08-01 04:19:00
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco_20250731T211322Z_reco2.root
Finished	2025-08-01 04:21:36
Saved logs	justin-logs:19954.127-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:08 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 05:14:09 BST run: 4991 subRun: 0 event: 1440
Comparing two wires in the same plane: return failure
%MSG
01-Aug-2025 05:18:55 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco_20250731T211322Z_reco2.root"
01-Aug-2025 05:18:55 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/cc/1f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2365.6        2481.4        2634.89       2485.55       73.2429        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00380689     0.0296431      0.1346      0.00906285     0.0444248       10     
reco:pandora:StandardPandora                            2073.33       2171.96       2321.32       2164.22       64.7747        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000295587   0.00726468     0.0572392    0.000325468    0.0168282       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000341576   0.00197147    0.00877658    0.000415246   0.00260155       10     
reco:pandoracalo:Calorimetry                          0.000506213   0.00360787    0.00634256    0.00461079    0.00211531       10     
reco:pandorapid:Chi2ParticleID                        6.5189e-05    0.000214889   0.00121727    0.000111221   0.000335276      10     
reco:linecluster:LineCluster                            1.00536       1.18661       2.29221       1.04771      0.372139        10     
reco:trajcluster:TrajCluster                           0.452538      0.491105      0.538199      0.490548      0.0305256       10     
reco:pmtracktc:PMAlgTrackMaker                          6.54818       8.99701       12.1738       8.63901       1.69011        10     
reco:emtrkmichelid:EmTrackMichelId                      275.925       296.803       322.642       296.481       14.4429        10     
reco:solarflash:SolarOpFlash                            1.22457       1.53478       1.94782       1.50724      0.197184        10     
[art]:TriggerResults:TriggerResultInserter            2.4932e-05    3.79571e-05   6.3343e-05    3.40175e-05   1.23777e-05      10     
end_path:out1:RootOutput                               5.735e-06    8.3702e-06    1.9543e-05     7.205e-06    3.84803e-06      10     
end_path:out1:RootOutput(write)                        0.253516      0.381074      0.445362      0.395141      0.0555836       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4044.44 MB
  Peak resident set size usage (VmHWM): 2561.68 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco_20250731T211322Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco_20250731T211322Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco_20250731T211322Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T022102Z_gen_000144_supernova_g4stage1_g4stage2_detsim_reco_20250731T211322Z_reco2.root.json
reco2_hist.root