Jobsub ID 13129.79@dunegpschedd02.fnal.gov

Jobsub ID	13129.79@dunegpschedd02.fnal.gov
Workflow ID	163
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-30 23:21:09
Site	UK_Sheffield
Entry	DUNE_UK_Sheffield_lcgce2
Last heartbeat	2025-07-31 07:02:35
From worker node	Hostname	wn015.hep
	cpuinfo	Intel(R) Core(TM) i7-5960X CPU @ 3.00GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-30 23:23:17
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (17595s)
	CPU time	4h (16293s = 92%)
	Max RSS bytes	2578280448 (2458 MiB)
Outputting started	2025-07-31 04:17:33
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco_20250730T232320Z_reco2.root
Finished	2025-07-31 07:02:35
Saved logs	justin-logs:13129.79-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 05:13:36 BST run: 4962 subRun: 0 event: 32700
Comparing two wires in the same plane: return failure
%MSG
31-Jul-2025 05:16:27 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco_20250730T232320Z_reco2.root"
31-Jul-2025 05:16:27 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/39/84/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1419.06       1677.12       2348.51       1498.9        342.009        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00276309     0.0300351     0.128309     0.00806878     0.0467267       10     
reco:pandora:StandardPandora                            1260.59       1465.07       1950.72       1336.7        255.87         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000149456    0.0065186     0.0507993    0.000568416    0.0148605       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000154585   0.00215568     0.0118199    0.000959644   0.00340868       10     
reco:pandoracalo:Calorimetry                          0.000133089   0.00132809    0.00365709    0.000372108   0.00134296       10     
reco:pandorapid:Chi2ParticleID                        3.4111e-05    0.000193195   0.00140476    6.9928e-05    0.000404179      10     
reco:linecluster:LineCluster                           0.959478       33.0226       165.516      0.985848       64.0913        10     
reco:trajcluster:TrajCluster                           0.257855      0.310381      0.434493      0.290137      0.0566978       10     
reco:pmtracktc:PMAlgTrackMaker                          4.06437       5.13774       8.00216       4.8037        1.0926         10     
reco:emtrkmichelid:EmTrackMichelId                      145.305       172.027       229.909       161.744       27.8232        10     
reco:solarflash:SolarOpFlash                            1.13173       1.29569       2.10068       1.15806       0.29188        10     
[art]:TriggerResults:TriggerResultInserter            1.3299e-05    2.0569e-05    6.0674e-05    1.5267e-05    1.36395e-05      10     
end_path:out1:RootOutput                               2.316e-06    4.6751e-06    2.0643e-05     2.903e-06    5.33224e-06      10     
end_path:out1:RootOutput(write)                        0.184624      0.221146      0.366013      0.192429      0.0608643       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4041.58 MB
  Peak resident set size usage (VmHWM): 2578.28 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco_20250730T232320Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco_20250730T232320Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco_20250730T232320Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T160333Z_gen_003270_supernova_g4stage1_g4stage2_detsim_reco_20250730T232320Z_reco2.root.json
reco2_hist.root