Jobsub ID 19952.142@dunegpschedd01.fnal.gov

Jobsub ID	19952.142@dunegpschedd01.fnal.gov
Workflow ID	163
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-31 21:11:15
Site	UK_Brunel
Entry	CMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat	2025-08-01 02:38:51
From worker node	Hostname	wn-b8-26-01.brunel.ac.uk
	cpuinfo	Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-31 21:13:28
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	5h (19363s)
	CPU time	4h (17340s = 89%)
	Max RSS bytes	2570113024 (2451 MiB)
Outputting started	2025-08-01 02:36:12
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco_20250731T211332Z_reco2.root
Finished	2025-08-01 02:38:51
Saved logs	justin-logs:19952.142-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 03:32:57 BST run: 4992 subRun: 0 event: 12900
Comparing two wires in the same plane: return failure
%MSG
01-Aug-2025 03:36:07 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco_20250731T211332Z_reco2.root"
01-Aug-2025 03:36:07 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/2d/d7/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1664.12       1753.45       1869.94       1759.5        55.5804        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00290937     0.0327773     0.155167     0.00883394     0.0508689       10     
reco:pandora:StandardPandora                            1484.73       1551.53       1640.16       1548.87       45.4303        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000233147   0.00642374     0.0474172    0.00206485     0.0137492       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000230145   0.00214618     0.0137345    0.00102311    0.00388532       10     
reco:pandoracalo:Calorimetry                          0.000185105   0.00141984    0.00497688    0.000393741   0.00168192       10     
reco:pandorapid:Chi2ParticleID                        5.5289e-05    0.000252304   0.00169754    9.48215e-05   0.00048222       10     
reco:linecluster:LineCluster                            1.18555       1.58481       2.09389       1.63327      0.248121        10     
reco:trajcluster:TrajCluster                           0.318904      0.443552      0.562637       0.44202      0.0973384       10     
reco:pmtracktc:PMAlgTrackMaker                          5.12314       6.62976       8.03982       6.41556       0.91875        10     
reco:emtrkmichelid:EmTrackMichelId                      169.074       191.046       216.94        189.938       12.8032        10     
reco:solarflash:SolarOpFlash                            1.37413       1.83594       2.39483       1.81053      0.335489        10     
[art]:TriggerResults:TriggerResultInserter            2.6784e-05    5.10562e-05   0.000130729   3.6782e-05    3.12278e-05      10     
end_path:out1:RootOutput                               5.637e-06    1.1932e-05    5.0966e-05     7.175e-06    1.31999e-05      10     
end_path:out1:RootOutput(write)                        0.244771      0.329669      0.457229      0.289256      0.0820993       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4037.33 MB
  Peak resident set size usage (VmHWM): 2570.11 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco_20250731T211332Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco_20250731T211332Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco_20250731T211332Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T135329Z_gen_001290_supernova_g4stage1_g4stage2_detsim_reco_20250731T211332Z_reco2.root.json
reco2_hist.root