Jobsub ID 18710.14@dunegpschedd01.fnal.gov

Jobsub ID	18710.14@dunegpschedd01.fnal.gov
Workflow ID	100
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-28 21:39:07
Site	UK_Brunel
Entry	CMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat	2025-07-29 05:28:59
From worker node	Hostname	wn-b7-04-01.brunel.ac.uk
	cpuinfo	Intel(R) Xeon(R) CPU E5645 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-28 21:39:35
Input files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	7h (27940s)
	CPU time	7h (27184s = 97%)
	Max RSS bytes	2571104256 (2451 MiB)
Outputting started	2025-07-29 05:25:17
Output files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco_20250728T213940Z_reco2.root
Finished	2025-07-29 05:28:59
Saved logs	justin-logs:18710.14-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:36 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  29-Jul-2025 06:20:37 BST run: 5185 subRun: 0 event: 38200
Comparing two wires in the same plane: return failure
%MSG
29-Jul-2025 06:25:11 BST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco_20250728T213940Z_reco2.root"
29-Jul-2025 06:25:11 BST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/99/e2/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2395.45       2753.63       3034.15       2762.63       217.815        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00273725     0.0206549     0.0608675    0.00793804     0.0215645       10     
reco:pandora:StandardPandora                            2079.48       2452.51       2728.43       2464.77       212.712        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000276517   0.00571656     0.0404916    0.00100347     0.0118322       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000311503   0.00313959     0.0106495    0.00180601    0.00298321       10     
reco:pandoracalo:Calorimetry                          0.000267945   0.00144829    0.00394139    0.000583857   0.00137813       10     
reco:pandorapid:Chi2ParticleID                        7.0977e-05    0.000236725   0.000824103   0.000136355   0.000259455      10     
reco:linecluster:LineCluster                           0.450591      0.911036       3.58007      0.601981      0.904294        10     
reco:trajcluster:TrajCluster                           0.390174      0.430066      0.495345      0.431904      0.0329905       10     
reco:pmtracktc:PMAlgTrackMaker                          7.12998       8.89283       10.2772       8.89547      0.915852        10     
reco:emtrkmichelid:EmTrackMichelId                      266.364       289.138       303.294       291.523       12.8664        10     
reco:solarflash:SolarOpFlash                           0.905597       1.38379       5.02665      0.953419       1.21687        10     
[art]:TriggerResults:TriggerResultInserter            3.0073e-05    0.000119974   0.00083938    3.7103e-05    0.000240038      10     
end_path:out1:RootOutput                               7.435e-06    1.29723e-05   2.9542e-05    8.4105e-06    8.40928e-06      10     
end_path:out1:RootOutput(write)                        0.313032      0.332722      0.367574      0.325119      0.017727        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4039.61 MB
  Peak resident set size usage (VmHWM): 2571.1 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco_20250728T213940Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco_20250728T213940Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco_20250728T213940Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T031246Z_gen_003820_supernova_g4stage1_g4stage2_detsim_reco_20250728T213940Z_reco2.root.json
reco2_hist.root