Jobsub ID 21366.8@dunegpschedd01.fnal.gov

Jobsub ID	21366.8@dunegpschedd01.fnal.gov
Workflow ID	545
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-08-06 16:02:39
Site	UK_RAL-Tier1
Entry	LIGO_UK_RAL_arc_ce03
Last heartbeat	2025-08-06 20:23:55
From worker node	Hostname	dune001-7936819.0-lcg2708.gridpp.rl.ac.uk
	cpuinfo	AMD EPYC 9654 96-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	216000 (60 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-08-06 16:03:30
Input files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (15508s)
	CPU time	4h (14929s = 96%)
	Max RSS bytes	2365272064 (2255 MiB)
Outputting started	2025-08-06 20:21:59
Output files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco_20250806T160335Z_reco2.root
Finished	2025-08-06 20:23:55
Saved logs	justin-logs:21366.8-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ring two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  06-Aug-2025 20:19:14 UTC run: 81 subRun: 0 event: 46430
Comparing two wires in the same plane: return failure
%MSG
06-Aug-2025 20:21:54 UTC  Closed output file "prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco_20250806T160335Z_reco2.root"
06-Aug-2025 20:21:54 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/fd/18/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1339.1        1516.77       1717.14       1512.55       124.115        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00483522     0.0344278     0.126819      0.0126837     0.0461497       10     
reco:pandora:StandardPandora                            1181.33       1346.47       1550.25       1333.53       123.293        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000273221   0.00993038     0.0953426    0.000448815    0.0284709       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000257738   0.000682055   0.00339688    0.000379707   0.000907057      10     
reco:pandoracalo:Calorimetry                          0.000329295   0.00726339     0.0218733    0.00794745    0.00627269       10     
reco:pandorapid:Chi2ParticleID                        4.7852e-05    0.000158408   0.00065115    8.9124e-05    0.000172326      10     
reco:linecluster:LineCluster                            1.06866       1.19251       1.57728       1.14088      0.150537        10     
reco:trajcluster:TrajCluster                           0.264194      0.375308      0.499117       0.36877      0.0618837       10     
reco:pmtracktc:PMAlgTrackMaker                          4.96744       7.66631       9.27203       7.68115       1.11128        10     
reco:emtrkmichelid:EmTrackMichelId                      146.358       159.426       178.271       158.195       9.70968        10     
reco:solarflash:SolarOpFlash                            1.15783       1.33984       1.58417       1.34278       0.1168         10     
[art]:TriggerResults:TriggerResultInserter            3.7867e-05    5.3892e-05    8.9044e-05    4.8828e-05    1.63024e-05      10     
end_path:out1:RootOutput                               9.785e-06    1.72168e-05    5.32e-05     1.3345e-05    1.22024e-05      10     
end_path:out1:RootOutput(write)                        0.181198      0.242174       0.26519      0.250549      0.0241092       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3983.61 MB
  Peak resident set size usage (VmHWM): 2365.27 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco_20250806T160335Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco_20250806T160335Z_reco2.root
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco_20250806T160335Z_reco2.root.ext.json
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T093324Z_gen_004643_supernova_g4stage1_g4stage2_detsim_reco_20250806T160335Z_reco2.root.json
reco2_hist.root