Jobsub ID 21366.28@dunegpschedd01.fnal.gov

Jobsub ID	21366.28@dunegpschedd01.fnal.gov
Workflow ID	545
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-08-06 16:02:39
Site	UK_QMUL
Entry	DUNE_UK_London_QMUL_arcce03
Last heartbeat	2025-08-07 00:45:22
From worker node	Hostname	cn550.htc.esc.qmul
	cpuinfo	Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-08-06 16:03:19
Input files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	8h (31161s)
	CPU time	8h (30578s = 98%)
	Max RSS bytes	2486947840 (2371 MiB)
Outputting started	2025-08-07 00:42:41
Output files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco_20250806T160326Z_reco2.root
Finished	2025-08-07 00:45:22
Saved logs	justin-logs:21366.28-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ring two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:00 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 01:37:01 BST run: 68 subRun: 0 event: 31030
Comparing two wires in the same plane: return failure
%MSG
07-Aug-2025 01:42:35 BST  Closed output file "prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco_20250806T160326Z_reco2.root"
07-Aug-2025 01:42:35 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/13/a5/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2284.19       3073.06       3923.86       3046.36       388.347        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00402569     0.0315898     0.120867      0.0125961     0.041792        10     
reco:pandora:StandardPandora                            1983.26       2670.41       3429.34       2635.43       346.374        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000333876    0.0126417     0.122601     0.000420838    0.036653        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000317796   0.00080426    0.00425361    0.000442614    0.0011522       10     
reco:pandoracalo:Calorimetry                          0.000375202   0.00691938     0.0117639    0.00703845     0.0033931       10     
reco:pandorapid:Chi2ParticleID                        6.6424e-05    0.000199405   0.00101977    0.000116825   0.000275165      10     
reco:linecluster:LineCluster                           0.977417       1.1431        1.87135       1.0895        0.24872        10     
reco:trajcluster:TrajCluster                           0.346589      0.512024      0.690018       0.52014      0.125112        10     
reco:pmtracktc:PMAlgTrackMaker                          6.07587       9.27211       13.9308       8.24155       3.12983        10     
reco:emtrkmichelid:EmTrackMichelId                      291.377       389.821       481.008       389.487       55.4945        10     
reco:solarflash:SolarOpFlash                            1.16643       1.4784        2.00284       1.39399      0.285337        10     
[art]:TriggerResults:TriggerResultInserter            2.3751e-05    4.64291e-05   0.000159459   3.1262e-05    3.94548e-05      10     
end_path:out1:RootOutput                               4.765e-06    1.37128e-05   5.5768e-05    9.3745e-06    1.41557e-05      10     
end_path:out1:RootOutput(write)                        0.257911      0.375906      0.538485      0.337989      0.106561        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3959.35 MB
  Peak resident set size usage (VmHWM): 2486.95 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco_20250806T160326Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco_20250806T160326Z_reco2.root
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco_20250806T160326Z_reco2.root.ext.json
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250725T192758Z_gen_003103_supernova_g4stage1_g4stage2_detsim_reco_20250806T160326Z_reco2.root.json
reco2_hist.root