Jobsub ID 21366.24@dunegpschedd01.fnal.gov

Jobsub ID	21366.24@dunegpschedd01.fnal.gov
Workflow ID	545
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-08-06 16:02:39
Site	UK_QMUL
Entry	DUNE_UK_London_QMUL_arcce02
Last heartbeat	2025-08-07 01:19:41
From worker node	Hostname	cn512.htc.esc.qmul
	cpuinfo	Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-08-06 16:03:46
Input files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	9h (33196s)
	CPU time	9h (32652s = 98%)
	Max RSS bytes	2511245312 (2394 MiB)
Outputting started	2025-08-07 01:17:03
Output files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco_20250806T160352Z_reco2.root
Finished	2025-08-07 01:19:41
Saved logs	justin-logs:21366.24-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ring two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:17 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:17 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:17 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  07-Aug-2025 02:11:18 BST run: 81 subRun: 0 event: 54480
Comparing two wires in the same plane: return failure
%MSG
07-Aug-2025 02:16:56 BST  Closed output file "prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco_20250806T160352Z_reco2.root"
07-Aug-2025 02:16:56 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d9/44/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2812.18       3279.33       3861.06       3218.33       366.227        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00412644     0.0327217     0.123289      0.0140653     0.0419964       10     
reco:pandora:StandardPandora                            2422.58       2845.49       3343.29       2780.29       319.296        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000338768    0.0135639     0.119408     0.000537579    0.0354187       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00034498    0.00158142    0.00807349    0.000468383   0.00243246       10     
reco:pandoracalo:Calorimetry                          0.000296406    0.0056059     0.0114725    0.00575223    0.00443951       10     
reco:pandorapid:Chi2ParticleID                        6.4087e-05    0.000260023   0.00092279    9.6899e-05    0.00032787       10     
reco:linecluster:LineCluster                            1.00007       1.09593       1.45587       1.07901       0.12573        10     
reco:trajcluster:TrajCluster                           0.385089      0.540912      0.652412      0.572103      0.0888296       10     
reco:pmtracktc:PMAlgTrackMaker                          6.30084       9.53724       13.8532       8.83733       2.84028        10     
reco:emtrkmichelid:EmTrackMichelId                      332.688       420.612       506.074       428.65        55.1778        10     
reco:solarflash:SolarOpFlash                            1.21555       1.55786       1.88805       1.61469       0.20012        10     
[art]:TriggerResults:TriggerResultInserter            2.5055e-05    4.84857e-05   0.000132192   3.7246e-05    2.97092e-05      10     
end_path:out1:RootOutput                               6.379e-06    1.33339e-05   4.1475e-05    1.1159e-05    9.6342e-06       10     
end_path:out1:RootOutput(write)                        0.314474      0.440014      0.552159       0.43624      0.0624971       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3983.59 MB
  Peak resident set size usage (VmHWM): 2511.25 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco_20250806T160352Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco_20250806T160352Z_reco2.root
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco_20250806T160352Z_reco2.root.ext.json
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250727T101703Z_gen_005448_supernova_g4stage1_g4stage2_detsim_reco_20250806T160352Z_reco2.root.json
reco2_hist.root