Jobsub ID 11631.1@dunegpschedd02.fnal.gov

Jobsub ID	11631.1@dunegpschedd02.fnal.gov
Workflow ID	69
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-27 05:46:25
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_dissel
Last heartbeat	2025-07-27 10:42:28
From worker node	Hostname	wn-choc-033.farm.nikhef.nl
	cpuinfo	Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-27 05:47:03
Input files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	4h (17562s)
	CPU time	4h (17270s = 98%)
	Max RSS bytes	2570461184 (2451 MiB)
Outputting started	2025-07-27 10:39:46
Output files	fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco_20250727T054707Z_reco2.root
Finished	2025-07-27 10:42:28
Saved logs	justin-logs:11631.1-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:40 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:40 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  27-Jul-2025 12:36:41 CEST run: 5179 subRun: 0 event: 29890
Comparing two wires in the same plane: return failure
%MSG
27-Jul-2025 12:39:42 CEST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco_20250727T054707Z_reco2.root"
27-Jul-2025 12:39:42 CEST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/9c/31/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1717.14       1735.13       1764.16       1733.72       13.3071        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00288817     0.0361962     0.225454     0.00771865     0.0674374       10     
reco:pandora:StandardPandora                            1532.72       1550.81       1582.16       1551.34       14.3525        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000221642   0.00491229     0.0388854    0.000304165    0.0114072       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000244154   0.00148931    0.00870062    0.000285408   0.00250751       10     
reco:pandoracalo:Calorimetry                          0.00017863    0.00166123    0.00344352    0.00175601    0.00127498       10     
reco:pandorapid:Chi2ParticleID                        6.0083e-05    0.000184591   0.000669218   7.0156e-05    0.000223942      10     
reco:linecluster:LineCluster                            0.54573      0.628482      0.736084      0.626829      0.0571885       10     
reco:trajcluster:TrajCluster                           0.324935      0.346341      0.368664       0.34573      0.0133191       10     
reco:pmtracktc:PMAlgTrackMaker                          5.18864       5.53426       5.92237       5.60002       0.24018        10     
reco:emtrkmichelid:EmTrackMichelId                      172.113       176.647       182.053       176.354       2.62789        10     
reco:solarflash:SolarOpFlash                            0.81086      0.859079      0.953765      0.842145      0.0479118       10     
[art]:TriggerResults:TriggerResultInserter            1.7154e-05    2.96319e-05   5.3479e-05    2.92705e-05   9.09353e-06      10     
end_path:out1:RootOutput                               5.422e-06    7.3427e-06    2.2403e-05     5.694e-06    5.02185e-06      10     
end_path:out1:RootOutput(write)                        0.244987      0.253918      0.261988      0.253329     0.00530199       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4034.38 MB
  Peak resident set size usage (VmHWM): 2570.46 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco_20250727T054707Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco_20250727T054707Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco_20250727T054707Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250215T042049Z_gen_002989_supernova_g4stage1_g4stage2_detsim_reco_20250727T054707Z_reco2.root.json
reco2_hist.root