Jobsub ID 19550.4@dunegpschedd01.fnal.gov

Jobsub ID	19550.4@dunegpschedd01.fnal.gov
Workflow ID	163
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-07-30 20:53:01
Site	FR_CCIN2P3
Entry	DUNE_FR_CCIN2P3_cccondorce03
Last heartbeat	2025-07-31 00:25:12
From worker node	Hostname	ccwcondor0041
	cpuinfo	AMD EPYC 9334 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	106200 (29 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-07-30 20:54:03
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	3h (12503s)
	CPU time	3h (12030s = 96%)
	Max RSS bytes	2529923072 (2412 MiB)
Outputting started	2025-07-31 00:22:28
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco_20250730T205409Z_reco2.root
Finished	2025-07-31 00:25:12
Saved logs	justin-logs:19550.4-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

res in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:09 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  31-Jul-2025 02:20:10 CEST run: 4961 subRun: 0 event: 8060
Comparing two wires in the same plane: return failure
%MSG
31-Jul-2025 02:22:23 CEST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco_20250730T205409Z_reco2.root"
31-Jul-2025 02:22:23 CEST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/7d/c8/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1030.5        1218.19       1342.52       1253.78       101.049        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00368185     0.0333961     0.135495      0.0092127     0.0495647       10     
reco:pandora:StandardPandora                            915.181       1085.17       1202.32       1117.2        92.5641        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000277071   0.00887455     0.0525505    0.00376033     0.0146792       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000274217   0.00200511     0.0104403    0.00113361    0.00283121       10     
reco:pandoracalo:Calorimetry                          0.000272033   0.000897408    0.0030436    0.000460429   0.000996916      10     
reco:pandorapid:Chi2ParticleID                        5.4573e-05    0.000208805   0.00110705    0.000117814   0.000300775      10     
reco:linecluster:LineCluster                             1.015        1.13668       1.57877       1.06561      0.161578        10     
reco:trajcluster:TrajCluster                           0.265746      0.304775      0.330011      0.306683      0.0220235       10     
reco:pmtracktc:PMAlgTrackMaker                          6.0013        7.19508       9.34511       6.76182       1.03091        10     
reco:emtrkmichelid:EmTrackMichelId                      104.126       122.758       134.113       126.303       10.9142        10     
reco:solarflash:SolarOpFlash                            1.21822       1.34343       1.72458       1.26745      0.170929        10     
[art]:TriggerResults:TriggerResultInserter            3.3471e-05    4.66359e-05   0.000106322   4.11225e-05   2.01629e-05      10     
end_path:out1:RootOutput                               7.351e-06    1.11669e-05   3.2269e-05    8.9085e-06    7.07841e-06      10     
end_path:out1:RootOutput(write)                        0.207831      0.239184      0.263288      0.239029      0.0147461       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4050.47 MB
  Peak resident set size usage (VmHWM): 2529.92 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco_20250730T205409Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco_20250730T205409Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco_20250730T205409Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T022808Z_gen_000806_supernova_g4stage1_g4stage2_detsim_reco_20250730T205409Z_reco2.root.json
reco2_hist.root