Jobsub ID 20048.0@dunegpschedd01.fnal.gov

Jobsub ID	20048.0@dunegpschedd01.fnal.gov
Workflow ID	163
Stage ID	1
User name	higuera@fnal.gov
HTCondor Group	group_dune.prod.mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-08-01 02:57:31
Site	BR_CBPF
Entry	DUNE_BR_CBPF_ce02
Last heartbeat	2025-08-01 11:06:42
From worker node	Hostname	wn31
	cpuinfo	Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-08-01 02:58:35
Input files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco.root
Jobscript	Exit code	0
	Real time	8h (29034s)
	CPU time	7h (27323s = 94%)
	Max RSS bytes	2558967808 (2440 MiB)
Outputting started	2025-08-01 11:02:31
Output files	fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco_20250801T025845Z_reco2.root
Finished	2025-08-01 11:06:42
Saved logs	justin-logs:20048.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:04 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Aug-2025 07:57:05 -03 run: 4985 subRun: 0 event: 37030
Comparing two wires in the same plane: return failure
%MSG
01-Aug-2025 08:02:06 -03  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco_20250801T025845Z_reco2.root"
01-Aug-2025 08:02:07 -03  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/0d/a7/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2728.49       2784.04       2967.51       2773.21       67.7162        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00519132     0.0591969     0.172652      0.0129941     0.065557        10     
reco:pandora:StandardPandora                            2420.26       2480.7        2648.16       2476.47        63.54         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000425528   0.00959759     0.0460532    0.00442803     0.0145426       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000475418    0.0153078     0.134921     0.00252225     0.0398874       10     
reco:pandoracalo:Calorimetry                          0.000403012   0.00274459     0.0128661    0.000914739   0.00366009       10     
reco:pandorapid:Chi2ParticleID                        0.000121131   0.000365554   0.00157466    0.000214832   0.00042429       10     
reco:linecluster:LineCluster                            1.51122       1.60801       2.24623       1.52609      0.216454        10     
reco:trajcluster:TrajCluster                           0.614626      0.640931      0.771662      0.624651      0.0450285       10     
reco:pmtracktc:PMAlgTrackMaker                          11.2316       12.0653       13.3311       12.0794      0.555657        10     
reco:emtrkmichelid:EmTrackMichelId                      274.276       285.896       301.242       284.31        7.22506        10     
reco:solarflash:SolarOpFlash                            2.47988       2.58316       3.15122       2.52407       0.19104        10     
[art]:TriggerResults:TriggerResultInserter            5.2714e-05    6.70853e-05   0.000103845   5.99905e-05   1.7018e-05       10     
end_path:out1:RootOutput                              1.0301e-05    1.46269e-05   4.6654e-05    1.1202e-05    1.06836e-05      10     
end_path:out1:RootOutput(write)                        0.436065       0.45687      0.487609      0.451495      0.0177271       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4038.18 MB
  Peak resident set size usage (VmHWM): 2558.97 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco_20250801T025845Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco_20250801T025845Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco_20250801T025845Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T220939Z_gen_003703_supernova_g4stage1_g4stage2_detsim_reco_20250801T025845Z_reco2.root.json
reco2_hist.root