Jobsub ID 268653.0@dunegpschedd02.fnal.gov

Jobsub ID	268653.0@dunegpschedd02.fnal.gov
Workflow ID	11715
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-11 09:10:36
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-11 09:12:40
From worker node	Hostname	dunegli-8298660-0-fnpc22002.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-11 09:10:47
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000425_lim000025_mergeLar_20241220T183526_20250610T120557Z_reco2.root
Jobscript	Exit code	0
	Real time	1m (104s)
	CPU time	1m (62s = 59%)
	Max RSS bytes	619085824 (590 MiB)
Outputting started	2026-01-11 09:12:31
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_nuecc_with_pds/ntuple/fnal/11715/1/001/triggerAna_11715_2026-01-11T_091055Z.ntuple.root
Finished	2026-01-11 09:12:40
Saved logs	justin-logs:268653.0-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

objects.
TriggerPrimitiveMakerPDS: Generated 149 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 149 failed to backtrack. 3.3557%.
Begin processing the 2477th record. run: 4246 subRun: 0 event: 44977 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 100 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 84 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 81 failed to backtrack. 3.7037%.
Begin processing the 2478th record. run: 4246 subRun: 0 event: 44978 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 168 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 131 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 129 failed to backtrack. 0%.
Begin processing the 2479th record. run: 4246 subRun: 0 event: 44979 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 196 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 196 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 193 failed to backtrack. 1.5544%.
Begin processing the 2480th record. run: 4246 subRun: 0 event: 44980 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 139 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 132 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 129 failed to backtrack. 0.775194%.
Begin processing the 2481st record. run: 4246 subRun: 0 event: 44981 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 9 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 5 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 4 failed to backtrack. 0%.
Begin processing the 2482nd record. run: 4246 subRun: 0 event: 44982 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 178 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 168 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 164 failed to backtrack. 1.21951%.
Begin processing the 2483rd record. run: 4246 subRun: 0 event: 44983 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 215 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 209 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 207 failed to backtrack. 1.93237%.
Begin processing the 2484th record. run: 4246 subRun: 0 event: 44984 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 84 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 44 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 43 failed to backtrack. 6.97674%.
Begin processing the 2485th record. run: 4246 subRun: 0 event: 44985 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 209 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 220 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 219 failed to backtrack. 1.36986%.
Begin processing the 2486th record. run: 4246 subRun: 0 event: 44986 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 144 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 132 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 129 failed to backtrack. 4.65116%.
Begin processing the 2487th record. run: 4246 subRun: 0 event: 44987 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 35 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 23 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 23 failed to backtrack. 4.34783%.
Begin processing the 2488th record. run: 4246 subRun: 0 event: 44988 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 162 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 163 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 163 failed to backtrack. 0%.
Begin processing the 2489th record. run: 4246 subRun: 0 event: 44989 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 114 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 73 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 72 failed to backtrack. 2.77778%.
Begin processing the 2490th record. run: 4246 subRun: 0 event: 44990 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 38 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 19 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 18 failed to backtrack. 5.55556%.
Begin processing the 2491st record. run: 4246 subRun: 0 event: 44991 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 99 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 85 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 84 failed to backtrack. 3.57143%.
Begin processing the 2492nd record. run: 4246 subRun: 0 event: 44992 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 147 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 133 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 131 failed to backtrack. 1.52672%.
Begin processing the 2493rd record. run: 4246 subRun: 0 event: 44993 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 221 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 202 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 202 failed to backtrack. 2.9703%.
Begin processing the 2494th record. run: 4246 subRun: 0 event: 44994 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 133 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 109 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 107 failed to backtrack. 3.73832%.
Begin processing the 2495th record. run: 4246 subRun: 0 event: 44995 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 100 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 66 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 64 failed to backtrack. 1.5625%.
Begin processing the 2496th record. run: 4246 subRun: 0 event: 44996 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 132 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 100 failed to backtrack. 7%.
Begin processing the 2497th record. run: 4246 subRun: 0 event: 44997 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 101 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 81 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 79 failed to backtrack. 3.79747%.
Begin processing the 2498th record. run: 4246 subRun: 0 event: 44998 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 126 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 96 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 95 failed to backtrack. 3.15789%.
Begin processing the 2499th record. run: 4246 subRun: 0 event: 44999 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 96 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 92 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 91 failed to backtrack. 0%.
Begin processing the 2500th record. run: 4246 subRun: 0 event: 45000 at 11-Jan-2026 09:12:29 UTC
TriggerPrimitiveMakerPDS: found 31 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 17 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 16 failed to backtrack. 6.25%.
11-Jan-2026 09:12:29 UTC  Closed output file "tpg_11715_2026-01-11T_091055Z.root"
11-Jan-2026 09:12:29 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/1b/8e/fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000425_lim000025_mergeLar_20241220T183526_20250610T120557Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                       0.00244758    0.00741727     0.626306     0.00448758     0.0228555      2500    
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000123996   0.000398657    0.0458152    0.000397746   0.00095965      2500    
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS    0.000783729   0.00258277     0.0986443    0.00174692     0.005408       2500    
[art]:TriggerResults:TriggerResultInserter                        5.931e-06    8.09551e-06   0.00016288     7.254e-06    4.24647e-06     2500    
end_path:out1:RootOutput                                          9.11e-07     1.75877e-06    4.707e-05     1.473e-06     1.299e-06      2500    
end_path:triggerAna:TriggerAnaTree                               0.000796624   0.00222399     0.0665358    0.00157762    0.00358097      2500    
end_path:out1:RootOutput(write)                                  0.000245006   0.000777162    0.106827     0.000435653   0.00408608      2500    
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1314.24 MB
  Peak resident set size usage (VmHWM): 622.481 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0