Jobsub ID 280590.2@dunegpschedd01.fnal.gov

Jobsub ID	280590.2@dunegpschedd01.fnal.gov
Workflow ID	12031
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-18 06:51:25
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-18 07:46:14
From worker node	Hostname	dunegli-8200006-0-fnpc23025.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-18 07:42:47
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4272_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000300_lim000025_mergeLar_20241220T193806_20250610T121220Z_reco2.root
Jobscript	Exit code	0
	Real time	3m (195s)
	CPU time	1m (84s = 43%)
	Max RSS bytes	616095744 (587 MiB)
Outputting started	2026-01-18 07:46:03
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_nuecc_with_pds/ntuple/fnal/12031/1/001/triggerAna_12031_2026-01-18T_074255Z.ntuple.root
Finished	2026-01-18 07:46:14
Saved logs	justin-logs:280590.2-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: Generated 94 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 92 failed to backtrack. 1.08696%.
Begin processing the 2477th record. run: 4272 subRun: 0 event: 32977 at 18-Jan-2026 07:46:01 UTC
TriggerPrimitiveMakerPDS: found 190 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 206 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 201 failed to backtrack. 1.99005%.
Begin processing the 2478th record. run: 4272 subRun: 0 event: 32978 at 18-Jan-2026 07:46:01 UTC
TriggerPrimitiveMakerPDS: found 223 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 210 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 205 failed to backtrack. 2.43902%.
Begin processing the 2479th record. run: 4272 subRun: 0 event: 32979 at 18-Jan-2026 07:46:01 UTC
TriggerPrimitiveMakerPDS: found 243 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 272 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 8 / 267 failed to backtrack. 2.99625%.
Begin processing the 2480th record. run: 4272 subRun: 0 event: 32980 at 18-Jan-2026 07:46:01 UTC
TriggerPrimitiveMakerPDS: found 167 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 158 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 155 failed to backtrack. 1.29032%.
Begin processing the 2481st record. run: 4272 subRun: 0 event: 32981 at 18-Jan-2026 07:46:01 UTC
TriggerPrimitiveMakerPDS: found 108 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 102 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 98 failed to backtrack. 2.04082%.
Begin processing the 2482nd record. run: 4272 subRun: 0 event: 32982 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 145 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 107 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 105 failed to backtrack. 4.7619%.
Begin processing the 2483rd record. run: 4272 subRun: 0 event: 32983 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 6 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 3 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 3 failed to backtrack. 33.3333%.
Begin processing the 2484th record. run: 4272 subRun: 0 event: 32984 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 62 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 46 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 45 failed to backtrack. 2.22222%.
Begin processing the 2485th record. run: 4272 subRun: 0 event: 32985 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 127 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 117 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 112 failed to backtrack. 2.67857%.
Begin processing the 2486th record. run: 4272 subRun: 0 event: 32986 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 273 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 266 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 8 / 262 failed to backtrack. 3.05344%.
Begin processing the 2487th record. run: 4272 subRun: 0 event: 32987 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 174 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 194 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 191 failed to backtrack. 1.57068%.
Begin processing the 2488th record. run: 4272 subRun: 0 event: 32988 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 277 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 308 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 299 failed to backtrack. 1.33779%.
Begin processing the 2489th record. run: 4272 subRun: 0 event: 32989 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 247 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 256 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 255 failed to backtrack. 1.56863%.
Begin processing the 2490th record. run: 4272 subRun: 0 event: 32990 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 128 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 98 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 96 failed to backtrack. 4.16667%.
Begin processing the 2491st record. run: 4272 subRun: 0 event: 32991 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 155 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 133 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 130 failed to backtrack. 3.07692%.
Begin processing the 2492nd record. run: 4272 subRun: 0 event: 32992 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 206 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 218 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 213 failed to backtrack. 1.87793%.
Begin processing the 2493rd record. run: 4272 subRun: 0 event: 32993 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 194 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 170 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 167 failed to backtrack. 3.59281%.
Begin processing the 2494th record. run: 4272 subRun: 0 event: 32994 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 189 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 182 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 179 failed to backtrack. 1.11732%.
Begin processing the 2495th record. run: 4272 subRun: 0 event: 32995 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 148 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 129 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 126 failed to backtrack. 0%.
Begin processing the 2496th record. run: 4272 subRun: 0 event: 32996 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 217 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 227 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 225 failed to backtrack. 0.444444%.
Begin processing the 2497th record. run: 4272 subRun: 0 event: 32997 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 56 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 32 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 31 failed to backtrack. 6.45161%.
Begin processing the 2498th record. run: 4272 subRun: 0 event: 32998 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 83 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 54 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 53 failed to backtrack. 1.88679%.
Begin processing the 2499th record. run: 4272 subRun: 0 event: 32999 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 230 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 240 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 238 failed to backtrack. 1.2605%.
Begin processing the 2500th record. run: 4272 subRun: 0 event: 33000 at 18-Jan-2026 07:46:02 UTC
TriggerPrimitiveMakerPDS: found 75 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 45 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 45 failed to backtrack. 0%.
18-Jan-2026 07:46:03 UTC  Closed output file "tpg_12031_2026-01-18T_074255Z.root"
18-Jan-2026 07:46:03 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8b/6b/fardet-vd_mc_le_mc_2024a_list-4272_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000300_lim000025_mergeLar_20241220T193806_20250610T121220Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                       0.00309465     0.0272569      1.39528     0.00773572     0.0706669      2500    
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000196073   0.00134011     0.0441698    0.000538619   0.00352567      2500    
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS    0.000728706   0.00651757     0.105611     0.00238745     0.0110579      2500    
[art]:TriggerResults:TriggerResultInserter                        8.596e-06    1.76113e-05   0.000184911   1.65515e-05   5.77272e-06     2500    
end_path:out1:RootOutput                                          1.463e-06    4.24251e-06    2.077e-05     4.218e-06    1.04574e-06     2500    
end_path:triggerAna:TriggerAnaTree                               0.000907105   0.00673202     0.242512     0.00228697     0.0150126      2500    
end_path:out1:RootOutput(write)                                  0.000397285   0.00729213     0.168476     0.000773556    0.0196719      2500    
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1314.24 MB
  Peak resident set size usage (VmHWM): 622.49 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0