Jobsub ID 274737.0@dunegpschedd02.fnal.gov

Jobsub ID	274737.0@dunegpschedd02.fnal.gov
Workflow ID	12031
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-18 06:49:24
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-18 07:41:45
From worker node	Hostname	dunegli-8356520-0-fnpc17001.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-18 07:13:29
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4272_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T193925_20250610T123002Z_reco2.root
Jobscript	Exit code	0
	Real time	28m (1688s)
	CPU time	1m (91s = 5%)
	Max RSS bytes	616259584 (587 MiB)
Outputting started	2026-01-18 07:41:38
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_nuecc_with_pds/ntuple/fnal/12031/1/001/triggerAna_12031_2026-01-18T_071336Z.ntuple.root
Finished	2026-01-18 07:41:45
Saved logs	justin-logs:274737.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rimitiveMakerPDS: Generated 177 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 171 failed to backtrack. 1.75439%.
Begin processing the 2477th record. run: 4272 subRun: 0 event: 37977 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 53 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 44 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 43 failed to backtrack. 4.65116%.
Begin processing the 2478th record. run: 4272 subRun: 0 event: 37978 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 181 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 175 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 169 failed to backtrack. 3.5503%.
Begin processing the 2479th record. run: 4272 subRun: 0 event: 37979 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 27 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 17 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 17 failed to backtrack. 11.7647%.
Begin processing the 2480th record. run: 4272 subRun: 0 event: 37980 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 71 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 48 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 44 failed to backtrack. 2.27273%.
Begin processing the 2481st record. run: 4272 subRun: 0 event: 37981 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 36 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 15 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 15 failed to backtrack. 6.66667%.
Begin processing the 2482nd record. run: 4272 subRun: 0 event: 37982 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 136 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 120 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 116 failed to backtrack. 3.44828%.
Begin processing the 2483rd record. run: 4272 subRun: 0 event: 37983 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 213 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 194 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 192 failed to backtrack. 1.5625%.
Begin processing the 2484th record. run: 4272 subRun: 0 event: 37984 at 18-Jan-2026 07:40:52 UTC
TriggerPrimitiveMakerPDS: found 254 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 290 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 281 failed to backtrack. 1.06762%.
Begin processing the 2485th record. run: 4272 subRun: 0 event: 37985 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 61 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 32 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 32 failed to backtrack. 12.5%.
Begin processing the 2486th record. run: 4272 subRun: 0 event: 37986 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 219 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 229 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 220 failed to backtrack. 0%.
Begin processing the 2487th record. run: 4272 subRun: 0 event: 37987 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 298 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 262 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 255 failed to backtrack. 2.7451%.
Begin processing the 2488th record. run: 4272 subRun: 0 event: 37988 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 56 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 42 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 41 failed to backtrack. 4.87805%.
Begin processing the 2489th record. run: 4272 subRun: 0 event: 37989 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 85 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 60 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 58 failed to backtrack. 1.72414%.
Begin processing the 2490th record. run: 4272 subRun: 0 event: 37990 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 176 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 150 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 147 failed to backtrack. 3.40136%.
Begin processing the 2491st record. run: 4272 subRun: 0 event: 37991 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 192 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 199 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 198 failed to backtrack. 3.0303%.
Begin processing the 2492nd record. run: 4272 subRun: 0 event: 37992 at 18-Jan-2026 07:40:53 UTC
TriggerPrimitiveMakerPDS: found 186 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 194 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 190 failed to backtrack. 1.05263%.
Begin processing the 2493rd record. run: 4272 subRun: 0 event: 37993 at 18-Jan-2026 07:40:54 UTC
TriggerPrimitiveMakerPDS: found 265 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 301 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 294 failed to backtrack. 1.70068%.
Begin processing the 2494th record. run: 4272 subRun: 0 event: 37994 at 18-Jan-2026 07:40:54 UTC
TriggerPrimitiveMakerPDS: found 184 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 167 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 156 failed to backtrack. 2.5641%.
Begin processing the 2495th record. run: 4272 subRun: 0 event: 37995 at 18-Jan-2026 07:40:54 UTC
TriggerPrimitiveMakerPDS: found 212 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 160 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 155 failed to backtrack. 1.93548%.
Begin processing the 2496th record. run: 4272 subRun: 0 event: 37996 at 18-Jan-2026 07:40:54 UTC
TriggerPrimitiveMakerPDS: found 114 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 118 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 116 failed to backtrack. 3.44828%.
Begin processing the 2497th record. run: 4272 subRun: 0 event: 37997 at 18-Jan-2026 07:40:55 UTC
TriggerPrimitiveMakerPDS: found 191 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 208 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 200 failed to backtrack. 0%.
Begin processing the 2498th record. run: 4272 subRun: 0 event: 37998 at 18-Jan-2026 07:40:55 UTC
TriggerPrimitiveMakerPDS: found 13 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 8 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 8 failed to backtrack. 12.5%.
Begin processing the 2499th record. run: 4272 subRun: 0 event: 37999 at 18-Jan-2026 07:40:55 UTC
TriggerPrimitiveMakerPDS: found 151 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 151 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 149 failed to backtrack. 1.34228%.
Begin processing the 2500th record. run: 4272 subRun: 0 event: 38000 at 18-Jan-2026 07:40:55 UTC
TriggerPrimitiveMakerPDS: found 60 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 37 failed to backtrack. 2.7027%.
18-Jan-2026 07:40:59 UTC  Closed output file "tpg_12031_2026-01-18T_071336Z.root"
18-Jan-2026 07:40:59 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/5a/e4/fardet-vd_mc_le_mc_2024a_list-4272_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T193925_20250610T123002Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                       0.00370925     0.110293       18.5538      0.0154416     0.667277       2500    
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000186106   0.00500412     0.941643     0.00057544     0.0330162      2500    
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS    0.00113379     0.0217835      1.31909     0.00550212     0.0720244      2500    
[art]:TriggerResults:TriggerResultInserter                        9.198e-06    1.70247e-05   8.2576e-05    1.61665e-05   4.60755e-06     2500    
end_path:out1:RootOutput                                          1.299e-06    3.55289e-06   2.8741e-05    3.5215e-06    1.34865e-06     2500    
end_path:triggerAna:TriggerAnaTree                               0.00100884     0.0156869      1.15907      0.0041462     0.0650082      2500    
end_path:out1:RootOutput(write)                                  0.000357574    0.0148821     0.873453     0.000730547    0.0726789      2500    
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1314.25 MB
  Peak resident set size usage (VmHWM): 619.102 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0