Jobsub ID 280590.1@dunegpschedd01.fnal.gov

Jobsub ID	280590.1@dunegpschedd01.fnal.gov
Workflow ID	12031
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-18 06:51:25
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-18 07:50:37
From worker node	Hostname	dunegli-8356436-0-fnpc8011.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-18 07:42:26
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4279_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000425_lim000025_mergeLar_20241220T211546_20250610T120601Z_reco2.root
Jobscript	Exit code	0
	Real time	8m (481s)
	CPU time	2m (122s = 25%)
	Max RSS bytes	618868736 (590 MiB)
Outputting started	2026-01-18 07:50:27
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_nuecc_with_pds/ntuple/fnal/12031/1/001/triggerAna_12031_2026-01-18T_074235Z.ntuple.root
Finished	2026-01-18 07:50:37
Saved logs	justin-logs:280590.1-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

MakerPDS: Generated 28 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 27 failed to backtrack. 0%.
Begin processing the 2477th record. run: 4279 subRun: 0 event: 45377 at 18-Jan-2026 07:50:12 UTC
TriggerPrimitiveMakerPDS: found 109 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 113 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 106 failed to backtrack. 1.88679%.
Begin processing the 2478th record. run: 4279 subRun: 0 event: 45378 at 18-Jan-2026 07:50:12 UTC
TriggerPrimitiveMakerPDS: found 76 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 59 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 58 failed to backtrack. 8.62069%.
Begin processing the 2479th record. run: 4279 subRun: 0 event: 45379 at 18-Jan-2026 07:50:12 UTC
TriggerPrimitiveMakerPDS: found 202 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 232 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 230 failed to backtrack. 2.17391%.
Begin processing the 2480th record. run: 4279 subRun: 0 event: 45380 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 173 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 172 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 167 failed to backtrack. 1.1976%.
Begin processing the 2481st record. run: 4279 subRun: 0 event: 45381 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 102 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 78 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 77 failed to backtrack. 3.8961%.
Begin processing the 2482nd record. run: 4279 subRun: 0 event: 45382 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 162 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 162 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 158 failed to backtrack. 1.26582%.
Begin processing the 2483rd record. run: 4279 subRun: 0 event: 45383 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 221 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 225 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 219 failed to backtrack. 0.913242%.
Begin processing the 2484th record. run: 4279 subRun: 0 event: 45384 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 159 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 107 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 107 failed to backtrack. 0.934579%.
Begin processing the 2485th record. run: 4279 subRun: 0 event: 45385 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 108 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 111 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 108 failed to backtrack. 1.85185%.
Begin processing the 2486th record. run: 4279 subRun: 0 event: 45386 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 161 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 160 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 152 failed to backtrack. 0.657895%.
Begin processing the 2487th record. run: 4279 subRun: 0 event: 45387 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 138 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 122 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 116 failed to backtrack. 6.03448%.
Begin processing the 2488th record. run: 4279 subRun: 0 event: 45388 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 120 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 114 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 114 failed to backtrack. 1.75439%.
Begin processing the 2489th record. run: 4279 subRun: 0 event: 45389 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 206 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 202 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 198 failed to backtrack. 1.0101%.
Begin processing the 2490th record. run: 4279 subRun: 0 event: 45390 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 95 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 82 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 80 failed to backtrack. 2.5%.
Begin processing the 2491st record. run: 4279 subRun: 0 event: 45391 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 53 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 39 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 38 failed to backtrack. 7.89474%.
Begin processing the 2492nd record. run: 4279 subRun: 0 event: 45392 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 80 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 64 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 61 failed to backtrack. 0%.
Begin processing the 2493rd record. run: 4279 subRun: 0 event: 45393 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 169 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 171 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 169 failed to backtrack. 0.591716%.
Begin processing the 2494th record. run: 4279 subRun: 0 event: 45394 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 268 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 268 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 10 / 266 failed to backtrack. 3.7594%.
Begin processing the 2495th record. run: 4279 subRun: 0 event: 45395 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 136 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 118 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 0 / 116 failed to backtrack. 0%.
Begin processing the 2496th record. run: 4279 subRun: 0 event: 45396 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 101 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 94 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 92 failed to backtrack. 2.17391%.
Begin processing the 2497th record. run: 4279 subRun: 0 event: 45397 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 84 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 66 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 65 failed to backtrack. 1.53846%.
Begin processing the 2498th record. run: 4279 subRun: 0 event: 45398 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 39 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 28 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 26 failed to backtrack. 3.84615%.
Begin processing the 2499th record. run: 4279 subRun: 0 event: 45399 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 174 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 131 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 123 failed to backtrack. 2.43902%.
Begin processing the 2500th record. run: 4279 subRun: 0 event: 45400 at 18-Jan-2026 07:50:13 UTC
TriggerPrimitiveMakerPDS: found 227 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 227 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 218 failed to backtrack. 2.29358%.
18-Jan-2026 07:50:15 UTC  Closed output file "tpg_12031_2026-01-18T_074235Z.root"
18-Jan-2026 07:50:15 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/1f/f4/fardet-vd_mc_le_mc_2024a_list-4279_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000425_lim000025_mergeLar_20241220T211546_20250610T120601Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                       0.00409267     0.0568062      6.70528     0.00772897     0.435405       2500    
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000316262   0.00106073     0.618765     0.000760406    0.0130733      2500    
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS    0.00094528    0.00439686     0.700328     0.00238357     0.026054       2500    
[art]:TriggerResults:TriggerResultInserter                       1.7059e-05    2.3726e-05    0.000167695   2.1084e-05    6.89085e-06     2500    
end_path:out1:RootOutput                                          3.104e-06    4.27199e-06   3.2853e-05     4.102e-06    1.06677e-06     2500    
end_path:triggerAna:TriggerAnaTree                               0.00123753    0.00629445     0.812072     0.00270354     0.0369212      2500    
end_path:out1:RootOutput(write)                                  0.000614238   0.00414718     0.726778     0.000974075    0.0308348      2500    
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1314.25 MB
  Peak resident set size usage (VmHWM): 620.782 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0