Jobsub ID 268617.2@dunegpschedd02.fnal.gov

Jobsub ID	268617.2@dunegpschedd02.fnal.gov
Workflow ID	11715
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-11 08:20:36
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-11 09:08:41
From worker node	Hostname	dunegli-8142294-0-fnpc23018.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-11 09:06:49
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4244_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T175850_20250610T122651Z_reco2.root
Jobscript	Exit code	0
	Real time	1m (102s)
	CPU time	1m (66s = 64%)
	Max RSS bytes	618008576 (589 MiB)
Outputting started	2026-01-11 09:08:32
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_nuecc_with_pds/ntuple/fnal/11715/1/001/triggerAna_11715_2026-01-11T_090714Z.ntuple.root
Finished	2026-01-11 09:08:41
Saved logs	justin-logs:268617.2-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 61 failed to backtrack. 8.19672%.
Begin processing the 2477th record. run: 4244 subRun: 0 event: 37477 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 236 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 261 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 8 / 257 failed to backtrack. 3.11284%.
Begin processing the 2478th record. run: 4244 subRun: 0 event: 37478 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 53 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 31 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 30 failed to backtrack. 6.66667%.
Begin processing the 2479th record. run: 4244 subRun: 0 event: 37479 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 217 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 204 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 197 failed to backtrack. 3.04569%.
Begin processing the 2480th record. run: 4244 subRun: 0 event: 37480 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 106 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 76 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 71 failed to backtrack. 2.8169%.
Begin processing the 2481st record. run: 4244 subRun: 0 event: 37481 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 167 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 118 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 116 failed to backtrack. 6.03448%.
Begin processing the 2482nd record. run: 4244 subRun: 0 event: 37482 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 200 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 195 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 195 failed to backtrack. 3.07692%.
Begin processing the 2483rd record. run: 4244 subRun: 0 event: 37483 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 195 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 164 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 160 failed to backtrack. 2.5%.
Begin processing the 2484th record. run: 4244 subRun: 0 event: 37484 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 267 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 225 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 222 failed to backtrack. 0.45045%.
Begin processing the 2485th record. run: 4244 subRun: 0 event: 37485 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 70 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 75 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 75 failed to backtrack. 1.33333%.
Begin processing the 2486th record. run: 4244 subRun: 0 event: 37486 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 202 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 206 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 205 failed to backtrack. 1.46341%.
Begin processing the 2487th record. run: 4244 subRun: 0 event: 37487 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 104 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 95 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 94 failed to backtrack. 4.25532%.
Begin processing the 2488th record. run: 4244 subRun: 0 event: 37488 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 112 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 103 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 99 failed to backtrack. 4.0404%.
Begin processing the 2489th record. run: 4244 subRun: 0 event: 37489 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 178 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 171 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 169 failed to backtrack. 1.77515%.
Begin processing the 2490th record. run: 4244 subRun: 0 event: 37490 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 235 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 226 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 225 failed to backtrack. 1.77778%.
Begin processing the 2491st record. run: 4244 subRun: 0 event: 37491 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 227 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 202 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 198 failed to backtrack. 1.0101%.
Begin processing the 2492nd record. run: 4244 subRun: 0 event: 37492 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 194 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 187 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 186 failed to backtrack. 2.68817%.
Begin processing the 2493rd record. run: 4244 subRun: 0 event: 37493 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 114 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 82 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 79 failed to backtrack. 5.06329%.
Begin processing the 2494th record. run: 4244 subRun: 0 event: 37494 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 222 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 230 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 226 failed to backtrack. 0.884956%.
Begin processing the 2495th record. run: 4244 subRun: 0 event: 37495 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 114 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 98 failed to backtrack. 1.02041%.
Begin processing the 2496th record. run: 4244 subRun: 0 event: 37496 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 252 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 246 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 245 failed to backtrack. 0.408163%.
Begin processing the 2497th record. run: 4244 subRun: 0 event: 37497 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 130 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 88 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 87 failed to backtrack. 1.14943%.
Begin processing the 2498th record. run: 4244 subRun: 0 event: 37498 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 301 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 254 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 251 failed to backtrack. 2.78884%.
Begin processing the 2499th record. run: 4244 subRun: 0 event: 37499 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 274 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 217 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 215 failed to backtrack. 1.39535%.
Begin processing the 2500th record. run: 4244 subRun: 0 event: 37500 at 11-Jan-2026 09:08:31 UTC
TriggerPrimitiveMakerPDS: found 221 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 270 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 267 failed to backtrack. 0.749064%.
11-Jan-2026 09:08:32 UTC  Closed output file "tpg_11715_2026-01-11T_090714Z.root"
11-Jan-2026 09:08:32 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/9f/80/fardet-vd_mc_le_mc_2024a_list-4244_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000350_lim000025_mergeLar_20241220T175850_20250610T122651Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                       0.00224167    0.00482297     0.171222     0.00416934    0.00484858      2500    
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000131872   0.000335379    0.0111295    0.000352194   0.000264265     2500    
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS    0.000610097    0.0017078     0.0779123    0.00159144    0.00189089      2500    
[art]:TriggerResults:TriggerResultInserter                        6.161e-06    8.89475e-06   7.7027e-05     8.136e-06    2.80522e-06     2500    
end_path:out1:RootOutput                                          8.92e-07     1.94472e-06   0.000182679    1.683e-06    3.73175e-06     2500    
end_path:triggerAna:TriggerAnaTree                               0.000662086   0.00174461     0.0261015    0.00141876     0.0014799      2500    
end_path:out1:RootOutput(write)                                  0.000245099   0.000555544    0.0425746    0.000483475   0.00106321      2500    
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1314.22 MB
  Peak resident set size usage (VmHWM): 622.17 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0