Jobsub ID 268617.6@dunegpschedd02.fnal.gov

Jobsub ID	268617.6@dunegpschedd02.fnal.gov
Workflow ID	11715
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-11 08:20:36
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2026-01-11 09:11:28
From worker node	Hostname	dunegli-8142348-0-fnpc9064.fnal.gov
	cpuinfo	Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-11 09:06:06
Input files	fardet-vd:fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000450_lim000025_mergeLar_20241220T183610_20250610T122650Z_reco2.root
Jobscript	Exit code	0
	Real time	5m (307s)
	CPU time	2m (130s = 42%)
	Max RSS bytes	621572096 (592 MiB)
Outputting started	2026-01-11 09:11:13
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_nuecc_with_pds/ntuple/fnal/11715/1/001/triggerAna_11715_2026-01-11T_090617Z.ntuple.root
Finished	2026-01-11 09:11:28
Saved logs	justin-logs:268617.6-dunegpschedd02.fnal.gov.logs.tgz
List job events (HTCondor job logs unavailable)

Jobscript log (last 10,000 characters)

d 206 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 201 failed to backtrack. 2.98507%.
Begin processing the 2477th record. run: 4246 subRun: 0 event: 47477 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 186 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 180 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 179 failed to backtrack. 1.67598%.
Begin processing the 2478th record. run: 4246 subRun: 0 event: 47478 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 199 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 181 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 4 / 177 failed to backtrack. 2.25989%.
Begin processing the 2479th record. run: 4246 subRun: 0 event: 47479 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 224 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 202 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 200 failed to backtrack. 1.5%.
Begin processing the 2480th record. run: 4246 subRun: 0 event: 47480 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 157 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 155 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 153 failed to backtrack. 0.653595%.
Begin processing the 2481st record. run: 4246 subRun: 0 event: 47481 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 146 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 118 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 117 failed to backtrack. 1.7094%.
Begin processing the 2482nd record. run: 4246 subRun: 0 event: 47482 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 182 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 184 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 181 failed to backtrack. 1.65746%.
Begin processing the 2483rd record. run: 4246 subRun: 0 event: 47483 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 158 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 155 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 154 failed to backtrack. 1.2987%.
Begin processing the 2484th record. run: 4246 subRun: 0 event: 47484 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 168 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 153 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 6 / 152 failed to backtrack. 3.94737%.
Begin processing the 2485th record. run: 4246 subRun: 0 event: 47485 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 160 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 141 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 141 failed to backtrack. 4.96454%.
Begin processing the 2486th record. run: 4246 subRun: 0 event: 47486 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 130 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 102 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 102 failed to backtrack. 4.90196%.
Begin processing the 2487th record. run: 4246 subRun: 0 event: 47487 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 99 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 72 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 72 failed to backtrack. 1.38889%.
Begin processing the 2488th record. run: 4246 subRun: 0 event: 47488 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 160 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 118 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 118 failed to backtrack. 2.54237%.
Begin processing the 2489th record. run: 4246 subRun: 0 event: 47489 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 83 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 71 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 3 / 70 failed to backtrack. 4.28571%.
Begin processing the 2490th record. run: 4246 subRun: 0 event: 47490 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 234 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 245 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 242 failed to backtrack. 2.06612%.
Begin processing the 2491st record. run: 4246 subRun: 0 event: 47491 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 139 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 97 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 95 failed to backtrack. 2.10526%.
Begin processing the 2492nd record. run: 4246 subRun: 0 event: 47492 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 66 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 37 failed to backtrack. 2.7027%.
Begin processing the 2493rd record. run: 4246 subRun: 0 event: 47493 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 227 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 170 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 168 failed to backtrack. 4.16667%.
Begin processing the 2494th record. run: 4246 subRun: 0 event: 47494 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 186 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 152 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 150 failed to backtrack. 1.33333%.
Begin processing the 2495th record. run: 4246 subRun: 0 event: 47495 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 33 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 10 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 1 / 10 failed to backtrack. 10%.
Begin processing the 2496th record. run: 4246 subRun: 0 event: 47496 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 216 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 224 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 224 failed to backtrack. 0.892857%.
Begin processing the 2497th record. run: 4246 subRun: 0 event: 47497 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 258 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 269 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 7 / 267 failed to backtrack. 2.62172%.
Begin processing the 2498th record. run: 4246 subRun: 0 event: 47498 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 60 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 38 failed to backtrack. 5.26316%.
Begin processing the 2499th record. run: 4246 subRun: 0 event: 47499 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 184 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 167 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 2 / 163 failed to backtrack. 1.22699%.
Begin processing the 2500th record. run: 4246 subRun: 0 event: 47500 at 11-Jan-2026 09:10:53 UTC
TriggerPrimitiveMakerPDS: found 220 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 251 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 5 / 251 failed to backtrack. 1.99203%.
11-Jan-2026 09:10:56 UTC  Closed output file "tpg_11715_2026-01-11T_090617Z.root"
11-Jan-2026 09:10:56 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/90/83/fardet-vd_mc_le_mc_2024a_list-4246_input.list_out1_standard_reco1_dunevd10kt_1x8x14_3view_30deg_hit-reconstructed_merged_skip000450_lim000025_mergeLar_20241220T183610_20250610T122650Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                       0.00377821     0.0434063      8.44166      0.0088875     0.427223       2500    
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000314068   0.00092456     0.0175164    0.000883812   0.000516368     2500    
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS    0.000891611   0.00263874     0.202461     0.00245091    0.00411379      2500    
[art]:TriggerResults:TriggerResultInserter                       1.6366e-05    2.72366e-05   0.000102507   2.7075e-05    5.5795e-06      2500    
end_path:out1:RootOutput                                          2.902e-06    5.07025e-06   2.1355e-05    4.9765e-06    1.00322e-06     2500    
end_path:triggerAna:TriggerAnaTree                               0.00114965    0.00363761     0.0259768    0.00313458    0.00241476      2500    
end_path:out1:RootOutput(write)                                  0.000596348   0.00189616      1.66029     0.00122828     0.0331763      2500    
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1314.24 MB
  Peak resident set size usage (VmHWM): 622.625 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0