Jobsub ID 281174.0@dunegpschedd01.fnal.gov

Jobsub ID	281174.0@dunegpschedd01.fnal.gov
Workflow ID	12072
Stage ID	1
User name	jierans@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-18 11:25:43
Site	US_UChicago
Entry	Engage_US_MWT2_iut2_condce_mcore
Last heartbeat	2026-01-18 11:49:24
From worker node	Hostname	uct2-c560.mwt2.org
	cpuinfo	AMD EPYC 7402 24-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	86400 (24 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-18 11:26:52
Input files	fardet-vd:prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250802T045620Z_gen_009275_supernova_g4stage1_g4stage2_detsim_reco_20250805T233930Z_reco2.root
Jobscript	Exit code	0
	Real time	22m (1333s)
	CPU time	3m (223s = 16%)
	Max RSS bytes	2522607616 (2405 MiB)
Outputting started	2026-01-18 11:49:06
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/jierans/vd_1x8x14_radiologicals_with_pds_20260118/ntuple/fnal/12072/1/001/triggerAna_12072_2026-01-18T_112710Z.ntuple.root
Finished	2026-01-18 11:49:24
Saved logs	justin-logs:281174.0-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

a104) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 105 (apa105) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 106 (apa106) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 107 (apa107) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 108 (apa108) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 109 (apa109) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 110 (apa110) has 864 channels from 3/3 readout planes.
GeoApaChannelGroupService::ctor: Group 111 (apa111) has 864 channels from 3/3 readout planes.
DuneToolManager::fclFilename: Taking fcl name from command line: lar -c triggersim_triggerana_dunefdvd_1x8x14_pds.fcl -n 100 -s root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/64/30/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250802T045620Z_gen_009275_supernova_g4stage1_g4stage2_detsim_reco_20250805T233930Z_reco2.root -o tpg_12072_2026-01-18T_112710Z.root -T triggerAna_12072_2026-01-18T_112710Z.ntuple.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x6872870
StandardRawDigitPrepService::ctor:   Extract service: @0x6687e90
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x162d650
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x162fe20
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x24d30d0
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
18-Jan-2026 05:27:33 CST  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/64/30/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250802T045620Z_gen_009275_supernova_g4stage1_g4stage2_detsim_reco_20250805T233930Z_reco2.root"
18-Jan-2026 05:27:37 CST  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/64/30/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250802T045620Z_gen_009275_supernova_g4stage1_g4stage2_detsim_reco_20250805T233930Z_reco2.root"
Begin processing the 1st record. run: 195 subRun: 0 event: 92741 at 18-Jan-2026 05:27:40 CST
TriggerPrimitiveMakerPDS: found 251538 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 314875 TPs.
Creating new TTree for tpmakerPDSLessSimpleThreshold::TriggerSimAna
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9431 / 156939 failed to backtrack. 6.00934%.
18-Jan-2026 05:28:52 CST  Opened output file with pattern "tpg_12072_2026-01-18T_112710Z.root"
Begin processing the 2nd record. run: 195 subRun: 0 event: 92742 at 18-Jan-2026 05:41:30 CST
TriggerPrimitiveMakerPDS: found 251587 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 316121 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9707 / 160316 failed to backtrack. 6.05492%.
Begin processing the 3rd record. run: 195 subRun: 0 event: 92743 at 18-Jan-2026 05:42:34 CST
TriggerPrimitiveMakerPDS: found 250932 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 312056 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9373 / 156421 failed to backtrack. 5.99216%.
Begin processing the 4th record. run: 195 subRun: 0 event: 92744 at 18-Jan-2026 05:43:34 CST
TriggerPrimitiveMakerPDS: found 251620 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 314532 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9341 / 156000 failed to backtrack. 5.98782%.
Begin processing the 5th record. run: 195 subRun: 0 event: 92745 at 18-Jan-2026 05:44:24 CST
TriggerPrimitiveMakerPDS: found 251483 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 315650 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9647 / 157839 failed to backtrack. 6.11192%.
Begin processing the 6th record. run: 195 subRun: 0 event: 92746 at 18-Jan-2026 05:45:14 CST
TriggerPrimitiveMakerPDS: found 251900 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 315341 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9585 / 158169 failed to backtrack. 6.05997%.
Begin processing the 7th record. run: 195 subRun: 0 event: 92747 at 18-Jan-2026 05:45:58 CST
TriggerPrimitiveMakerPDS: found 250606 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 313224 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9490 / 156569 failed to backtrack. 6.06123%.
Begin processing the 8th record. run: 195 subRun: 0 event: 92748 at 18-Jan-2026 05:46:44 CST
TriggerPrimitiveMakerPDS: found 251622 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 314472 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9198 / 157464 failed to backtrack. 5.84134%.
Begin processing the 9th record. run: 195 subRun: 0 event: 92749 at 18-Jan-2026 05:47:28 CST
TriggerPrimitiveMakerPDS: found 250992 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 314905 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9364 / 155504 failed to backtrack. 6.02171%.
Begin processing the 10th record. run: 195 subRun: 0 event: 92750 at 18-Jan-2026 05:48:13 CST
TriggerPrimitiveMakerPDS: found 252932 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 320073 TPs.
For TP collection tpmakerPDSLessSimpleThreshold::TriggerSimAna, 9941 / 161896 failed to backtrack. 6.14036%.
18-Jan-2026 05:49:03 CST  Closed output file "tpg_12072_2026-01-18T_112710Z.root"
18-Jan-2026 05:49:03 CST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/64/30/prodbackground_radiological_decay0_dunevd10kt_1x8x14_20250802T045620Z_gen_009275_supernova_g4stage1_g4stage2_detsim_reco_20250805T233930Z_reco2.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                         22.3112       26.4531       37.0727       24.5262       4.44274        10     
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.00109967     0.0484365     0.301813      0.0118533     0.0869265       10     
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS      15.2747       18.3182       27.4096       16.6609       3.72907        10     
[art]:TriggerResults:TriggerResultInserter                       2.9275e-05    6.49043e-05   0.000106008   5.9526e-05    2.26393e-05      10     
end_path:out1:RootOutput                                          8.116e-06    1.21986e-05    2.69e-05     1.0364e-05    5.13566e-06      10     
end_path:triggerAna:TriggerAnaTree                                 6.13234       7.8245        9.49975       7.61347       1.1408         10     
end_path:out1:RootOutput(write)                                   0.248795      0.260733      0.282978      0.256884      0.011447        10     
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3197.86 MB
  Peak resident set size usage (VmHWM): 2522.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0