justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264776.6@dunegpschedd02.fnal.gov

Jobsub ID264776.6@dunegpschedd02.fnal.gov
Workflow ID11399
Stage ID1
User namejierans@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-28 23:02:43
SiteUS_UChicago
EntryEngage_US_MWT2_iut2_condce_mcore
Last heartbeat2025-12-29 02:47:44
From worker nodeHostnameuct2-c551.mwt2.org
cpuinfoAMD EPYC 7402 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job stateaborted
Started2025-12-28 23:30:20
Input filesmonte-carlo-011399-000034
Outputting started2025-12-29 02:45:38
Output files
Finished2025-12-29 02:47:44
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

atusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
28-Dec-2025 20:44:17 CST  Initiating request to open input file "tmp_tpg_tpc.root"
28-Dec-2025 20:44:18 CST  Opened input file "tmp_tpg_tpc.root"
Begin processing the 1st record. run: 11399 subRun: 34 event: 1 at 28-Dec-2025 20:44:18 CST
TriggerPrimitiveMakerPDS: found 63876 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100776 TPs.
TriggerPrimitiveMakerPDS: found 63876 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38151 TPs.
Creating new TTree for tpmakerPDSSimpleThreshold::TriggerSimAna
Creating new TTree for tpmakerPDSLessSimpleThreshold::TriggerSimAna
Creating new TTree for tpmakerTPCSimpleThreshold::TriggerPrimitiveMaker
28-Dec-2025 20:44:21 CST  Opened output file with pattern "tpg_11399_000034.root"
Begin processing the 2nd record. run: 11399 subRun: 34 event: 2 at 28-Dec-2025 20:44:27 CST
TriggerPrimitiveMakerPDS: found 63035 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101218 TPs.
TriggerPrimitiveMakerPDS: found 63035 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37967 TPs.
Begin processing the 3rd record. run: 11399 subRun: 34 event: 3 at 28-Dec-2025 20:44:31 CST
TriggerPrimitiveMakerPDS: found 63573 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101687 TPs.
TriggerPrimitiveMakerPDS: found 63573 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37951 TPs.
Begin processing the 4th record. run: 11399 subRun: 34 event: 4 at 28-Dec-2025 20:44:35 CST
TriggerPrimitiveMakerPDS: found 64328 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 102615 TPs.
TriggerPrimitiveMakerPDS: found 64328 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38741 TPs.
Begin processing the 5th record. run: 11399 subRun: 34 event: 5 at 28-Dec-2025 20:44:39 CST
TriggerPrimitiveMakerPDS: found 64484 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 104579 TPs.
TriggerPrimitiveMakerPDS: found 64484 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38987 TPs.
Begin processing the 6th record. run: 11399 subRun: 34 event: 6 at 28-Dec-2025 20:44:42 CST
TriggerPrimitiveMakerPDS: found 63799 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101856 TPs.
TriggerPrimitiveMakerPDS: found 63799 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38381 TPs.
Begin processing the 7th record. run: 11399 subRun: 34 event: 7 at 28-Dec-2025 20:44:45 CST
TriggerPrimitiveMakerPDS: found 63373 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 99561 TPs.
TriggerPrimitiveMakerPDS: found 63373 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37441 TPs.
Begin processing the 8th record. run: 11399 subRun: 34 event: 8 at 28-Dec-2025 20:44:48 CST
TriggerPrimitiveMakerPDS: found 63290 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100441 TPs.
TriggerPrimitiveMakerPDS: found 63290 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37868 TPs.
Begin processing the 9th record. run: 11399 subRun: 34 event: 9 at 28-Dec-2025 20:44:51 CST
TriggerPrimitiveMakerPDS: found 63504 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100813 TPs.
TriggerPrimitiveMakerPDS: found 63504 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37914 TPs.
Begin processing the 10th record. run: 11399 subRun: 34 event: 10 at 28-Dec-2025 20:44:56 CST
TriggerPrimitiveMakerPDS: found 63709 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101838 TPs.
TriggerPrimitiveMakerPDS: found 63709 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38303 TPs.
Begin processing the 11th record. run: 11399 subRun: 34 event: 11 at 28-Dec-2025 20:44:59 CST
TriggerPrimitiveMakerPDS: found 63431 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 102552 TPs.
TriggerPrimitiveMakerPDS: found 63431 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38218 TPs.
Begin processing the 12th record. run: 11399 subRun: 34 event: 12 at 28-Dec-2025 20:45:02 CST
TriggerPrimitiveMakerPDS: found 64193 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 102814 TPs.
TriggerPrimitiveMakerPDS: found 64193 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38534 TPs.
Begin processing the 13th record. run: 11399 subRun: 34 event: 13 at 28-Dec-2025 20:45:07 CST
TriggerPrimitiveMakerPDS: found 63665 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100464 TPs.
TriggerPrimitiveMakerPDS: found 63665 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37919 TPs.
Begin processing the 14th record. run: 11399 subRun: 34 event: 14 at 28-Dec-2025 20:45:11 CST
TriggerPrimitiveMakerPDS: found 63448 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100491 TPs.
TriggerPrimitiveMakerPDS: found 63448 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37884 TPs.
Begin processing the 15th record. run: 11399 subRun: 34 event: 15 at 28-Dec-2025 20:45:14 CST
TriggerPrimitiveMakerPDS: found 64015 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 103433 TPs.
TriggerPrimitiveMakerPDS: found 64015 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38672 TPs.
Begin processing the 16th record. run: 11399 subRun: 34 event: 16 at 28-Dec-2025 20:45:18 CST
TriggerPrimitiveMakerPDS: found 63784 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 100891 TPs.
TriggerPrimitiveMakerPDS: found 63784 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38047 TPs.
Begin processing the 17th record. run: 11399 subRun: 34 event: 17 at 28-Dec-2025 20:45:21 CST
TriggerPrimitiveMakerPDS: found 62860 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 98453 TPs.
TriggerPrimitiveMakerPDS: found 62860 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37364 TPs.
Begin processing the 18th record. run: 11399 subRun: 34 event: 18 at 28-Dec-2025 20:45:25 CST
TriggerPrimitiveMakerPDS: found 63918 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101670 TPs.
TriggerPrimitiveMakerPDS: found 63918 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38392 TPs.
Begin processing the 19th record. run: 11399 subRun: 34 event: 19 at 28-Dec-2025 20:45:29 CST
TriggerPrimitiveMakerPDS: found 63902 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 101500 TPs.
TriggerPrimitiveMakerPDS: found 63902 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 38138 TPs.
Begin processing the 20th record. run: 11399 subRun: 34 event: 20 at 28-Dec-2025 20:45:32 CST
TriggerPrimitiveMakerPDS: found 62586 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 98517 TPs.
TriggerPrimitiveMakerPDS: found 62586 OpDetWaveform objects.
TriggerPrimitiveMakerPDS: Generated 37192 TPs.
28-Dec-2025 20:45:35 CST  Closed output file "tpg_11399_000034.root"
28-Dec-2025 20:45:35 CST  Closed input file "tmp_tpg_tpc.root"

===================================================================================================================================================
TimeTracker printout (sec)                                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================================
Full event                                                         1.2754        2.22789       3.53892       1.95393      0.678723        20     
---------------------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                           0.000474903   0.000653738   0.00115887     0.0006091    0.000172343      20     
makers:tpmakerPDSSimpleThreshold:TriggerPrimitiveMakerPDS         0.244005      0.360834       0.40364      0.372529      0.0394961       20     
makers:tpmakerPDSLessSimpleThreshold:TriggerPrimitiveMakerPDS     0.160201      0.199287      0.212032      0.204733      0.0142853       20     
[art]:TriggerResults:TriggerResultInserter                       1.4558e-05    3.36107e-05   0.000127459   2.5398e-05    2.69486e-05      20     
end_path:out1:RootOutput                                          4.108e-06    1.15155e-05   6.4791e-05     8.24e-06     1.31277e-05      20     
end_path:triggerAna:TriggerAnaTree                                 0.77599       1.57151       2.86289       1.2762        0.66102        20     
end_path:out1:RootOutput(write)                                   0.0777688     0.094694      0.103438      0.0955158    0.00570465       20     
===================================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1874.77 MB
  Peak resident set size usage (VmHWM): 1204.65 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
lar exit code 0
justIN time: 2026-02-04 11:55:12 UTC       justIN version: 01.06.00