justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 292959.182@dunegpschedd02.fnal.gov

Jobsub ID292959.182@dunegpschedd02.fnal.gov
Workflow ID12183
Stage ID1
User namejlechevr@fnal.gov
RequestedProcessors4
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-21 18:49:05
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw7
Last heartbeat2026-01-21 19:32:25
From worker nodeHostnamemh-7763-19.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors4
RSS bytes7864320000 (7500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-21 19:14:04
Input fileshd-protodune:pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1.root
JobscriptExit code0
Real time17m (1023s)
CPU time1m (116s = 11%)
Max RSS bytes2577293312 (2457 MiB)
Outputting started2026-01-21 19:31:13
Output filesusertests:pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1_20260121T191412Z_michel.root
Finished2026-01-21 19:32:25
Saved logsjustin-logs:292959.182-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

etPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
ToolBasedRawDigitPrepService::ctor:      Fetching digitReader
AcdDigitReader::ctor:     LogLevel: 1
ToolBasedRawDigitPrepService::ctor:     Found tool digitReader @ 0x44870b70
ToolBasedRawDigitPrepService::ctor:      Fetching adcSampleFiller
AdcSampleFiller::ctor: Configuration parameters:
AdcSampleFiller::ctor:       LogLevel: 1
AdcSampleFiller::ctor:   AdcUnderflow: 0
AdcSampleFiller::ctor:    AdcOverflow: 4095
ToolBasedRawDigitPrepService::ctor:     Found tool adcSampleFiller @ 0x426e3ba0
ToolBasedRawDigitPrepService::ctor:      Fetching adcScaleAdcToKe
AdcSampleScaler::ctor: Parameters:
AdcSampleScaler::ctor:          LogLevel: 1
AdcSampleScaler::ctor:       ScaleFactor: 0.025
AdcSampleScaler::ctor:        OutputUnit: ke/tick
AdcSampleScaler::ctor:         InputUnit: ADC count
ToolBasedRawDigitPrepService::ctor:     Found tool adcScaleAdcToKe @ 0x4531a9f0
ToolBasedRawDigitPrepService::ctor:      Fetching pdspTailPedRemovalZKe
DuneToolManager::getPrivate: ERROR: No such tool name: pdspTailPedRemovalZKe
ToolBasedRawDigitPrepService::ctor: ERROR: Unable to retrieve display tool pdspTailPedRemovalZKe
ToolBasedRawDigitPrepService::ctor: Fetching wire building service.
ToolBasedRawDigitPrepService::ctor:   Wire building service: @0x3ea7a5a0
ToolBasedRawDigitPrepService::ctor: ToolBasedRawDigitPrepService:
ToolBasedRawDigitPrepService::ctor:                     LogLevel: 3
ToolBasedRawDigitPrepService::ctor:                      DoWires: 1
ToolBasedRawDigitPrepService::ctor:      ADC channel tools:
ToolBasedRawDigitPrepService::ctor:            digitReader
ToolBasedRawDigitPrepService::ctor:            adcSampleFiller
ToolBasedRawDigitPrepService::ctor:            adcScaleAdcToKe
%MSG-i SignalShapingServiceDUNE:  Early 21-Jan-2026 11:14:25 PST JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 21-Jan-2026 11:14:26 PST JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Detector Properties:
  Detector Geometry: protodunehdv6  (PDHD)
  Tick Window: [0, 6000]
  Top Bounds: (0.0651,0,-0.59375) -> (353.486,607.499,463.126)
  Bot Bounds: (-353.686,0,-0.59375) -> (-0.2651,607.499,463.126)
Analysis Parameters:
  Keep All Events: true
  Track Length Cut: 30 cm
  Fiducial Length: 20 cm
  Barycenter Radius: 10 cm
  Michel Space Radius: 20 cm
  Smoothing Length: 6 points
21-Jan-2026 11:14:26 PST  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/80/71/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1.root"
%MSG-i Root_Information:  MichelAnalysis:checks@Construction TClass::Init()  21-Jan-2026 11:14:29 PST ModuleConstruction
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
21-Jan-2026 11:14:29 PST  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/80/71/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1.root"
db: runtime0
Begin processing the 1st record. run: 20250614 subRun: 1 event: 480 at 21-Jan-2026 11:14:36 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:16:18 PST  run: 20250614 subRun: 1 event: 480
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 2nd record. run: 20250614 subRun: 1 event: 481 at 21-Jan-2026 11:16:26 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:17:44 PST  run: 20250614 subRun: 1 event: 481
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 3rd record. run: 20250614 subRun: 1 event: 482 at 21-Jan-2026 11:17:50 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:19:12 PST  run: 20250614 subRun: 1 event: 482
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 4th record. run: 20250614 subRun: 1 event: 483 at 21-Jan-2026 11:19:20 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:20:23 PST  run: 20250614 subRun: 1 event: 483
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 5th record. run: 20250614 subRun: 1 event: 484 at 21-Jan-2026 11:20:30 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:22:27 PST  run: 20250614 subRun: 1 event: 484
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 6th record. run: 20250614 subRun: 1 event: 485 at 21-Jan-2026 11:22:34 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:24:07 PST  run: 20250614 subRun: 1 event: 485
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 7th record. run: 20250614 subRun: 1 event: 486 at 21-Jan-2026 11:24:17 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:26:04 PST  run: 20250614 subRun: 1 event: 486
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 8th record. run: 20250614 subRun: 1 event: 487 at 21-Jan-2026 11:26:14 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:27:39 PST  run: 20250614 subRun: 1 event: 487
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 9th record. run: 20250614 subRun: 1 event: 488 at 21-Jan-2026 11:27:45 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:29:04 PST  run: 20250614 subRun: 1 event: 488
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
Begin processing the 10th record. run: 20250614 subRun: 1 event: 489 at 21-Jan-2026 11:29:14 PST
%MSG-w PhotonBackTrackerService:  ProcessEvent 21-Jan-2026 11:30:52 PST  run: 20250614 subRun: 1 event: 489
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
21-Jan-2026 11:31:02 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/80/71/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          4.98398       7.37041       10.0896       6.95399       1.63186        10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000541095    0.0333878     0.112292      0.0254155     0.0366227       10     
end_path:checks:MichelAnalysis      4.98299       7.3367        10.0395       6.90049       1.62076        10     
====================================================================================================================
%MSG-i NuRandomService:  MichelAnalysis:checks@EndJob 21-Jan-2026 11:31:02 PST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 16176083
  seed within: [ 1 ; 900000000 ]

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 checks

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 90.495194 Real = 990.792239

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 4119.98 VmHWM = 2577.29

ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 4 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
Art has completed and will exit with status 0.
Output files:
\tReco: pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1_20260121T191412Z_michel.root
Forming reco metadata
Ran successfully
{
  "name": "pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_258213_32_1_20251206T014112Z_detsim_reco1_20260121T191412Z_michel.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_16_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "pdhd_michel_job.fcl",
    "dune.campaign": "usertests",
    "core.start_time": 1769022852.0,
    "core.end_time": 1769023864.0
  }
}
justIN time: 2026-02-04 11:24:01 UTC       justIN version: 01.06.00