justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 277177.88@dunegpschedd01.fnal.gov

Jobsub ID277177.88@dunegpschedd01.fnal.gov
Workflow ID11820
Stage ID1
User namejlechevr@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2026-01-13 14:29:26
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2026-01-13 14:33:11
From worker nodeHostnamedunegli-8149214-0-fnpc18002.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statenone_processed
Started2026-01-13 14:31:27
Input fileshd-protodune:pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_267115_60_1_20251212T074747Z_detsim_reco1.root
Outputting started2026-01-13 14:32:43
Output files
Finished2026-01-13 14:33:11
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

reated
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
%MSG-i GeometryCore:  Early 13-Jan-2026 14:32:03 UTC JobSetup
Sorting volumes...
%MSG
%MSG-i GeometryCore:  Early 13-Jan-2026 14:32:03 UTC JobSetup
New detector geometry loaded from
	/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_11_00d00/gdml/protodunehd_v6_refactored.gdml
%MSG
%MSG-i DuneApaWireReadoutGeom:  Early 13-Jan-2026 14:32:03 UTC JobSetup
Initializing wire readout...
%MSG
Cryostat 0:
  10240 total channels
  4 APAs
  For all identical APA:
    Number of channels per APA = 2560
    U channels per APA = 800
    V channels per APA = 800
    Z channels per APA = 960
    Pitch in U Plane = 0.4669
    Pitch in V Plane = 0.4669
    Pitch in Z Plane = 0.4792
DuneDeconvolutionService::ctor: DuneDeconvolutionService:
DuneDeconvolutionService::ctor:                LogLevel: 1
DuneRoiBuildingService::ctor: DuneRoiBuildingService:
DuneRoiBuildingService::ctor:     LogLevel: 1
DuneRoiBuildingService::ctor:  NSigmaStart: 3
DuneRoiBuildingService::ctor:    NSigmaEnd: 1
DuneRoiBuildingService::ctor:       PadLow: 50
DuneRoiBuildingService::ctor:      PadHigh: 50
StandardAdcWireBuildingService::ctor: StandardAdcWireBuildingService:
StandardAdcWireBuildingService::ctor:     LogLevel: 1
%MSG-i AuxDetGeometryCore:  Early 13-Jan-2026 14:32:03 UTC JobSetup
New detector geometry loaded from
	/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_11_00d00/gdml/protodunehd_v6_refactored.gdml
%MSG
GeoApaChannelGroupService::ctor: Group 0 (apa0) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 1 (apa1) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 2 (apa2) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 3 (apa3) has 2560 channels from 4/4 readout planes.
%MSG-i SimpleChannelStatusService:  Early 13-Jan-2026 14:32:03 UTC JobSetup
Loaded from configuration:
  - 0 bad channels
  - 0 noisy channels
  - largest channel ID: 10239, largest present: 10239
%MSG
%MSG-i setupProvider<DetectorPropertiesStandard>:  Early  13-Jan-2026 14:32:03 UTC JobSetup
Asked to ignore 1 keys: 'InheritNumberTimeSamples'
%MSG
PDSP Channel Map: Building RCE TPC wiremap from file protoDUNETPCChannelMap_RCE_v4.txt
PDSP Channel Map: Building FELIX TPC wiremap from file protoDUNETPCChannelMap_RCE_v4.txt
PDSP Channel Map: Building SSP channel map from file protoDUNESSPChannelMap_v1.txt
DuneToolManager::fclFilename: Taking fcl name from command line: lar -c pdhd_MichelAnalysis.fcl -n 1 root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/d4/93/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_267115_60_1_20251212T074747Z_detsim_reco1.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
ToolBasedRawDigitPrepService::ctor:      Fetching digitReader
AcdDigitReader::ctor:     LogLevel: 1
ToolBasedRawDigitPrepService::ctor:     Found tool digitReader @ 0x8b93190
ToolBasedRawDigitPrepService::ctor:      Fetching adcSampleFiller
AdcSampleFiller::ctor: Configuration parameters:
AdcSampleFiller::ctor:       LogLevel: 1
AdcSampleFiller::ctor:   AdcUnderflow: 0
AdcSampleFiller::ctor:    AdcOverflow: 4095
ToolBasedRawDigitPrepService::ctor:     Found tool adcSampleFiller @ 0xa8aebc0
ToolBasedRawDigitPrepService::ctor:      Fetching adcScaleAdcToKe
AdcSampleScaler::ctor: Parameters:
AdcSampleScaler::ctor:          LogLevel: 1
AdcSampleScaler::ctor:       ScaleFactor: 0.025
AdcSampleScaler::ctor:        OutputUnit: ke/tick
AdcSampleScaler::ctor:         InputUnit: ADC count
ToolBasedRawDigitPrepService::ctor:     Found tool adcScaleAdcToKe @ 0xabbb7a0
ToolBasedRawDigitPrepService::ctor:      Fetching pdspTailPedRemovalZKe
DuneToolManager::getPrivate: ERROR: No such tool name: pdspTailPedRemovalZKe
ToolBasedRawDigitPrepService::ctor: ERROR: Unable to retrieve display tool pdspTailPedRemovalZKe
ToolBasedRawDigitPrepService::ctor: Fetching wire building service.
ToolBasedRawDigitPrepService::ctor:   Wire building service: @0x583fb40
ToolBasedRawDigitPrepService::ctor: ToolBasedRawDigitPrepService:
ToolBasedRawDigitPrepService::ctor:                     LogLevel: 3
ToolBasedRawDigitPrepService::ctor:                      DoWires: 1
ToolBasedRawDigitPrepService::ctor:      ADC channel tools:
ToolBasedRawDigitPrepService::ctor:            digitReader
ToolBasedRawDigitPrepService::ctor:            adcSampleFiller
ToolBasedRawDigitPrepService::ctor:            adcScaleAdcToKe
%MSG-i SignalShapingServiceDUNE:  Early 13-Jan-2026 14:32:16 UTC JobSetup
Getting Filter from .fcl file
%MSG
%MSG-i SignalShapingServiceDUNE:  Early 13-Jan-2026 14:32:16 UTC JobSetup
 using the field response provided from a .root file 
%MSG
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Detector Properties:
  Detector Geometry: protodunehdv6  (PDHD)
  Tick Window: [0, 6000]
  Top Bounds: (0.0651,0,-0.59375) -> (353.486,607.499,463.126)
  Bot Bounds: (-353.686,0,-0.59375) -> (-0.2651,607.499,463.126)
Analysis Parameters:
  Track Length Cut: 30 cm
  Fiducial Length: 20 cm
  Barycenter Radius: 10 cm
  Michel Space Radius: 20 cm
13-Jan-2026 14:32:17 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/d4/93/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_267115_60_1_20251212T074747Z_detsim_reco1.root"
%MSG-i Root_Information:  MichelAnalysis:checks@Construction TClass::Init()  13-Jan-2026 14:32:23 UTC ModuleConstruction
no dictionary for class sim::IDE is available
ROOT severity: 2000
%MSG
13-Jan-2026 14:32:24 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/d4/93/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_267115_60_1_20251212T074747Z_detsim_reco1.root"
db: runtime0
Begin processing the 1st record. run: 20250614 subRun: 1 event: 50 at 13-Jan-2026 14:32:26 UTC
%MSG-w PhotonBackTrackerService:  ProcessEvent 13-Jan-2026 14:32:34 UTC  run: 20250614 subRun: 1 event: 50
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
13-Jan-2026 14:32:42 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/hd-protodune/d4/93/pdhd_prod_beam__gen_g4_IonScintPDExt_PDInt_267115_60_1_20251212T074747Z_detsim_reco1.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                          6.84836       6.84836       6.84836       6.84836          0            1     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)             0.0189688     0.0189688     0.0189688     0.0189688         0            1     
end_path:checks:MichelAnalysis      6.8283        6.8283        6.8283        6.8283           0            1     
====================================================================================================================
%MSG-i NuRandomService:  MichelAnalysis:checks@EndJob 13-Jan-2026 14:32:42 UTC  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 695829107
  seed within: [ 1 ; 900000000 ]

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 1 passed = 1 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport          1          1          0 checks

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 14.905394 Real = 15.773684

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 20243.7 VmHWM = 2109.87

ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 4 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
Art has completed and will exit with status 0.
/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python: No module named meta_maker
meta_maker.py failed
justIN time: 2026-02-04 07:15:33 UTC       justIN version: 01.06.00