justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 257564.86@dunegpschedd02.fnal.gov

Jobsub ID257564.86@dunegpschedd02.fnal.gov
Workflow ID10989
Stage ID1
User namechasnip@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-12-04 11:07:26
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-12-04 13:20:48
From worker nodeHostnamedunegli-7813185-0-fnpc18004.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes7864320000 (7500 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-12-04 11:28:02
Input filesmonte-carlo-010989-000468
JobscriptExit code0
Real time1h (6692s)
CPU time1h (6609s = 98%)
Max RSS bytes4776083456 (4554 MiB)
Outputting started2025-12-04 13:19:35
Output filesusertests:prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim_trigger.root
Finished2025-12-04 13:20:48
Saved logsjustin-logs:257564.86-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ssing the 1st record. run: 1 subRun: 0 event: 1 at 04-Dec-2025 13:17:29 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 04-Dec-2025 13:17:44 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 3rd record. run: 1 subRun: 0 event: 3 at 04-Dec-2025 13:17:55 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 4th record. run: 1 subRun: 0 event: 4 at 04-Dec-2025 13:18:05 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 04-Dec-2025 13:18:16 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 6th record. run: 1 subRun: 0 event: 6 at 04-Dec-2025 13:18:30 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 7th record. run: 1 subRun: 0 event: 7 at 04-Dec-2025 13:18:42 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 8th record. run: 1 subRun: 0 event: 8 at 04-Dec-2025 13:18:53 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 9th record. run: 1 subRun: 0 event: 9 at 04-Dec-2025 13:19:04 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 04-Dec-2025 13:19:16 UTC
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor:  Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 4 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcSampleFiller:   0.00 sec
ToolBasedRawDigitPrepService:dtor:                adcScaleAdcToKe:   0.00 sec
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   0.00 sec
Art has completed and will exit with status 0.
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available

Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_12_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
04-Dec-2025 13:17:28 UTC  Initiating request to open input file "prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim.root"
04-Dec-2025 13:17:29 UTC  Opened input file "prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim.root"
04-Dec-2025 13:17:42 UTC  Opened output file with pattern "prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim_trigger.root"
04-Dec-2025 13:19:29 UTC  Closed output file "prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim_trigger.root"
04-Dec-2025 13:19:29 UTC  Closed input file "prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      3.73734       4.1644        4.61749       4.17831      0.209695        10     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0003067    0.000479683   0.00133447    0.000349079   0.000294488      10     
makers:tpmakerTPC:TriggerPrimitiveMakerTPC      3.65103       4.09062       4.50621       4.10199      0.198429        10     
makers:tamakerTPC:TriggerActivityMakerTPC      0.0146578     0.0365251     0.067288      0.0363731     0.0160851       10     
makers:tcmakerTPC:TriggerCandidateMakerTPC    5.0045e-05    0.000127381   0.000607368   7.54825e-05   0.000160306      10     
[art]:TriggerResults:TriggerResultInserter    1.4848e-05    2.48199e-05   6.8359e-05    2.09795e-05    1.466e-05       10     
end_path:out1:RootOutput                       4.468e-06    7.3838e-06    3.0969e-05    4.5485e-06    7.8738e-06       10     
end_path:out1:RootOutput(write)                0.0192651     0.0358272     0.0560364     0.0372405     0.0116696       10     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3071.08 MB
  Peak resident set size usage (VmHWM): 2362.21 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'prod_protodunehd_beamneutrino_1_257564_86_1764847697_gen_g4_detsim_trigger.root', 'start_time': 1764854197.94014, 'end_time': 1764854370.496371}
justIN time: 2025-12-19 20:17:57 UTC       justIN version: 01.05.03