Jobsub ID 257563.107@dunegpschedd02.fnal.gov
| Jobsub ID | 257563.107@dunegpschedd02.fnal.gov |
| Workflow ID | 10989 |
| Stage ID | 1 |
| User name | chasnip@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 6291456000 (6000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2025-12-04 11:05:26 |
| Site | CA_SFU |
| Entry | DUNE_CA_SFU_lcg-ce3 |
| Last heartbeat | 2025-12-04 11:40:25 |
| From worker node | Hostname | fc30561.int.fir.alliancecan.ca |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 7864320000 (7500 MiB) |
| Wall seconds limit | 84598 (23 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | stalled |
| Started | 2025-12-04 11:09:10 |
| Input files | monte-carlo-010989-000295
|
| Outputting started | 2025-12-04 11:40:25 |
| Output files | |
| Finished | 2025-12-04 12:42:29 |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e 1st record. run: 1 subRun: 0 event: 1 at 04-Dec-2025 03:39:48 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 2nd record. run: 1 subRun: 0 event: 2 at 04-Dec-2025 03:39:52 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 3rd record. run: 1 subRun: 0 event: 3 at 04-Dec-2025 03:39:56 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 4th record. run: 1 subRun: 0 event: 4 at 04-Dec-2025 03:39:59 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 5th record. run: 1 subRun: 0 event: 5 at 04-Dec-2025 03:40:03 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 6th record. run: 1 subRun: 0 event: 6 at 04-Dec-2025 03:40:06 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 7th record. run: 1 subRun: 0 event: 7 at 04-Dec-2025 03:40:09 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 8th record. run: 1 subRun: 0 event: 8 at 04-Dec-2025 03:40:13 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 9th record. run: 1 subRun: 0 event: 9 at 04-Dec-2025 03:40:16 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
Begin processing the 10th record. run: 1 subRun: 0 event: 10 at 04-Dec-2025 03:40:19 PST
Creating Maker on Plane C:0 S:0 P:0
Creating Maker on Plane C:0 S:0 P:1
Creating Maker on Plane C:0 S:0 P:2
Creating Maker on Plane C:0 S:1 P:0
Creating Maker on Plane C:0 S:1 P:1
Creating Maker on Plane C:0 S:1 P:2
Creating Maker on Plane C:0 S:2 P:0
Creating Maker on Plane C:0 S:2 P:1
Creating Maker on Plane C:0 S:2 P:2
Creating Maker on Plane C:0 S:3 P:0
Creating Maker on Plane C:0 S:3 P:1
Creating Maker on Plane C:0 S:3 P:2
Created 0 TCs
ToolBasedRawDigitPrepService:dtor: Event count: 0
ToolBasedRawDigitPrepService:dtor: Call count: 0
ToolBasedRawDigitPrepService:dtor: Time report for 4 tools.
ToolBasedRawDigitPrepService:dtor: digitReader: 0.00 sec
ToolBasedRawDigitPrepService:dtor: adcSampleFiller: 0.00 sec
ToolBasedRawDigitPrepService:dtor: adcScaleAdcToKe: 0.00 sec
ToolBasedRawDigitPrepService:dtor: pdspTailPedRemovalZKe: 0.00 sec
Art has completed and will exit with status 0.
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Stderr:
Info in <TGeoManager::Import>: Reading geometry from file: /cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_12_02d00/gdml/protodunehd_v6_refactored.gdml
Info in <TGeoManager::TGeoManager>: Geometry GDMLImport, Geometry imported from GDML created
Info in <TGeoManager::SetTopVolume>: Top volume is volWorld. Master volume is volWorld
Info in <TGeoNavigator::BuildCache>: --- Maximum geometry depth set to 100
Info in <TGeoManager::CheckGeometry>: Fixing runtime shapes...
Info in <TGeoManager::CheckGeometry>: ...Nothing to fix
Info in <TGeoManager::CloseGeometry>: Counting nodes...
Info in <TGeoManager::Voxelize>: Voxelizing...
Info in <TGeoManager::CloseGeometry>: Building cache...
Info in <TGeoManager::CountLevels>: max level = 5, max placements = 1148
Info in <TGeoManager::CloseGeometry>: 25610 nodes/ 5537 volume UID's in Geometry imported from GDML
Info in <TGeoManager::CloseGeometry>: ----------------modeler ready----------------
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
04-Dec-2025 03:39:48 PST Initiating request to open input file "prod_protodunehd_beamneutrino_1_257563_107_1764846555_gen_g4_detsim.root"
04-Dec-2025 03:39:48 PST Opened input file "prod_protodunehd_beamneutrino_1_257563_107_1764846555_gen_g4_detsim.root"
04-Dec-2025 03:39:52 PST Opened output file with pattern "prod_protodunehd_beamneutrino_1_257563_107_1764846555_gen_g4_detsim_trigger.root"
04-Dec-2025 03:40:23 PST Closed output file "prod_protodunehd_beamneutrino_1_257563_107_1764846555_gen_g4_detsim_trigger.root"
04-Dec-2025 03:40:23 PST Closed input file "prod_protodunehd_beamneutrino_1_257563_107_1764846555_gen_g4_detsim.root"
================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
================================================================================================================================
Full event 1.47751 1.51293 1.55908 1.50757 0.0268456 10
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000210919 0.000313427 0.000568929 0.000299365 9.66738e-05 10
makers:tpmakerTPC:TriggerPrimitiveMakerTPC 1.46014 1.49253 1.53251 1.48571 0.0236647 10
makers:tamakerTPC:TriggerActivityMakerTPC 0.00492411 0.00886249 0.0130696 0.00801648 0.00277808 10
makers:tcmakerTPC:TriggerCandidateMakerTPC 3.098e-05 6.01521e-05 0.00020876 4.71005e-05 4.99057e-05 10
[art]:TriggerResults:TriggerResultInserter 8.29e-06 1.2665e-05 2.582e-05 1.1415e-05 4.61708e-06 10
end_path:out1:RootOutput 3.54e-06 5.63e-06 1.306e-05 5.025e-06 2.57093e-06 10
end_path:out1:RootOutput(write) 0.00649888 0.0107747 0.0136603 0.0111257 0.00228267 10
================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 2935.21 MB
Peak resident set size usage (VmHWM): 2226.84 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_protodunehd_beamneutrino_1_257563_107_1764846555_gen_g4_detsim_trigger.root', 'start_time': 1764848373.9207463, 'end_time': 1764848424.147624} 