justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 243524.0@dunegpschedd01.fnal.gov

Jobsub ID243524.0@dunegpschedd01.fnal.gov
Workflow ID9616
Stage ID1
User nameepennacc@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-11-05 13:07:22
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc01
Last heartbeat2025-11-05 13:17:12
From worker nodeHostnamewn-la-25.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Started2025-11-05 13:08:24
Input filesfardet-hd:prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-11-05 13:17:12
Saved logsjustin-logs:243524.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

evel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x585fd10
StandardRawDigitPrepService::ctor:   Extract service: @0x63d5130
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x2708cc0
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x17ff030
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x17ff0a0
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
05-Nov-2025 14:08:57 CET  Initiating request to open input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/48/73/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim.root"
05-Nov-2025 14:08:59 CET  Opened input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/48/73/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim.root"
Begin processing the 1st record. run: 1845 subRun: 0 event: 6051 at 05-Nov-2025 14:09:00 CET
05-Nov-2025 14:09:09 CET  Opened output file with pattern "prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim_20251105T130836Z_reco.root"
Begin processing the 2nd record. run: 1845 subRun: 0 event: 6052 at 05-Nov-2025 14:09:30 CET
Begin processing the 3rd record. run: 1845 subRun: 0 event: 6053 at 05-Nov-2025 14:09:39 CET
Begin processing the 4th record. run: 1845 subRun: 0 event: 6054 at 05-Nov-2025 14:09:47 CET
Begin processing the 5th record. run: 1845 subRun: 0 event: 6055 at 05-Nov-2025 14:09:56 CET
Begin processing the 6th record. run: 1845 subRun: 0 event: 6056 at 05-Nov-2025 14:10:05 CET
Begin processing the 7th record. run: 1845 subRun: 0 event: 6057 at 05-Nov-2025 14:10:13 CET
Begin processing the 8th record. run: 1845 subRun: 0 event: 6058 at 05-Nov-2025 14:10:22 CET
Begin processing the 9th record. run: 1845 subRun: 0 event: 6059 at 05-Nov-2025 14:10:31 CET
Begin processing the 10th record. run: 1845 subRun: 0 event: 6060 at 05-Nov-2025 14:10:39 CET
Begin processing the 11th record. run: 1845 subRun: 0 event: 6061 at 05-Nov-2025 14:10:47 CET
Begin processing the 12th record. run: 1845 subRun: 0 event: 6062 at 05-Nov-2025 14:10:56 CET
Begin processing the 13th record. run: 1845 subRun: 0 event: 6063 at 05-Nov-2025 14:11:04 CET
Begin processing the 14th record. run: 1845 subRun: 0 event: 6064 at 05-Nov-2025 14:11:12 CET
Begin processing the 15th record. run: 1845 subRun: 0 event: 6065 at 05-Nov-2025 14:11:19 CET
Begin processing the 16th record. run: 1845 subRun: 0 event: 6066 at 05-Nov-2025 14:11:28 CET
Begin processing the 17th record. run: 1845 subRun: 0 event: 6067 at 05-Nov-2025 14:11:36 CET
Begin processing the 18th record. run: 1845 subRun: 0 event: 6068 at 05-Nov-2025 14:11:45 CET
Begin processing the 19th record. run: 1845 subRun: 0 event: 6069 at 05-Nov-2025 14:11:54 CET
Begin processing the 20th record. run: 1845 subRun: 0 event: 6070 at 05-Nov-2025 14:12:03 CET
Begin processing the 21st record. run: 1845 subRun: 0 event: 6071 at 05-Nov-2025 14:12:11 CET
Begin processing the 22nd record. run: 1845 subRun: 0 event: 6072 at 05-Nov-2025 14:12:20 CET
Begin processing the 23rd record. run: 1845 subRun: 0 event: 6073 at 05-Nov-2025 14:12:29 CET
Begin processing the 24th record. run: 1845 subRun: 0 event: 6074 at 05-Nov-2025 14:12:37 CET
Begin processing the 25th record. run: 1845 subRun: 0 event: 6075 at 05-Nov-2025 14:12:46 CET
Begin processing the 26th record. run: 1845 subRun: 0 event: 6076 at 05-Nov-2025 14:12:55 CET
Begin processing the 27th record. run: 1845 subRun: 0 event: 6077 at 05-Nov-2025 14:13:03 CET
Begin processing the 28th record. run: 1845 subRun: 0 event: 6078 at 05-Nov-2025 14:13:12 CET
Begin processing the 29th record. run: 1845 subRun: 0 event: 6079 at 05-Nov-2025 14:13:21 CET
Begin processing the 30th record. run: 1845 subRun: 0 event: 6080 at 05-Nov-2025 14:13:29 CET
Begin processing the 31st record. run: 1845 subRun: 0 event: 6081 at 05-Nov-2025 14:13:38 CET
Begin processing the 32nd record. run: 1845 subRun: 0 event: 6082 at 05-Nov-2025 14:13:46 CET
Begin processing the 33rd record. run: 1845 subRun: 0 event: 6083 at 05-Nov-2025 14:13:55 CET
Begin processing the 34th record. run: 1845 subRun: 0 event: 6084 at 05-Nov-2025 14:14:03 CET
Begin processing the 35th record. run: 1845 subRun: 0 event: 6085 at 05-Nov-2025 14:14:12 CET
Begin processing the 36th record. run: 1845 subRun: 0 event: 6086 at 05-Nov-2025 14:14:21 CET
Begin processing the 37th record. run: 1845 subRun: 0 event: 6087 at 05-Nov-2025 14:14:29 CET
Begin processing the 38th record. run: 1845 subRun: 0 event: 6088 at 05-Nov-2025 14:14:38 CET
Begin processing the 39th record. run: 1845 subRun: 0 event: 6089 at 05-Nov-2025 14:14:47 CET
Begin processing the 40th record. run: 1845 subRun: 0 event: 6090 at 05-Nov-2025 14:14:55 CET
Begin processing the 41st record. run: 1845 subRun: 0 event: 6091 at 05-Nov-2025 14:15:04 CET
Begin processing the 42nd record. run: 1845 subRun: 0 event: 6092 at 05-Nov-2025 14:15:13 CET
Begin processing the 43rd record. run: 1845 subRun: 0 event: 6093 at 05-Nov-2025 14:15:21 CET
Begin processing the 44th record. run: 1845 subRun: 0 event: 6094 at 05-Nov-2025 14:15:30 CET
Begin processing the 45th record. run: 1845 subRun: 0 event: 6095 at 05-Nov-2025 14:15:38 CET
Begin processing the 46th record. run: 1845 subRun: 0 event: 6096 at 05-Nov-2025 14:15:47 CET
Begin processing the 47th record. run: 1845 subRun: 0 event: 6097 at 05-Nov-2025 14:15:56 CET
Begin processing the 48th record. run: 1845 subRun: 0 event: 6098 at 05-Nov-2025 14:16:04 CET
Begin processing the 49th record. run: 1845 subRun: 0 event: 6099 at 05-Nov-2025 14:16:13 CET
Begin processing the 50th record. run: 1845 subRun: 0 event: 6100 at 05-Nov-2025 14:16:22 CET
05-Nov-2025 14:16:32 CET  Closed output file "prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim_20251105T130836Z_reco.root"
05-Nov-2025 14:16:32 CET  Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/fardet-hd/48/73/prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim.root"

=========================================================================================================================================
TimeTracker printout (sec)                                 Min           Avg           Max         Median          RMS         nEvts   
=========================================================================================================================================
Full event                                               7.55289       8.36856       8.61867       8.44122      0.203798        50     
-----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.000310454   0.00205886     0.017124     0.000377985   0.00478114       50     
makers:tpmakerTPCsimpleThr:TriggerPrimitiveMakerTPC      4.05209       4.52095       4.70001       4.55051      0.110552        50     
makers:tpmakerTPCabsRS:TriggerPrimitiveMakerTPC          3.46996       3.84271       3.92962       3.88402      0.106856        50     
[art]:TriggerResults:TriggerResultInserter             2.0801e-05    2.70772e-05   9.3691e-05    2.4737e-05     1.064e-05       50     
end_path:out1:RootOutput                                4.687e-06    6.10176e-06   4.2233e-05     5.303e-06    5.17341e-06      50     
end_path:out1:RootOutput(write)                        0.00188027    0.00217404    0.00330244    0.00213296    0.000214798      50     
=========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1535.15 MB
  Peak resident set size usage (VmHWM): 803.537 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_flat_cc_dune10kt_1x2x2_20250826T091438Z_gen_000122_supernova_g4_detsim_20251105T130836Z_reco.root
Failed to extract md
justIN time: 2026-02-11 07:35:57 UTC       justIN version: 01.06.00