justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296473.118@dunegpschedd02.fnal.gov

Jobsub ID296473.118@dunegpschedd02.fnal.gov
Workflow ID12511
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2026-01-29 10:23:50
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2026-01-29 10:33:01
From worker nodeHostnamewn-da-06.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-29 10:25:41
Input filesfardet-hd:nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root
JobscriptExit code0
Real time6m (387s)
CPU time5m (357s = 92%)
Max RSS bytes1196072960 (1140 MiB)
Outputting started2026-01-29 10:32:09
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/kalmanAlg_CHECK_nu_0/fnal/12511/1/001/ClusterValidation_WithAlg_nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root
Finished2026-01-29 10:33:01
Saved logsjustin-logs:296473.118-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_17_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954
MRB_SOURCE=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954/srcs
MRB_BUILDDIR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954/localProducts_larsoft_v10_17_00_e26_prof

PRODUCTS=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954/localProducts_larsoft_v10_17_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954/localProducts_larsoft_v10_17_00_e26_prof

local product directory is /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/07a864404679176cbcba8ffec28910705f208954/localProducts_larsoft_v10_17_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/ba/f4/nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Begin processing the 75th record. run: 1410 subRun: 1 event: 32975 at 29-Jan-2026 11:30:25 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 76th record. run: 1410 subRun: 1 event: 32976 at 29-Jan-2026 11:30:28 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 77th record. run: 1410 subRun: 1 event: 32977 at 29-Jan-2026 11:30:30 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 78th record. run: 1410 subRun: 1 event: 32978 at 29-Jan-2026 11:30:50 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 79th record. run: 1410 subRun: 1 event: 32979 at 29-Jan-2026 11:30:52 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 80th record. run: 1410 subRun: 1 event: 32980 at 29-Jan-2026 11:30:55 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 81st record. run: 1410 subRun: 1 event: 32981 at 29-Jan-2026 11:31:02 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 82nd record. run: 1410 subRun: 1 event: 32982 at 29-Jan-2026 11:31:04 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 83rd record. run: 1410 subRun: 1 event: 32983 at 29-Jan-2026 11:31:07 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 84th record. run: 1410 subRun: 1 event: 32984 at 29-Jan-2026 11:31:10 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 85th record. run: 1410 subRun: 1 event: 32985 at 29-Jan-2026 11:31:12 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 86th record. run: 1410 subRun: 1 event: 32986 at 29-Jan-2026 11:31:16 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 87th record. run: 1410 subRun: 1 event: 32987 at 29-Jan-2026 11:31:18 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 88th record. run: 1410 subRun: 1 event: 32988 at 29-Jan-2026 11:31:21 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 89th record. run: 1410 subRun: 1 event: 32989 at 29-Jan-2026 11:31:23 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 90th record. run: 1410 subRun: 1 event: 32990 at 29-Jan-2026 11:31:27 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 91st record. run: 1410 subRun: 1 event: 32991 at 29-Jan-2026 11:31:30 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 92nd record. run: 1410 subRun: 1 event: 32992 at 29-Jan-2026 11:31:34 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 93rd record. run: 1410 subRun: 1 event: 32993 at 29-Jan-2026 11:31:45 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 94th record. run: 1410 subRun: 1 event: 32994 at 29-Jan-2026 11:31:47 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 95th record. run: 1410 subRun: 1 event: 32995 at 29-Jan-2026 11:31:49 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 96th record. run: 1410 subRun: 1 event: 32996 at 29-Jan-2026 11:31:52 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 97th record. run: 1410 subRun: 1 event: 32997 at 29-Jan-2026 11:31:57 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 98th record. run: 1410 subRun: 1 event: 32998 at 29-Jan-2026 11:31:59 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 99th record. run: 1410 subRun: 1 event: 32999 at 29-Jan-2026 11:32:01 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 100th record. run: 1410 subRun: 1 event: 33000 at 29-Jan-2026 11:32:05 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
29-Jan-2026 11:32:08 CET  Closed output file "nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2_reco2.root"
29-Jan-2026 11:32:08 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/fardet-hd/ba/f4/nu_dune10kt_1x2x6_1410_329_20230826T123334Z_gen_g4_detsim_hitreco__20240229T175814Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      1.98922       3.0392        19.2402       2.42169       2.11262        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00349468    0.00833327     0.0250097    0.00502295    0.00613523       100    
reco:pandora:StandardPandora                    1.98064       3.01923       19.1881       2.39684       2.10407        100    
[art]:TriggerResults:TriggerResultInserter    1.1081e-05     2.241e-05    0.000145678   1.77185e-05   2.15721e-05      100    
end_path:out1:RootOutput                       2.957e-06    4.00953e-06   1.7073e-05     3.702e-06    1.93479e-06      100    
end_path:out1:RootOutput(write)               0.000964093    0.0114246     0.0490998    0.00895563     0.0103439       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2184.8 MB
  Peak resident set size usage (VmHWM): 1196.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2026-02-04 04:48:51 UTC       justIN version: 01.06.00