justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 249242.3@dunegpschedd02.fnal.gov

Jobsub ID249242.3@dunegpschedd02.fnal.gov
Workflow ID10459
Stage ID1
User nameimawby@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes1048576000 (1000 MiB)
Wall seconds limit7200 (2 hours)
Submitted time2025-11-21 13:57:28
SiteUS_UCSD
EntryCMSHTPC_T2_US_UCSD_gw6
Last heartbeat2025-11-21 15:03:34
From worker nodeHostnamemh-7763-2.t2.ucsd.edu
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes1048576000 (1000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-21 13:58:33
Input filesfardet-hd:nu_dune10kt_1x2x6_1427_177_20230827T213345Z_gen_g4_detsim_hitreco__20240224T094212Z_reco2.root
JobscriptExit code0
Real time1h (3882s)
CPU time6m (368s = 9%)
Max RSS bytes1263923200 (1205 MiB)
Outputting started2025-11-21 15:03:16
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/metrics_nu_0/fnal/10459/1/001/Validation_nu_dune10kt_1x2x6_1427_177_20230827T213345Z_gen_g4_detsim_hitreco__20240224T094212Z_reco2.root
Finished2025-11-21 15:03:34
Saved logsjustin-logs:249242.3-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_13_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b
MRB_SOURCE=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b/srcs
MRB_BUILDDIR=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b/localProducts_larsoft_v10_13_00_e26_prof

PRODUCTS=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b/localProducts_larsoft_v10_13_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b/localProducts_larsoft_v10_13_00_e26_prof

local product directory is /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/b60726f83326265f7849d35b2a1763ddcb86787b/localProducts_larsoft_v10_13_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f9/c8/nu_dune10kt_1x2x6_1427_177_20230827T213345Z_gen_g4_detsim_hitreco__20240224T094212Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
initialRegionL: 13.0853
initialRegionL: 11.5002
initialRegionL: 11.5021
initialRegionL: 6.92209
initialRegionL: 13.9801
initialRegionL: 12.1045
initialRegionL: 8.94477
initialRegionL: 13.3333
initialRegionL: 13.4155
initialRegionL: 13.5772
initialRegionL: 7.57414
initialRegionL: 13.0193
Begin processing the 96th record. run: 1427 subRun: 1 event: 17796 at 21-Nov-2025 07:02:39 PST
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
Begin processing the 97th record. run: 1427 subRun: 1 event: 17797 at 21-Nov-2025 07:02:41 PST
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
initialRegionL: 11.0147
initialRegionL: 13.9844
initialRegionL: 13.1092
Begin processing the 98th record. run: 1427 subRun: 1 event: 17798 at 21-Nov-2025 07:02:44 PST
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
initialRegionL: 11.6144
initialRegionL: 11.7532
initialRegionL: 13.9994
initialRegionL: 11.0471
initialRegionL: 13.5213
initialRegionL: 11.802
initialRegionL: 13.9204
initialRegionL: 7.48051
initialRegionL: 11.3436
initialRegionL: 12.4099
initialRegionL: 10.227
initialRegionL: 13.8709
initialRegionL: 6.54766
initialRegionL: 9.76308
initialRegionL: 2.36558
initialRegionL: 13.986
initialRegionL: 12.4885
initialRegionL: 13.3292
Begin processing the 99th record. run: 1427 subRun: 1 event: 17799 at 21-Nov-2025 07:02:58 PST
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
initialRegionL: 12.7059
initialRegionL: 9.68
initialRegionL: 13.755
initialRegionL: 8.91343
initialRegionL: 13.4765
initialRegionL: 13.3192
initialRegionL: 1.59722
initialRegionL: 13.5609
initialRegionL: 9.02005
initialRegionL: 10.4024
initialRegionL: 13.1078
initialRegionL: 13.729
initialRegionL: 13.0926
initialRegionL: 8.87225
initialRegionL: 13.5251
initialRegionL: 13.8733
initialRegionL: 11.5731
initialRegionL: 13.504
Begin processing the 100th record. run: 1427 subRun: 1 event: 17800 at 21-Nov-2025 07:03:06 PST
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
initialRegionL: 12.189
initialRegionL: 10.4811
initialRegionL: 13.9221
initialRegionL: 9.09063
initialRegionL: 13.2713
initialRegionL: 13.4713
initialRegionL: 7.43393
initialRegionL: 13.119
initialRegionL: 9.46588
initialRegionL: 9.81546
initialRegionL: 13.46
initialRegionL: 13.4812
21-Nov-2025 07:03:15 PST  Closed output file "nu_dune10kt_1x2x6_1427_177_20230827T213345Z_gen_g4_detsim_hitreco__20240224T094212Z_reco2_reco2.root"
21-Nov-2025 07:03:15 PST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f9/c8/nu_dune10kt_1x2x6_1427_177_20230827T213345Z_gen_g4_detsim_hitreco__20240224T094212Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      0.39742       3.5576        75.7246       1.69483       9.03138        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0958943     0.104865      0.131663      0.104089     0.00758046       100    
reco:pandora:StandardPandora                   0.299062       3.44155       75.5428       1.59303       9.02178        100    
[art]:TriggerResults:TriggerResultInserter     1.034e-05    3.03913e-05   0.000347981   1.93705e-05   4.6069e-05       100    
end_path:out1:RootOutput                       2.39e-06     3.38073e-06    1.689e-05     3.055e-06    1.5257e-06       100    
end_path:out1:RootOutput(write)               0.000813561    0.0109431     0.0839301    0.00762772     0.0119009       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2352.03 MB
  Peak resident set size usage (VmHWM): 1263.92 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
justIN time: 2025-12-19 17:06:04 UTC       justIN version: 01.05.03