justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242367.28@dunegpschedd01.fnal.gov

Jobsub ID242367.28@dunegpschedd01.fnal.gov
Workflow ID9551
Stage ID1
User nameimawby@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit43200 (12 hours)
Submitted time2025-11-03 13:08:53
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2025-11-03 13:36:00
From worker nodeHostnameiut2-c266.iu.edu
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 13:26:24
Input filesfardet-hd:nu_dune10kt_1x2x6_1123_863_20230828T124905Z_gen_g4_detsim_hitreco__20240223T003727Z_reco2.root
JobscriptExit code0
Real time9m (559s)
CPU time8m (500s = 89%)
Max RSS bytes1270591488 (1211 MiB)
Outputting started2025-11-03 13:35:44
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/imawby/splitting_nu_3/fnal/09551/1/001/CheatingKalmanSplittingU_nu_dune10kt_1x2x6_1123_863_20230828T124905Z_gen_g4_detsim_hitreco__20240223T003727Z_reco2.root
Finished2025-11-03 13:36:00
Saved logsjustin-logs:242367.28-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_08_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e
MRB_SOURCE=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e/srcs
MRB_BUILDDIR=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e/localProducts_larsoft_v10_08_00_e26_prof

PRODUCTS=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e/localProducts_larsoft_v10_08_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e/localProducts_larsoft_v10_08_00_e26_prof

local product directory is /cvmfs/fifeuser4.opensciencegrid.org/sw/dune/beb6b236fa7313969dbb0b461feed43d0063fa2e/localProducts_larsoft_v10_08_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7b/aa/nu_dune10kt_1x2x6_1123_863_20230828T124905Z_gen_g4_detsim_hitreco__20240223T003727Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
clusterHits.size():498
hitType: 4
clusterHits.size():60
hitType: 4
Begin processing the 89th record. run: 1123 subRun: 1 event: 86389 at 03-Nov-2025 08:34:46 EST
clusterHits.size():778
hitType: 4
Begin processing the 90th record. run: 1123 subRun: 1 event: 86390 at 03-Nov-2025 08:34:50 EST
clusterHits.size():1475
hitType: 4
Begin processing the 91st record. run: 1123 subRun: 1 event: 86391 at 03-Nov-2025 08:34:55 EST
clusterHits.size():1329
hitType: 4
clusterHits.size():560
hitType: 4
clusterHits.size():54
hitType: 4
Begin processing the 92nd record. run: 1123 subRun: 1 event: 86392 at 03-Nov-2025 08:34:59 EST
clusterHits.size():96
hitType: 4
Begin processing the 93rd record. run: 1123 subRun: 1 event: 86393 at 03-Nov-2025 08:35:03 EST
clusterHits.size():80
hitType: 4
Begin processing the 94th record. run: 1123 subRun: 1 event: 86394 at 03-Nov-2025 08:35:08 EST
clusterHits.size():426
hitType: 4
clusterHits.size():68
hitType: 4
Begin processing the 95th record. run: 1123 subRun: 1 event: 86395 at 03-Nov-2025 08:35:12 EST
clusterHits.size():1047
hitType: 4
clusterHits.size():74
hitType: 4
Begin processing the 96th record. run: 1123 subRun: 1 event: 86396 at 03-Nov-2025 08:35:17 EST
clusterHits.size():1462
hitType: 4
clusterHits.size():92
hitType: 4
clusterHits.size():56
hitType: 4
clusterHits.size():86
hitType: 4
clusterHits.size():153
hitType: 4
clusterHits.size():97
hitType: 4
clusterHits.size():629
hitType: 4
clusterHits.size():72
hitType: 4
Begin processing the 97th record. run: 1123 subRun: 1 event: 86397 at 03-Nov-2025 08:35:24 EST
clusterHits.size():194
hitType: 4
clusterHits.size():59
hitType: 4
clusterHits.size():131
hitType: 4
clusterHits.size():117
hitType: 4
clusterHits.size():50
hitType: 4
clusterHits.size():86
hitType: 4
clusterHits.size():170
hitType: 4
Begin processing the 98th record. run: 1123 subRun: 1 event: 86398 at 03-Nov-2025 08:35:29 EST
clusterHits.size():71
hitType: 4
clusterHits.size():80
hitType: 4
clusterHits.size():265
hitType: 4
Begin processing the 99th record. run: 1123 subRun: 1 event: 86399 at 03-Nov-2025 08:35:34 EST
clusterHits.size():67
hitType: 4
Begin processing the 100th record. run: 1123 subRun: 1 event: 86400 at 03-Nov-2025 08:35:38 EST
clusterHits.size():75
hitType: 4
03-Nov-2025 08:35:43 EST  Closed output file "nu_dune10kt_1x2x6_1123_863_20230828T124905Z_gen_g4_detsim_hitreco__20240223T003727Z_reco2_reco2.root"
03-Nov-2025 08:35:43 EST  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/7b/aa/nu_dune10kt_1x2x6_1123_863_20230828T124905Z_gen_g4_detsim_hitreco__20240223T003727Z_reco2.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.0718483      4.10986       7.36472       4.13586      0.963912        100    
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                         0.0123538     0.0254938     0.156096      0.0239329     0.015484        100    
reco:pandora:StandardPandora                   0.0523957      4.07675       7.34201       4.09644      0.960761        100    
[art]:TriggerResults:TriggerResultInserter    1.9307e-05    3.35885e-05   0.000129203   3.1938e-05    1.14721e-05      100    
end_path:out1:RootOutput                       3.727e-06    7.70089e-06   3.5036e-05     7.474e-06    3.53663e-06      100    
end_path:out1:RootOutput(write)               0.00162941    0.00729874     0.0212104    0.00665517    0.00453629       100    
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 2251.58 MB
  Peak resident set size usage (VmHWM): 1270.59 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
mv: cannot stat 'CheatingKalmanSplittingV.root': No such file or directory
mv: cannot stat 'CheatingKalmanSplittingW.root': No such file or directory
justIN time: 2026-02-11 12:21:47 UTC       justIN version: 01.06.00