justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301923.1@dunegpschedd01.fnal.gov

Jobsub ID301923.1@dunegpschedd01.fnal.gov
Workflow ID12473
Stage ID1
User nameskar@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-28 11:42:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-28 11:45:25
From worker nodeHostnamedunegli-8463070-0-fnpc23031.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 11:43:13
Input filesfardet-hd:nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root
JobscriptExit code0
Real time1m (108s)
CPU time1m (69s = 63%)
Max RSS bytes11056103424 (10543 MiB)
Outputting started2026-01-28 11:45:01
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/skar/fnal/12473/1/001/nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2_ana_2026-01-28T_114326Z.root
Finished2026-01-28 11:45:25
Saved logsjustin-logs:301923.1-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/64/nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:23 UTC run: 1098 subRun: 1 event: 31703
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 4th record. run: 1098 subRun: 1 event: 31704 at 28-Jan-2026 11:44:25 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 5th record. run: 1098 subRun: 1 event: 31705 at 28-Jan-2026 11:44:27 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 6th record. run: 1098 subRun: 1 event: 31706 at 28-Jan-2026 11:44:27 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Begin processing the 7th record. run: 1098 subRun: 1 event: 31707 at 28-Jan-2026 11:44:28 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Found this many showers 1
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:28 UTC run: 1098 subRun: 1 event: 31707
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1098 subRun: 1 event: 31708 at 28-Jan-2026 11:44:29 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 9
Begin processing the 9th record. run: 1098 subRun: 1 event: 31709 at 28-Jan-2026 11:44:39 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no vertex found for PFParticle with ID 5
Warning: there was no track found for track-like PFParticle with ID 5
Warning: there was no track found for track-like PFParticle with ID 6
Found this many showers 6
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:40 UTC run: 1098 subRun: 1 event: 31709
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 10th record. run: 1098 subRun: 1 event: 31710 at 28-Jan-2026 11:44:42 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there were 13 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no vertex found for PFParticle with ID 13
Warning: there was no track found for track-like PFParticle with ID 13
Warning: there was no vertex found for PFParticle with ID 14
Warning: there was no track found for track-like PFParticle with ID 14
Warning: there was no vertex found for PFParticle with ID 15
Warning: there was no track found for track-like PFParticle with ID 15
Warning: there were 17 reconstructed PFParticle daughters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 17
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:44:50 UTC run: 1098 subRun: 1 event: 31710
the pmtrajfit track #0 has 2039 hits on calorimetry plane #2, only 2000 stored in tree
%MSG
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:44:50 UTC run: 1098 subRun: 1 event: 31710
the pmtrajfit track #0 has 2786 hits on calorimetry plane #1, only 2000 stored in tree
%MSG
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:44:50 UTC run: 1098 subRun: 1 event: 31710
the pmtrajfit track #0 has 3394 hits on calorimetry plane #0, only 2000 stored in tree
%MSG
Found this many showers 17
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:53 UTC run: 1098 subRun: 1 event: 31710
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:45:00 UTC  Closed output file "nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2_ana_2026-01-28T_114326Z.root"
28-Jan-2026 11:45:00 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/64/nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.398303       4.19479       16.4901       2.38997       4.78481        10     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.0017478     0.0080425     0.0194633    0.00270772    0.00726125       10     
end_path:out1:RootOutput                         3.607e-06    1.50296e-05   9.8869e-05     6.167e-06    2.79597e-05      10     
end_path:analysistree:AnalysisTree               0.0478668      1.81537       8.04523      0.787595       2.47925        10     
end_path:pmtrackeff:NeutrinoTrackingEff         0.000127364    0.0295264     0.211113     0.00414071     0.0615462       10     
end_path:pmtracktceff:NeutrinoTrackingEff       2.1972e-05     0.0357992     0.270205     0.00264163     0.0795017       10     
end_path:pandoraeff:NeutrinoTrackingEff         1.8886e-05     0.0156923     0.0892223    0.00271267     0.0261172       10     
end_path:pmtrajfiteff:NeutrinoTrackingEff       1.7313e-05     0.0166424     0.0938856    0.00448145     0.027424        10     
end_path:pmtrajfittceff:NeutrinoTrackingEff     1.6742e-05     0.0724895     0.593226     0.00803824      0.17447        10     
end_path:pandorashweff:NeutrinoShowerEff        2.2423e-05     0.0406491      0.29009     0.00499062     0.0849274       10     
end_path:emshowershweff:NeutrinoShowerEff       1.8345e-05    0.00023365    0.000748974   0.000185079   0.000218405      10     
end_path:trajclustershweff:NeutrinoShowerEff    1.8255e-05    0.00592934     0.0255863    0.00202859    0.00810711       10     
end_path:runcheckereco:CheckRecoEnergy          1.6882e-05    6.32511e-05   0.000331826    3.139e-05    9.1097e-05       10     
end_path:flashmatchAna:FlashMatchAna            0.00177717     0.106017      0.419748      0.048733      0.125533        10     
end_path:out1:RootOutput(write)                  0.345232       2.04705       6.46887       1.53114       1.80984        10     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 20849.4 MB
  Peak resident set size usage (VmHWM): 11056.1 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 18:09:25 UTC       justIN version: 01.06.00