justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296289.6@dunegpschedd02.fnal.gov

Jobsub ID296289.6@dunegpschedd02.fnal.gov
Workflow ID12470
Stage ID1
User nameskar@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-28 11:30:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-28 11:33:36
From worker nodeHostnamedunegli-8464114-0-fnpc22004.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 11:31:52
Input filesfardet-hd:nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2.root
JobscriptExit code0
Real time0m (59s)
CPU time0m (52s = 88%)
Max RSS bytes12321476608 (11750 MiB)
Outputting started2026-01-28 11:32:52
Output filesusertests:nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2_ana_2026-01-28T_113158Z.root
Finished2026-01-28 11:33:36
Saved logsjustin-logs:296289.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/c7/nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Analysing.

Warning: there were 21 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no vertex found for PFParticle with ID 8
Warning: there was no track found for track-like PFParticle with ID 8
Warning: there was no track found for track-like PFParticle with ID 9
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:32:42 UTC run: 1410 subRun: 1 event: 24104
the pmtrajfit track #0 has 2351 hits on calorimetry plane #2, only 2000 stored in tree
%MSG
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:32:42 UTC run: 1410 subRun: 1 event: 24104
the pmtrajfit track #0 has 2010 hits on calorimetry plane #0, only 2000 stored in tree
%MSG
Found this many showers 9
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:42 UTC run: 1410 subRun: 1 event: 24104
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 5th record. run: 1410 subRun: 1 event: 24105 at 28-Jan-2026 11:32:44 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 6th record. run: 1410 subRun: 1 event: 24106 at 28-Jan-2026 11:32:45 UTC
Analysing.

Found this many showers 0
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:45 UTC run: 1410 subRun: 1 event: 24106
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 7th record. run: 1410 subRun: 1 event: 24107 at 28-Jan-2026 11:32:45 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 7
Found this many showers 7
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:45 UTC run: 1410 subRun: 1 event: 24107
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1410 subRun: 1 event: 24108 at 28-Jan-2026 11:32:47 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 5
Found this many showers 5
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:47 UTC run: 1410 subRun: 1 event: 24108
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 9th record. run: 1410 subRun: 1 event: 24109 at 28-Jan-2026 11:32:49 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 4
Found this many showers 4
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:49 UTC run: 1410 subRun: 1 event: 24109
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 10th record. run: 1410 subRun: 1 event: 24110 at 28-Jan-2026 11:32:50 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:50 UTC run: 1410 subRun: 1 event: 24110
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:32:51 UTC  Closed output file "nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2_ana_2026-01-28T_113158Z.root"
28-Jan-2026 11:32:51 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/c7/nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.230259       1.64091       3.33238       1.38479       1.05909        10     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                          0.00232852    0.00557193     0.0186444    0.00332051    0.00528439       10     
end_path:out1:RootOutput                         5.41e-06     2.30267e-05   0.000159042    8.03e-06     4.53626e-05      10     
end_path:analysistree:AnalysisTree               0.0182822     0.561932       1.31848       0.37428      0.477573        10     
end_path:pmtrackeff:NeutrinoTrackingEff         0.000201492   0.00461949     0.0168197    0.00296975    0.00496847       10     
end_path:pmtracktceff:NeutrinoTrackingEff       2.3765e-05    0.00358423     0.0122374    0.00185728    0.00398179       10     
end_path:pandoraeff:NeutrinoTrackingEff         2.1391e-05    0.00337617     0.0146121    0.00128919    0.00430461       10     
end_path:pmtrajfiteff:NeutrinoTrackingEff       1.9407e-05    0.00374817     0.0161387    0.00131964    0.00471193       10     
end_path:pmtrajfittceff:NeutrinoTrackingEff     2.1391e-05     0.0136338     0.0496836    0.00672504     0.0158035       10     
end_path:pandorashweff:NeutrinoShowerEff         7.388e-05     0.0131406     0.0739005    0.00470787     0.0212265       10     
end_path:emshowershweff:NeutrinoShowerEff       7.0584e-05    0.00023561    0.000554062   0.000192119   0.000148689      10     
end_path:trajclustershweff:NeutrinoShowerEff    6.2709e-05    0.00331719     0.0180401    0.00181736    0.00501303       10     
end_path:runcheckereco:CheckRecoEnergy          2.0679e-05    0.00010119    0.000441869   4.0387e-05    0.00013047       10     
end_path:flashmatchAna:FlashMatchAna            0.00296991     0.0385672     0.104818      0.0250503     0.0306546       10     
end_path:out1:RootOutput(write)                  0.184948      0.988097       1.73632      0.955038      0.516281        10     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19953.2 MB
  Peak resident set size usage (VmHWM): 12321.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 18:10:21 UTC       justIN version: 01.06.00