justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301923.5@dunegpschedd01.fnal.gov

Jobsub ID301923.5@dunegpschedd01.fnal.gov
Workflow ID12473
Stage ID1
User nameskar@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-28 11:42:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-28 11:44:59
From worker nodeHostnamedunegli-8464114-0-fnpc22004.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 11:43:45
Input filesfardet-hd:nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2.root
JobscriptExit code0
Real time1m (62s)
CPU time0m (55s = 88%)
Max RSS bytes11270160384 (10748 MiB)
Outputting started2026-01-28 11:44:48
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/skar/fnal/12473/1/001/nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2_ana_2026-01-28T_114351Z.root
Finished2026-01-28 11:44:59
Saved logsjustin-logs:301923.5-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/c7/nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Analysing.

Warning: there were 21 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no vertex found for PFParticle with ID 8
Warning: there was no track found for track-like PFParticle with ID 8
Warning: there was no track found for track-like PFParticle with ID 9
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:44:38 UTC run: 1410 subRun: 1 event: 24104
the pmtrajfit track #0 has 2351 hits on calorimetry plane #2, only 2000 stored in tree
%MSG
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:44:38 UTC run: 1410 subRun: 1 event: 24104
the pmtrajfit track #0 has 2010 hits on calorimetry plane #0, only 2000 stored in tree
%MSG
Found this many showers 9
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:38 UTC run: 1410 subRun: 1 event: 24104
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 5th record. run: 1410 subRun: 1 event: 24105 at 28-Jan-2026 11:44:40 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 0
Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 6th record. run: 1410 subRun: 1 event: 24106 at 28-Jan-2026 11:44:40 UTC
Analysing.

Found this many showers 0
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:40 UTC run: 1410 subRun: 1 event: 24106
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 7th record. run: 1410 subRun: 1 event: 24107 at 28-Jan-2026 11:44:40 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 7
Found this many showers 7
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:41 UTC run: 1410 subRun: 1 event: 24107
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1410 subRun: 1 event: 24108 at 28-Jan-2026 11:44:42 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 5
Found this many showers 5
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:43 UTC run: 1410 subRun: 1 event: 24108
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 9th record. run: 1410 subRun: 1 event: 24109 at 28-Jan-2026 11:44:44 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 3
Warning: there was no track found for track-like PFParticle with ID 4
Found this many showers 4
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:45 UTC run: 1410 subRun: 1 event: 24109
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 10th record. run: 1410 subRun: 1 event: 24110 at 28-Jan-2026 11:44:46 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:46 UTC run: 1410 subRun: 1 event: 24110
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:44:47 UTC  Closed output file "nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2_ana_2026-01-28T_114351Z.root"
28-Jan-2026 11:44:47 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/e1/c7/nu_dune10kt_1x2x6_1410_241_20230826T123331Z_gen_g4_detsim_hitreco__20240227T211210Z_reco2.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.197755       1.67071       3.6032        1.38218       1.16358        10     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                          0.000883378   0.00209497    0.00343661    0.00217283    0.000630383      10     
end_path:out1:RootOutput                         4.178e-06    1.20017e-05    5.273e-05    7.0385e-06    1.37804e-05      10     
end_path:analysistree:AnalysisTree                0.01985      0.556708       1.30971      0.376116      0.487578        10     
end_path:pmtrackeff:NeutrinoTrackingEff         0.000198347   0.00451444     0.0169241     0.0020413    0.00510175       10     
end_path:pmtracktceff:NeutrinoTrackingEff       4.0237e-05    0.00375662     0.0131742    0.00146182    0.00434179       10     
end_path:pandoraeff:NeutrinoTrackingEff         2.5589e-05    0.00376112     0.0174113    0.00147398    0.00504919       10     
end_path:pmtrajfiteff:NeutrinoTrackingEff       2.0479e-05    0.00385998     0.0171232    0.00139612    0.00496383       10     
end_path:pmtrajfittceff:NeutrinoTrackingEff     1.9737e-05     0.0131476     0.058078     0.00482538      0.01703        10     
end_path:pandorashweff:NeutrinoShowerEff        3.9805e-05    0.00946866     0.0377397    0.00334741     0.0115515       10     
end_path:emshowershweff:NeutrinoShowerEff       2.9136e-05    0.000205152   0.000522943   0.000187712   0.000155059      10     
end_path:trajclustershweff:NeutrinoShowerEff    3.0077e-05    0.00156676    0.00305424    0.00173907    0.000911688      10     
end_path:runcheckereco:CheckRecoEnergy           1.605e-05    4.8482e-05    0.000174982   3.07585e-05   4.57238e-05      10     
end_path:flashmatchAna:FlashMatchAna            0.00213875     0.0407994     0.102111      0.0213487     0.0351911       10     
end_path:out1:RootOutput(write)                  0.155386       1.03003       2.04019      0.963982      0.615618        10     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19953.2 MB
  Peak resident set size usage (VmHWM): 11270.2 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 18:09:25 UTC       justIN version: 01.06.00