justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301923.6@dunegpschedd01.fnal.gov

Jobsub ID301923.6@dunegpschedd01.fnal.gov
Workflow ID12473
Stage ID1
User nameskar@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-28 11:42:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-28 11:44:31
From worker nodeHostnamedunegli-8464114-0-fnpc22004.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 11:43:15
Input filesfardet-hd:nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2.root
JobscriptExit code0
Real time1m (63s)
CPU time0m (58s = 92%)
Max RSS bytes10581266432 (10091 MiB)
Outputting started2026-01-28 11:44:19
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/skar/fnal/12473/1/001/nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2_ana_2026-01-28T_114319Z.root
Finished2026-01-28 11:44:31
Saved logsjustin-logs:301923.6-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/96/cc/nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Found this many showers 0
Begin processing the 4th record. run: 1410 subRun: 1 event: 63404 at 28-Jan-2026 11:44:04 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:04 UTC run: 1410 subRun: 1 event: 63404
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 5th record. run: 1410 subRun: 1 event: 63405 at 28-Jan-2026 11:44:06 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:06 UTC run: 1410 subRun: 1 event: 63405
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 6th record. run: 1410 subRun: 1 event: 63406 at 28-Jan-2026 11:44:07 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 6
Warning: there was no track found for track-like PFParticle with ID 6
Warning: there was no track found for track-like PFParticle with ID 7
Found this many showers 7
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:08 UTC run: 1410 subRun: 1 event: 63406
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 7th record. run: 1410 subRun: 1 event: 63407 at 28-Jan-2026 11:44:09 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 8
Found this many showers 8
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:10 UTC run: 1410 subRun: 1 event: 63407
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1410 subRun: 1 event: 63408 at 28-Jan-2026 11:44:12 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 5
Found this many showers 5
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:13 UTC run: 1410 subRun: 1 event: 63408
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 9th record. run: 1410 subRun: 1 event: 63409 at 28-Jan-2026 11:44:14 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 6
Found this many showers 6
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:14 UTC run: 1410 subRun: 1 event: 63409
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 10th record. run: 1410 subRun: 1 event: 63410 at 28-Jan-2026 11:44:16 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:16 UTC run: 1410 subRun: 1 event: 63410
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:44:18 UTC  Closed output file "nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2_ana_2026-01-28T_114319Z.root"
28-Jan-2026 11:44:18 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/96/cc/nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.911402       1.96033       3.06988       1.84149      0.666745        10     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                          0.00162596    0.00389481     0.0162798    0.00195258    0.00448724       10     
end_path:out1:RootOutput                         3.737e-06    1.1558e-05    6.6336e-05     5.21e-06     1.83072e-05      10     
end_path:analysistree:AnalysisTree               0.204951      0.660122       1.09389      0.641665      0.275558        10     
end_path:pmtrackeff:NeutrinoTrackingEff         0.00101167    0.00736524     0.0232321     0.0063138    0.00611151       10     
end_path:pmtracktceff:NeutrinoTrackingEff       0.00117968    0.00736078     0.0250139    0.00540597    0.00651897       10     
end_path:pandoraeff:NeutrinoTrackingEff         0.00123943    0.00542859     0.0113845    0.00534677    0.00277032       10     
end_path:pmtrajfiteff:NeutrinoTrackingEff       0.00120844    0.00534925     0.0112691    0.00522628    0.00274993       10     
end_path:pmtrajfittceff:NeutrinoTrackingEff     0.00431532     0.0140834     0.0255867     0.014614     0.00592753       10     
end_path:pandorashweff:NeutrinoShowerEff        0.00323103     0.0137561     0.0418365    0.00934823     0.0108501       10     
end_path:emshowershweff:NeutrinoShowerEff       6.5735e-05    0.000785682   0.00624191    0.000135712   0.00182314       10     
end_path:trajclustershweff:NeutrinoShowerEff    0.00147419     0.0018673    0.00246326    0.00181203    0.000300312      10     
end_path:runcheckereco:CheckRecoEnergy           1.558e-05    9.50667e-05   0.000308867   2.4141e-05    0.000114512      10     
end_path:flashmatchAna:FlashMatchAna             0.012974      0.036541      0.0905777     0.0293732     0.0203807       10     
end_path:out1:RootOutput(write)                  0.677617       1.20277       1.83666       1.11916      0.345733        10     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19943.6 MB
  Peak resident set size usage (VmHWM): 10581.3 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 18:09:23 UTC       justIN version: 01.06.00