justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296289.1@dunegpschedd02.fnal.gov

Jobsub ID296289.1@dunegpschedd02.fnal.gov
Workflow ID12470
Stage ID1
User nameskar@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2026-01-28 11:30:37
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2026-01-28 11:34:31
From worker nodeHostnamedunegli-8450302-0-fnpc18006.fnal.gov
cpuinfoAMD EPYC 7551 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-28 11:31:22
Input filesfardet-hd:nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root
JobscriptExit code0
Real time1m (104s)
CPU time1m (82s = 78%)
Max RSS bytes10656616448 (10162 MiB)
Outputting started2026-01-28 11:33:06
Output filesusertests:nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2_ana_2026-01-28T_113128Z.root
Finished2026-01-28 11:34:31
Saved logsjustin-logs:296289.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/02/nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Warning: there was no track found for track-like PFParticle with ID 4
Found this many showers 4
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:35 UTC run: 1412 subRun: 1 event: 74903
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 4th record. run: 1412 subRun: 1 event: 74904 at 28-Jan-2026 11:32:39 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Begin processing the 5th record. run: 1412 subRun: 1 event: 74905 at 28-Jan-2026 11:32:40 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:40 UTC run: 1412 subRun: 1 event: 74905
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 6th record. run: 1412 subRun: 1 event: 74906 at 28-Jan-2026 11:32:41 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 3
Found this many showers 3
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:42 UTC run: 1412 subRun: 1 event: 74906
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 7th record. run: 1412 subRun: 1 event: 74907 at 28-Jan-2026 11:32:44 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 23
Warning: there was no track found for track-like PFParticle with ID 23
Warning: there were 23 reconstructed PFParticle daughters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 27
Found this many showers 27
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:51 UTC run: 1412 subRun: 1 event: 74907
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1412 subRun: 1 event: 74908 at 28-Jan-2026 11:32:56 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 4
Begin processing the 9th record. run: 1412 subRun: 1 event: 74909 at 28-Jan-2026 11:32:58 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 5
Found this many showers 5
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:58 UTC run: 1412 subRun: 1 event: 74909
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 10th record. run: 1412 subRun: 1 event: 74910 at 28-Jan-2026 11:32:59 UTC
Analysing.

Warning: there were 20 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 3
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:33:01 UTC run: 1412 subRun: 1 event: 74910
the pmtrajfit track #0 has 2477 hits on calorimetry plane #2, only 2000 stored in tree
%MSG
%MSG-e AnalysisTree:limits:  AnalysisTree:analysistree@BeginModule  28-Jan-2026 11:33:01 UTC run: 1412 subRun: 1 event: 74910
the pmtrajfit track #0 has 2385 hits on calorimetry plane #0, only 2000 stored in tree
%MSG
Found this many showers 3
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:33:01 UTC run: 1412 subRun: 1 event: 74910
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:33:05 UTC  Closed output file "nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2_ana_2026-01-28T_113128Z.root"
28-Jan-2026 11:33:05 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/02/nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.561358       3.43868       11.8674       2.04336       3.42222        10     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                          0.00191074    0.00389219     0.0171859    0.00222699    0.00446273       10     
end_path:out1:RootOutput                         8.521e-06    1.65737e-05   4.7772e-05    1.1315e-05    1.22454e-05      10     
end_path:analysistree:AnalysisTree               0.102533       1.17687       4.66822      0.491402        1.458         10     
end_path:pmtrackeff:NeutrinoTrackingEff         0.000172789    0.0418553     0.357822     0.00405347     0.105679        10     
end_path:pmtracktceff:NeutrinoTrackingEff       3.6317e-05     0.0388343     0.325292     0.00326083     0.095923        10     
end_path:pandoraeff:NeutrinoTrackingEff         3.3943e-05     0.0228331     0.173962     0.00345307     0.0509825       10     
end_path:pmtrajfiteff:NeutrinoTrackingEff       3.3873e-05     0.026485      0.211561     0.00369277     0.062146        10     
end_path:pmtrajfittceff:NeutrinoTrackingEff     3.2127e-05     0.0494304     0.339084      0.0118179     0.0985412       10     
end_path:pandorashweff:NeutrinoShowerEff         9.303e-05     0.0369581     0.261415     0.00924435     0.0759706       10     
end_path:emshowershweff:NeutrinoShowerEff       7.9061e-05    0.000313466   0.000694092   0.000282826   0.000193907      10     
end_path:trajclustershweff:NeutrinoShowerEff    9.5405e-05    0.00235095    0.00459841    0.00268872    0.00150709       10     
end_path:runcheckereco:CheckRecoEnergy          2.3327e-05    7.57648e-05   0.00047388    3.19175e-05   0.000132848      10     
end_path:flashmatchAna:FlashMatchAna             0.005211      0.0659998     0.262864      0.0391949     0.0769697       10     
end_path:out1:RootOutput(write)                  0.424685       1.97179       5.25951       1.43172       1.47171        10     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 20234.8 MB
  Peak resident set size usage (VmHWM): 10656.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2026-02-04 18:10:21 UTC       justIN version: 01.06.00