Jobsub ID 296289.5@dunegpschedd02.fnal.gov

Jobsub ID	296289.5@dunegpschedd02.fnal.gov
Workflow ID	12470
Stage ID	1
User name	skar@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-28 11:30:37
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-28 11:33:15
From worker node	Hostname	dunegli-8464114-0-fnpc22004.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-28 11:31:24
Input files	fardet-hd:nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2.root
Jobscript	Exit code	0
	Real time	1m (66s)
	CPU time	0m (59s = 89%)
	Max RSS bytes	10547494912 (10058 MiB)
Outputting started	2026-01-28 11:32:30
Output files	usertests:nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2_ana_2026-01-28T_113130Z.root
Finished	2026-01-28 11:33:15
Saved logs	justin-logs:296289.5-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/96/cc/nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Found this many showers 0
Begin processing the 4th record. run: 1410 subRun: 1 event: 63404 at 28-Jan-2026 11:32:15 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:16 UTC run: 1410 subRun: 1 event: 63404
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 5th record. run: 1410 subRun: 1 event: 63405 at 28-Jan-2026 11:32:17 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:17 UTC run: 1410 subRun: 1 event: 63405
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 6th record. run: 1410 subRun: 1 event: 63406 at 28-Jan-2026 11:32:18 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 6
Warning: there was no track found for track-like PFParticle with ID 6
Warning: there was no track found for track-like PFParticle with ID 7
Found this many showers 7
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:19 UTC run: 1410 subRun: 1 event: 63406
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 7th record. run: 1410 subRun: 1 event: 63407 at 28-Jan-2026 11:32:20 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 8
Found this many showers 8
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:22 UTC run: 1410 subRun: 1 event: 63407
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1410 subRun: 1 event: 63408 at 28-Jan-2026 11:32:23 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 5
Found this many showers 5
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:24 UTC run: 1410 subRun: 1 event: 63408
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 9th record. run: 1410 subRun: 1 event: 63409 at 28-Jan-2026 11:32:25 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 6
Found this many showers 6
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:26 UTC run: 1410 subRun: 1 event: 63409
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 10th record. run: 1410 subRun: 1 event: 63410 at 28-Jan-2026 11:32:27 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:27 UTC run: 1410 subRun: 1 event: 63410
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:32:29 UTC  Closed output file "nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2_ana_2026-01-28T_113130Z.root"
28-Jan-2026 11:32:29 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/96/cc/nu_dune10kt_1x2x6_1410_634_20230826T123347Z_gen_g4_detsim_hitreco__20240227T211945Z_reco2.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                       0.908862       2.03921       3.20756       2.02842      0.668702        10     
----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                          0.00144156    0.00458307     0.0172192    0.00170265    0.00549801       10     
end_path:out1:RootOutput                         2.876e-06    3.34156e-05   0.000208356   4.5885e-06    6.29335e-05      10     
end_path:analysistree:AnalysisTree               0.193423      0.662528       1.10237      0.671435      0.279312        10     
end_path:pmtrackeff:NeutrinoTrackingEff         0.000950606   0.00703883     0.0160747    0.00719277     0.0043354       10     
end_path:pmtracktceff:NeutrinoTrackingEff       0.00121632    0.00626101     0.0144635    0.00536716    0.00384534       10     
end_path:pandoraeff:NeutrinoTrackingEff         0.00123013    0.00499044     0.0076462    0.00508913    0.00207954       10     
end_path:pmtrajfiteff:NeutrinoTrackingEff       0.00119761    0.00490341     0.0073209    0.00513136    0.00202491       10     
end_path:pmtrajfittceff:NeutrinoTrackingEff      0.0051318     0.0175533     0.0483775     0.0143444     0.0119762       10     
end_path:pandorashweff:NeutrinoShowerEff        0.00370072     0.0157161     0.0441657     0.0120754     0.0118127       10     
end_path:emshowershweff:NeutrinoShowerEff       7.0794e-05    0.00024027     0.0011633    0.000119747   0.000315588      10     
end_path:trajclustershweff:NeutrinoShowerEff    0.00131886    0.00200273    0.00368797    0.00164523    0.000783707      10     
end_path:runcheckereco:CheckRecoEnergy          1.7864e-05    0.000104085   0.000374161   2.6596e-05    0.000129928      10     
end_path:flashmatchAna:FlashMatchAna             0.0136457     0.0594608     0.251106      0.0317689     0.0669638       10     
end_path:out1:RootOutput(write)                  0.685007       1.25206       1.90719       1.23939      0.340186        10     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19942.7 MB
  Peak resident set size usage (VmHWM): 10547.5 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0