Jobsub ID 296289.2@dunegpschedd02.fnal.gov

Jobsub ID	296289.2@dunegpschedd02.fnal.gov
Workflow ID	12470
Stage ID	1
User name	skar@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-28 11:30:37
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-28 11:32:35
From worker node	Hostname	dunegli-8464114-0-fnpc22004.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-28 11:31:13
Input files	fardet-hd:nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root
Jobscript	Exit code	0
	Real time	1m (60s)
	CPU time	0m (43s = 71%)
	Max RSS bytes	11694931968 (11153 MiB)
Outputting started	2026-01-28 11:32:14
Output files
Finished	2026-01-28 11:32:35
Saved logs	justin-logs:296289.2-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/64/nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
../justin-jobscript: line 63:  1127 Killed                  lar -c $FCL_FILE $events_option -o $outFile "$pfn" > ${fname}_ana_${now}.log 2>&1
=== Start last 100 lines of lar log file ===
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
Active Boundaries: 
	x: -363.376 to 363.376
	y: -607.829 to 607.829
	z: -0.87625 to 1393.46
28-Jan-2026 11:31:59 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/64/nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root"
Plugin version SecClnt v5.4.3 is incompatible with secztn v5.7.3 (must be <= 5.4.x) in sec.protocol libXrdSecztn-5.so
28-Jan-2026 11:32:01 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/f2/64/nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2.root"
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
Begin processing the 1st record. run: 1098 subRun: 1 event: 31701 at 28-Jan-2026 11:32:02 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 8
Found this many showers 8
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:03 UTC run: 1098 subRun: 1 event: 31701
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:32:03 UTC  Opened output file with pattern "nu_dune10kt_1x2x6_1098_317_20230826T012211Z_gen_g4_detsim_hitreco__20240227T210344Z_reco2_ana_2026-01-28T_113120Z.root"
Begin processing the 2nd record. run: 1098 subRun: 1 event: 31702 at 28-Jan-2026 11:32:05 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 9
Warning: there was no track found for track-like PFParticle with ID 9
Warning: there was no track found for track-like PFParticle with ID 10
Found this many showers 10
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:06 UTC run: 1098 subRun: 1 event: 31702
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 3rd record. run: 1098 subRun: 1 event: 31703 at 28-Jan-2026 11:32:07 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 8
Found this many showers 8
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:08 UTC run: 1098 subRun: 1 event: 31703
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 4th record. run: 1098 subRun: 1 event: 31704 at 28-Jan-2026 11:32:09 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 5th record. run: 1098 subRun: 1 event: 31705 at 28-Jan-2026 11:32:10 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 6th record. run: 1098 subRun: 1 event: 31706 at 28-Jan-2026 11:32:11 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Begin processing the 7th record. run: 1098 subRun: 1 event: 31707 at 28-Jan-2026 11:32:12 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Found this many showers 1
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:32:12 UTC run: 1098 subRun: 1 event: 31707
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 8th record. run: 1098 subRun: 1 event: 31708 at 28-Jan-2026 11:32:12 UTC
=== End last 100 lines of lar log file ===
lar exit code 0