Jobsub ID 301923.4@dunegpschedd01.fnal.gov

Jobsub ID	301923.4@dunegpschedd01.fnal.gov
Workflow ID	12473
Stage ID	1
User name	skar@fnal.gov
Requested	Processors	1
	GPU	No
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2026-01-28 11:42:37
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat	2026-01-28 11:44:26
From worker node	Hostname	dunegli-8464114-0-fnpc22004.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2026-01-28 11:43:14
Input files	fardet-hd:nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root
Jobscript	Exit code	0
	Real time	0m (58s)
	CPU time	0m (53s = 91%)
	Max RSS bytes	10727997440 (10231 MiB)
Outputting started	2026-01-28 11:44:13
Output files
Finished	2026-01-28 11:44:26
Saved logs	justin-logs:301923.4-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/02/nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
../justin-jobscript: line 63:  1127 Killed                  lar -c $FCL_FILE $events_option -o $outFile "$pfn" > ${fname}_ana_${now}.log 2>&1
=== Start last 100 lines of lar log file ===
	x: -363.376 to 363.376
	y: -607.829 to 607.829
	z: -0.87625 to 1393.46
28-Jan-2026 11:43:54 UTC  Initiating request to open input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/02/nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root"
Plugin version SecClnt v5.4.3 is incompatible with secztn v5.7.3 (must be <= 5.4.x) in sec.protocol libXrdSecztn-5.so
28-Jan-2026 11:43:56 UTC  Opened input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/33/02/nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2.root"
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
job begin...
Fiducial volume:
-353.376	< x <	353.376
-597.829	< y <	597.829
9.12375	< z <	1383.46
Begin processing the 1st record. run: 1412 subRun: 1 event: 74901 at 28-Jan-2026 11:43:57 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 3
Found this many showers 3
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:43:57 UTC run: 1412 subRun: 1 event: 74901
Could not find shower with label emshower
%MSG
Found this many showers 0
28-Jan-2026 11:43:57 UTC  Opened output file with pattern "nu_dune10kt_1x2x6_1412_749_20230826T153338Z_gen_g4_detsim_hitreco__20240227T210725Z_reco2_ana_2026-01-28T_114318Z.root"
Begin processing the 2nd record. run: 1412 subRun: 1 event: 74902 at 28-Jan-2026 11:43:59 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 1
Begin processing the 3rd record. run: 1412 subRun: 1 event: 74903 at 28-Jan-2026 11:43:59 UTC
Analysing.

Warning: there were 12 reconstructed PFParticle clusters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 4
Found this many showers 4
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:01 UTC run: 1412 subRun: 1 event: 74903
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 4th record. run: 1412 subRun: 1 event: 74904 at 28-Jan-2026 11:44:04 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Begin processing the 5th record. run: 1412 subRun: 1 event: 74905 at 28-Jan-2026 11:44:04 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 2
Found this many showers 2
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:04 UTC run: 1412 subRun: 1 event: 74905
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 6th record. run: 1412 subRun: 1 event: 74906 at 28-Jan-2026 11:44:05 UTC
Analysing.

Warning: there was no track found for track-like PFParticle with ID 3
Found this many showers 3
%MSG-e NeutrinoShowerEff:  NeutrinoShowerEff:emshowershweff@BeginModule  28-Jan-2026 11:44:06 UTC run: 1412 subRun: 1 event: 74906
Could not find shower with label emshower
%MSG
Found this many showers 0
Begin processing the 7th record. run: 1412 subRun: 1 event: 74907 at 28-Jan-2026 11:44:07 UTC
Analysing.

Warning: there was no vertex found for PFParticle with ID 23
Warning: there was no track found for track-like PFParticle with ID 23
Warning: there were 23 reconstructed PFParticle daughters; only the first 10 being stored in tree
Warning: there was no track found for track-like PFParticle with ID 27
Found this many showers 27
=== End last 100 lines of lar log file ===
lar exit code 0