Jobsub ID 240915.68@dunegpschedd01.fnal.gov

Jobsub ID	240915.68@dunegpschedd01.fnal.gov
Workflow ID	9468
Stage ID	1
User name	osbiston@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-10-30 12:23:40
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-10-30 12:30:05
From worker node	Hostname	dunegli-7420711-0-fnpc22031.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-10-30 12:25:22
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T063155Z_gen_002259_supernova_g4_halfActiveVol_detsim_reco_20250725T012005Z_reco2.root
Jobscript	Exit code	0
	Real time	0m (16s)
	CPU time	0m (14s = 87%)
	Max RSS bytes	792485888 (755 MiB)
Outputting started	2025-10-30 12:25:39
Output files
Finished	2025-10-30 12:30:05
Saved logs	justin-logs:240915.68-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cp: cannot stat '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/*.xml': No such file or directory
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/01/d9/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T063155Z_gen_002259_supernova_g4_halfActiveVol_detsim_reco_20250725T012005Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_03
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e
MRB_SOURCE=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/srcs
MRB_BUILDDIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof

PRODUCTS=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof

local product directory is /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
hit initial : 172.577 | hit correction : 1.14095
hit initial : 142.197 | hit correction : 1.14086
hit initial : 123.56 | hit correction : 1.14082
hit initial : 137.134 | hit correction : 1.14076
hit initial : 117.415 | hit correction : 1.14066
hit initial : 125.139 | hit correction : 1.14053
hit initial : 144.88 | hit correction : 1.14033
hit initial : 147.465 | hit correction : 1.14015
hit initial : 175.103 | hit correction : 1.13986
hit initial : 267.299 | hit correction : 1.13966
hit initial : 168.367 | hit correction : 1.13941
hit initial : 272.062 | hit correction : 1.13914
hit initial : 543.661 | hit correction : 1.13898
hit initial : 530.372 | hit correction : 1.13881
hit initial : 281.62 | hit correction : 1.13858
hit initial : 272.875 | hit correction : 1.13837
hit initial : 236.031 | hit correction : 1.13815
hit initial : 155.367 | hit correction : 1.13788
hit initial : 183.966 | hit correction : 1.13759
hit initial : 192.401 | hit correction : 1.13737
hit initial : 178.861 | hit correction : 1.13704
hit initial : 265.897 | hit correction : 1.1368
hit initial : 181.073 | hit correction : 1.1365
hit initial : 184.294 | hit correction : 1.1362
hit initial : 71.2648 | hit correction : 1.13603
 *** Total Charge : 7385.12
 Looking at view: 2 | Number of hits in view: 33
Begin processing the 10th record. run: 5102 subRun: 0 event: 112910 at 30-Oct-2025 12:25:38 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  39
Added hit list length: 39 | Max was set to: -3.40282e+38
True Neutron Energy: 939.567
True Electron Energy: 50.1134
Completed MCParticle Loop
True Neutrino Energy: 55.6977
 Size of all hits: 39
hit initial : 142.584 | hit correction : 1.23862
hit initial : 186.674 | hit correction : 1.23813
hit initial : 24.8899 | hit correction : 1.23873
hit initial : 282.891 | hit correction : 1.23643
hit initial : 429.421 | hit correction : 1.23648
hit initial : 550.461 | hit correction : 1.23665
hit initial : 219.752 | hit correction : 1.23654
hit initial : 307.06 | hit correction : 1.23677
hit initial : 193.193 | hit correction : 1.23678
hit initial : 121.443 | hit correction : 1.23735
hit initial : 117.074 | hit correction : 1.23743
hit initial : 202.243 | hit correction : 1.23725
hit initial : 203.832 | hit correction : 1.23759
 *** Total Charge : 3688.1
 Looking at view: 0 | Number of hits in view: 13
hit initial : 108.364 | hit correction : 1.23869
hit initial : 120.111 | hit correction : 1.23801
hit initial : 85.5864 | hit correction : 1.23859
hit initial : 213.423 | hit correction : 1.23781
hit initial : 206.094 | hit correction : 1.23737
hit initial : 247.049 | hit correction : 1.23665
hit initial : 151.097 | hit correction : 1.23646
hit initial : 162.4 | hit correction : 1.23637
hit initial : 194.469 | hit correction : 1.23641
hit initial : 305.044 | hit correction : 1.23653
hit initial : 294.54 | hit correction : 1.23662
hit initial : 175.442 | hit correction : 1.23669
hit initial : 144.905 | hit correction : 1.23679
hit initial : 71.3078 | hit correction : 1.2374
hit initial : 173.24 | hit correction : 1.23732
hit initial : 65.6777 | hit correction : 1.23738
hit initial : 128.027 | hit correction : 1.23691
hit initial : 274.653 | hit correction : 1.2369
 *** Total Charge : 3861.24
 Looking at view: 1 | Number of hits in view: 18
hit initial : 122.383 | hit correction : 1.23872
hit initial : 477.749 | hit correction : 1.23655
hit initial : 576.464 | hit correction : 1.23773
hit initial : 899.941 | hit correction : 1.23654
hit initial : 390.479 | hit correction : 1.23665
hit initial : 59.496 | hit correction : 1.23452
hit initial : 218.076 | hit correction : 1.23741
hit initial : 233.816 | hit correction : 1.23685
 *** Total Charge : 3684.06
 Looking at view: 2 | Number of hits in view: 8
30-Oct-2025 12:25:39 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/01/d9/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T063155Z_gen_002259_supernova_g4_halfActiveVol_detsim_reco_20250725T012005Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0181295     0.0376839     0.0592633     0.0414769     0.0143182       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00098316    0.00208031    0.00718634     0.0014295    0.00174463       10     
end_path:ana:AnalyzeEvents         0.0163444     0.0353472     0.0558781     0.039646      0.0142918       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 18935.4 MB
  Peak resident set size usage (VmHWM): 782.991 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0