Jobsub ID 241071.148@dunegpschedd01.fnal.gov

Jobsub ID	241071.148@dunegpschedd01.fnal.gov
Workflow ID	9473
Stage ID	1
User name	osbiston@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-10-30 17:23:58
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-10-30 20:33:57
From worker node	Hostname	dunegli-7423490-0-fnpc23051.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-10-30 20:01:58
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T055403Z_gen_001094_supernova_g4_halfActiveVol_detsim_reco_20250724T172516Z_reco2.root
Jobscript	Exit code	0
	Real time	0m (12s)
	CPU time	0m (10s = 83%)
	Max RSS bytes	793448448 (756 MiB)
Outputting started	2025-10-30 20:02:11
Output files	https://fndcadoor.fnal.gov:2880/dune/scratch/users/osbiston/fnal/09473/1/001/analysisLowE_20251030T200201Z.root
Finished	2025-10-30 20:33:57
Saved logs	justin-logs:241071.148-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cp: cannot stat '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/*.xml': No such file or directory
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cb/7d/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T055403Z_gen_001094_supernova_g4_halfActiveVol_detsim_reco_20250724T172516Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_03
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e
MRB_SOURCE=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/srcs
MRB_BUILDDIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof

PRODUCTS=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof

local product directory is /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
hit initial : 72.2457 | hit correction : 1.10207
hit initial : 306.517 | hit correction : 1.09963
hit initial : 327.707 | hit correction : 1.09983
hit initial : 252.633 | hit correction : 1.09969
hit initial : 89.9015 | hit correction : 1.09964
hit initial : 248.624 | hit correction : 1.11049
hit initial : 611.9 | hit correction : 1.1105
hit initial : 295.771 | hit correction : 1.11048
hit initial : 117.919 | hit correction : 1.11105
hit initial : 118.73 | hit correction : 1.11129
hit initial : 144.025 | hit correction : 1.1115
hit initial : 114.124 | hit correction : 1.11166
hit initial : 157.135 | hit correction : 1.11235
hit initial : 396.02 | hit correction : 1.1124
hit initial : 192.485 | hit correction : 1.11238
hit initial : 82.1528 | hit correction : 1.11287
 *** Total Charge : 5256.3
 Looking at view: 0 | Number of hits in view: 24
hit initial : 138.755 | hit correction : 1.09026
hit initial : 155.886 | hit correction : 1.09029
hit initial : 112.512 | hit correction : 1.09076
hit initial : 78.2059 | hit correction : 1.09134
hit initial : 343.836 | hit correction : 1.09118
hit initial : 76.2158 | hit correction : 1.09135
hit initial : 49.9202 | hit correction : 1.11044
hit initial : 42.8059 | hit correction : 1.11105
hit initial : 245.471 | hit correction : 1.08645
hit initial : 91.8814 | hit correction : 1.08645
hit initial : 159.691 | hit correction : 1.08643
hit initial : 88.4551 | hit correction : 1.09852
hit initial : 367.265 | hit correction : 1.09871
hit initial : 121.356 | hit correction : 1.09877
hit initial : 12.648 | hit correction : 1.09912
hit initial : 79.849 | hit correction : 1.10207
hit initial : 75.0311 | hit correction : 1.10207
hit initial : 387.449 | hit correction : 1.09976
hit initial : 441.234 | hit correction : 1.09971
hit initial : 143.523 | hit correction : 1.09965
hit initial : 173.445 | hit correction : 1.1102
hit initial : 113.409 | hit correction : 1.11023
hit initial : 60.3348 | hit correction : 1.1102
hit initial : 156.189 | hit correction : 1.11043
hit initial : 135.688 | hit correction : 1.11047
hit initial : 28.0818 | hit correction : 1.11062
hit initial : 149.859 | hit correction : 1.11053
hit initial : 160.714 | hit correction : 1.11044
hit initial : 125.11 | hit correction : 1.11043
hit initial : 128.552 | hit correction : 1.11052
hit initial : 310.14 | hit correction : 1.11071
hit initial : 304.832 | hit correction : 1.1113
hit initial : 193.304 | hit correction : 1.11153
hit initial : 77.6767 | hit correction : 1.11234
hit initial : 369.38 | hit correction : 1.11251
hit initial : 270.229 | hit correction : 1.11244
hit initial : 82.3631 | hit correction : 1.11272
 *** Total Charge : 6673.49
 Looking at view: 1 | Number of hits in view: 37
hit initial : 168.316 | hit correction : 1.10011
hit initial : 285.048 | hit correction : 1.1102
hit initial : 81.0018 | hit correction : 1.11028
hit initial : 73.0349 | hit correction : 1.11105
hit initial : 440.201 | hit correction : 1.08644
hit initial : 78.7735 | hit correction : 1.08647
hit initial : 273.277 | hit correction : 1.09841
hit initial : 247.358 | hit correction : 1.09886
hit initial : 119.698 | hit correction : 1.10205
hit initial : 47.6111 | hit correction : 1.10208
hit initial : 362.191 | hit correction : 1.09934
hit initial : 795.32 | hit correction : 1.09976
hit initial : 205.084 | hit correction : 1.11044
hit initial : 240.683 | hit correction : 1.11052
hit initial : 327.518 | hit correction : 1.11065
hit initial : 216.071 | hit correction : 1.11041
hit initial : 223.772 | hit correction : 1.11045
hit initial : 159.115 | hit correction : 1.11111
hit initial : 175.446 | hit correction : 1.11133
hit initial : 232.012 | hit correction : 1.11166
hit initial : 399.991 | hit correction : 1.11232
hit initial : 244.4 | hit correction : 1.11238
hit initial : 213.945 | hit correction : 1.11283
 *** Total Charge : 6197.49
 Looking at view: 2 | Number of hits in view: 23
30-Oct-2025 20:02:11 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/cb/7d/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250210T055403Z_gen_001094_supernova_g4_halfActiveVol_detsim_reco_20250724T172516Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0170247     0.0263874     0.0467304     0.0214805     0.0103857       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000719099   0.00344708     0.0243875    0.00113026    0.00698626       10     
end_path:ana:AnalyzeEvents         0.0159262     0.0228028     0.0451791     0.0174618    0.00920438       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 18927.3 MB
  Peak resident set size usage (VmHWM): 776.573 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0