Jobsub ID 240915.112@dunegpschedd01.fnal.gov

Jobsub ID	240915.112@dunegpschedd01.fnal.gov
Workflow ID	9468
Stage ID	1
User name	osbiston@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-10-30 12:23:40
Site	US_FNAL-FermiGrid
Entry	FNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat	2025-10-30 12:28:12
From worker node	Hostname	dunegli-7420873-0-fnpc23023.fnal.gov
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-10-30 12:25:15
Input files	fardet-hd:prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250209T182413Z_gen_002801_supernova_g4_halfActiveVol_detsim_reco_20250725T013250Z_reco2.root
Jobscript	Exit code	0
	Real time	0m (15s)
	CPU time	0m (13s = 86%)
	Max RSS bytes	795975680 (759 MiB)
Outputting started	2025-10-30 12:25:31
Output files
Finished	2025-10-30 12:28:12
Saved logs	justin-logs:240915.112-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

cp: cannot stat '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/*.xml': No such file or directory
Input PFN = root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2a/89/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250209T182413Z_gen_002801_supernova_g4_halfActiveVol_detsim_reco_20250725T013250Z_reco2.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_03
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e
MRB_SOURCE=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/srcs
MRB_BUILDDIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof

PRODUCTS=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof

local product directory is /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/7e4d8a7884851e80797d7d3c5855496e8acfe48e/v09_91_03.prof/localProducts_larsoft_v09_91_03_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
hit initial : 340.842 | hit correction : 1.0954
hit initial : 238.562 | hit correction : 1.09517
hit initial : 400.328 | hit correction : 1.0953
hit initial : 136.267 | hit correction : 1.0953
hit initial : 133.987 | hit correction : 1.09541
hit initial : 138.302 | hit correction : 1.09557
hit initial : 162.407 | hit correction : 1.09571
hit initial : 248.03 | hit correction : 1.09597
hit initial : 333.409 | hit correction : 1.09644
hit initial : 213.736 | hit correction : 1.09694
hit initial : 181.338 | hit correction : 1.0973
hit initial : 174.462 | hit correction : 1.09762
 *** Total Charge : 3328.39
 Looking at view: 2 | Number of hits in view: 14
Begin processing the 9th record. run: 5100 subRun: 0 event: 140009 at 30-Oct-2025 12:25:30 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  2
This pfp has size:  44
Added hit list length: 44 | Max was set to: -3.40282e+38
True Electron Energy: 32.7553
Completed MCParticle Loop
True Neutrino Energy: 36.0511
 Size of all hits: 44
hit initial : 79.7942 | hit correction : 1.14446
hit initial : 314.045 | hit correction : 1.1447
hit initial : 161.756 | hit correction : 1.14486
hit initial : 212.511 | hit correction : 1.14525
hit initial : 300.532 | hit correction : 1.14534
hit initial : 253.425 | hit correction : 1.14595
hit initial : 251.834 | hit correction : 1.14608
hit initial : 165.553 | hit correction : 1.14679
hit initial : 319.372 | hit correction : 1.14692
hit initial : 93.4026 | hit correction : 1.14781
hit initial : 835.684 | hit correction : 1.14909
hit initial : 267.586 | hit correction : 1.14944
hit initial : 37.693 | hit correction : 1.15029
hit initial : 28.851 | hit correction : 1.15056
hit initial : 42.2012 | hit correction : 1.15084
hit initial : 134.955 | hit correction : 1.15127
 *** Total Charge : 4014.32
 Looking at view: 0 | Number of hits in view: 16
hit initial : 118.664 | hit correction : 1.14445
hit initial : 201.275 | hit correction : 1.14462
hit initial : 197.939 | hit correction : 1.14481
hit initial : 168.255 | hit correction : 1.14506
hit initial : 170.785 | hit correction : 1.1453
hit initial : 162.622 | hit correction : 1.14555
hit initial : 156.133 | hit correction : 1.1458
hit initial : 207.538 | hit correction : 1.14605
hit initial : 232.188 | hit correction : 1.14621
hit initial : 180.776 | hit correction : 1.14658
hit initial : 183.415 | hit correction : 1.14686
hit initial : 238.649 | hit correction : 1.14725
hit initial : 119.595 | hit correction : 1.1484
hit initial : 527.003 | hit correction : 1.14873
hit initial : 75.2723 | hit correction : 1.15018
hit initial : 512.639 | hit correction : 1.15027
hit initial : 67.7851 | hit correction : 1.1512
hit initial : 140.101 | hit correction : 1.15129
 *** Total Charge : 4199.95
 Looking at view: 1 | Number of hits in view: 18
hit initial : 268.576 | hit correction : 1.14454
hit initial : 457.229 | hit correction : 1.1449
hit initial : 439.825 | hit correction : 1.14555
hit initial : 495.977 | hit correction : 1.14608
hit initial : 396.4 | hit correction : 1.14677
hit initial : 345.008 | hit correction : 1.14733
hit initial : 174.323 | hit correction : 1.14808
hit initial : 714.651 | hit correction : 1.1496
hit initial : 229.863 | hit correction : 1.15056
hit initial : 259.724 | hit correction : 1.1513
 *** Total Charge : 4338.76
 Looking at view: 2 | Number of hits in view: 10
Begin processing the 10th record. run: 5100 subRun: 0 event: 140010 at 30-Oct-2025 12:25:31 UTC
*--------------------------- Running LowE Analysis --------------------------------------*
Number of reconstructed particles:  0
True Neutron Energy: 939.571
True Neutron Energy: 940.953
True Electron Energy: 45.7471
Completed MCParticle Loop
True Neutrino Energy: 63.0569
 Size of all hits: 0
30-Oct-2025 12:25:31 UTC  Closed input file "root://fndcadoor.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/2a/89/prodmarley_nue_cc_flat_radiological_decay0_dune10kt_1x2x6_lateralAPA_20250209T182413Z_gen_002801_supernova_g4_halfActiveVol_detsim_reco_20250725T013250Z_reco2.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                         0.0162195     0.0623338     0.172581      0.0596441     0.0453117       10     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000971419   0.00381578     0.0272964     0.0012012    0.00782893       10     
end_path:ana:AnalyzeEvents         0.0149447     0.0583947     0.170599      0.0555474     0.0447192       10     
====================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 18935.4 MB
  Peak resident set size usage (VmHWM): 780.808 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0