Jobsub ID 41009.4@dunegpschedd02.fnal.gov

Jobsub ID	41009.4@dunegpschedd02.fnal.gov
Workflow ID	2794
Stage ID	1
User name	gpaixao@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	8387559424 (7999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-17 13:49:15
Site	US_UCSD
Entry	CMSHTPC_T2_US_UCSD_gw6
Last heartbeat	2025-09-17 14:01:40
From worker node	Hostname	mh-7662-16.t2.ucsd.edu
	cpuinfo	AMD EPYC 7662 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	171000 (47 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2025-09-17 13:49:56
Input files	usertests:pdhd_g4_Stage2_2025-09-17T_045913Z.root
Jobscript	Exit code	0
	Real time	11m (683s)
	CPU time	4m (289s = 42%)
	Max RSS bytes	7321739264 (6982 MiB)
Outputting started	2025-09-17 14:01:19
Output files
Finished	2025-09-17 14:01:40
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/usertests/be/eb/pdhd_g4_Stage2_2025-09-17T_045913Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
InputModule: PDFastSimExternal
 - Vtx    = (360.805, 252.318, 459.701)
 - End    = (360.805, 252.318, 459.705)
End Process:eIoni
 - Time   = -780097
 - Dir    = (-0.848268, -0.419726, 0.32291)
 - Mom    = (-0.000513855, -0.000254257, 0.000195609)
 - |Mom|  = 0.000605769
 - Energy = 0.000792513
 - PDG    = 11
Begin processing the 7th record. run: 20250901 subRun: 1 event: 856 at 17-Sep-2025 06:56:42 PDT
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (-355.007, 0.0232078, 43.6819)
 - End    = (-355.007, 0.0232042, 43.6819)
End Process:eIoni
 - Time   = 519678
 - Dir    = (-0.956847, -0.269639, -0.108344)
 - Mom    = (-0.000105542, -2.97417e-05, -1.19506e-05)
 - |Mom|  = 0.000110302
 - Energy = 0.000522768
 - PDG    = 11
Begin processing the 8th record. run: 20250901 subRun: 1 event: 857 at 17-Sep-2025 06:57:27 PDT
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (-6.41621, 454.421, -274.734)
 - End    = (-300.247, 139.574, 1252.06)
End Process:Decay
 - Time   = 0
 - Dir    = (-0.205994, -0.197103, 0.958497)
 - Mom    = (-0.662551, -0.633954, 3.08288)
 - |Mom|  = 3.21636
 - Energy = 3.2181
 - PDG    = -13
Begin processing the 9th record. run: 20250901 subRun: 1 event: 858 at 17-Sep-2025 06:58:25 PDT
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (-361.237, 190.117, 457.921)
 - End    = (-361.237, 190.117, 457.921)
End Process:eIoni
 - Time   = 1.67499e+06
 - Dir    = (0.634965, -0.764164, 0.113455)
 - Mom    = (5.56754e-05, -6.7004e-05, 9.94802e-06)
 - |Mom|  = 8.76826e-05
 - Energy = 0.000518467
 - PDG    = 11
Begin processing the 10th record. run: 20250901 subRun: 1 event: 859 at 17-Sep-2025 07:00:04 PDT
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (-353.783, 172.018, 226.726)
 - End    = (-353.798, 172.022, 226.701)
End Process:eIoni
 - Time   = -1.02666e+06
 - Dir    = (-0.509311, 0.137965, -0.849451)
 - Mom    = (-0.000903445, 0.00024473, -0.00150681)
 - |Mom|  = 0.00177386
 - Energy = 0.00184599
 - PDG    = 11
17-Sep-2025 07:01:18 PDT  Closed input file "root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/usertests/be/eb/pdhd_g4_Stage2_2025-09-17T_045913Z.root"

=========================================================================================================================
TimeTracker printout (sec)                 Min           Avg           Max         Median          RMS         nEvts   
=========================================================================================================================
Full event                               7.03602       9.35205       12.6207       9.18679       1.52425        10     
-------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                 0.000369505    0.016355      0.0919732    0.000617028    0.0321096       10     
end_path:photoncounter:myPhotonHist      7.03017       9.32902       12.6137       9.17972       1.52235        10     
end_path:beaminfo:BeamInfo              0.0048209    0.00638014    0.00899489    0.00617023    0.00131929       10     
=========================================================================================================================
%MSG-i NuRandomService:  myPhotonHist:photoncounter@EndJob  17-Sep-2025 07:01:18 PDT ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 692078142
  seed within: [ 1 ; 900000000 ]

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8282.01 MB
  Peak resident set size usage (VmHWM): 7321.74 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 photoncounter
TrigReport         10         10          0 beaminfo

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 243.459797 Real = 627.733041

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 8282.01 VmHWM = 7321.74

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0