Jobsub ID 31536.12@dunegpschedd02.fnal.gov

Jobsub ID	31536.12@dunegpschedd02.fnal.gov
Workflow ID	2099
Stage ID	1
User name	gpaixao@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	GPU	No
	RSS bytes	8387559424 (7999 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2025-09-01 13:25:29
Site	CZ_FZU
Entry	Nova_CZ_FZU_osgce2
Last heartbeat	2025-09-01 13:37:40
From worker node	Hostname	milan15.farm.particle.cz
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	10485760000 (10000 MiB)
	Wall seconds limit	172800 (48 hours)
	GPU
	Inner Apptainer?	True
Job state	outputting_failed
Started	2025-09-01 13:26:20
Input files	usertests:pdhd_g4_Stage2_2025-08-31T_144220Z.root
Jobscript	Exit code	0
	Real time	4m (271s)
	CPU time	4m (247s = 91%)
	Max RSS bytes	6349623296 (6055 MiB)
Outputting started	2025-09-01 13:30:52
Output files
Finished	2025-09-01 13:37:40
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

Input PFN = root://se1.farm.particle.cz:1094//dune/RSE/usertests/a6/a2/pdhd_g4_Stage2_2025-08-31T_144220Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
InputModule: PDFastSimExternal
 - Vtx    = (4.38177, 450.608, -274.734)
 - End    = (-52.3159, 390.069, -7.41947)
End Process:pi-Inelastic
 - Time   = 0
 - Dir    = (-0.197258, -0.218853, 0.955611)
 - Mom    = (-1.48529, -1.64789, 7.19546)
 - |Mom|  = 7.52969
 - Energy = 7.53098
 - PDG    = -211
Begin processing the 7th record. run: 20250818 subRun: 1 event: 1246 at 01-Sep-2025 15:29:23 CEST
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (-361.191, 600.765, 229.45)
 - End    = (-361.193, 600.765, 229.45)
End Process:eIoni
 - Time   = -1.93555e+06
 - Dir    = (-0.981005, 0.193149, 0.0179721)
 - Mom    = (-0.000471959, 9.29236e-05, 8.64634e-06)
 - |Mom|  = 0.000481098
 - Energy = 0.000701837
 - PDG    = 11
Begin processing the 8th record. run: 20250818 subRun: 1 event: 1247 at 01-Sep-2025 15:29:42 CEST
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (353.567, 503.476, 111.716)
 - End    = (353.567, 503.476, 111.716)
End Process:eIoni
 - Time   = 227825
 - Dir    = (-0.707468, 0.670863, -0.222333)
 - Mom    = (-8.63337e-05, 8.18667e-05, -2.71317e-05)
 - |Mom|  = 0.000122032
 - Energy = 0.000525368
 - PDG    = 11
Begin processing the 9th record. run: 20250818 subRun: 1 event: 1248 at 01-Sep-2025 15:30:06 CEST
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (-5.71369, 460.285, -274.734)
 - End    = (-65.4077, 404.419, 12.5688)
End Process:pi-Inelastic
 - Time   = 0
 - Dir    = (-0.200543, -0.184427, 0.962169)
 - Mom    = (-1.28569, -1.18237, 6.16851)
 - |Mom|  = 6.41105
 - Energy = 6.41257
 - PDG    = -211
Begin processing the 10th record. run: 20250818 subRun: 1 event: 1249 at 01-Sep-2025 15:30:26 CEST
InputModule: PDFastSim
InputModule: PDFastSimExternal
 - Vtx    = (2.18822, 454.47, -274.734)
 - End    = (-97.7955, 355.364, 212.815)
End Process:pi-Inelastic
 - Time   = 0
 - Dir    = (-0.196535, -0.199169, 0.960055)
 - Mom    = (-1.29325, -1.31059, 6.31743)
 - |Mom|  = 6.58028
 - Energy = 6.58176
 - PDG    = -211
01-Sep-2025 15:30:51 CEST  Closed input file "root://se1.farm.particle.cz:1094//dune/RSE/usertests/a6/a2/pdhd_g4_Stage2_2025-08-31T_144220Z.root"

=========================================================================================================================
TimeTracker printout (sec)                 Min           Avg           Max         Median          RMS         nEvts   
=========================================================================================================================
Full event                               4.34336       5.98984       7.74123       6.00948      0.898217        10     
-------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                 0.000308709   0.000984026   0.00396969    0.000577103   0.00103884       10     
end_path:photoncounter:myPhotonHist      4.33763       5.98203       7.72964       6.00145      0.897095        10     
end_path:beaminfo:BeamInfo             0.00490005    0.00649682    0.00737944    0.00692115    0.00074652       10     
=========================================================================================================================
%MSG-i NuRandomService:  myPhotonHist:photoncounter@EndJob  01-Sep-2025 15:30:51 CEST ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 46831032
  seed within: [ 1 ; 900000000 ]

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7281.72 MB
  Peak resident set size usage (VmHWM): 6349.62 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 10 passed = 10 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         10         10          0 photoncounter
TrigReport         10         10          0 beaminfo

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 210.972971 Real = 225.881375

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 7281.72 VmHWM = 6349.62

Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0