justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.46@dunegpschedd01.fnal.gov

Jobsub ID279313.46@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 22:20:37
From worker nodeHostnamewn-da-12.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:20:55
Input filesmonte-carlo-011977-000003
JobscriptExit code0
Real time0m (17s)
CPU time0m (14s = 82%)
Max RSS bytes590995456 (563 MiB)
Outputting started2026-01-15 21:21:14
Output files
Finished2026-01-15 22:20:37
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

scaled E : 0.404825
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.621623 , mass :  0 , mom_sf: 2.5
particle E : 0.621623 , scaled E : 1.55406
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.57482 , mass :  0 , mom_sf: 2.5
particle E : 0.57482 , scaled E : 1.43705
Total number particles: 0
Begin processing the 18th record. run: 200003 subRun: 0 event: 18 at 15-Jan-2026 22:21:12 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:12 CET run: 200003 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 659577155
%MSG
Processing a new event...
Generating a rain particle at (286.248,157.369,427.122)
Generated boost parameter gamma beta = 1.041, cos(theta) = -0.321599, phi = 1.86337
Generating a boost (-0.196945,0.653836,-0.231926)
Event Vertex @ (286.248,157.369,427.122) ... 1 particles...
  0th instance PDG 11
E: 0.784631 , m: 0.000510999 , KE: 0.78412
total KE: 0.78412
gen_total_KE: 0.202426 , KE scale factor :  0.258157
KE range: 15 , pdg :  11
particle KE sf: 3.87236, p : 0.784631 , mass :  0.000510999 , mom_sf: 3.87049
particle E : 0.784631 , scaled E : 3.03691
Total number particles: 0
Begin processing the 19th record. run: 200003 subRun: 0 event: 19 at 15-Jan-2026 22:21:12 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:12 CET run: 200003 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 357100225
%MSG
Processing a new event...
Generating a rain particle at (157.527,-458.325,179.142)
Generated boost parameter gamma beta = 1.85198, cos(theta) = 0.973752, phi = 5.01468
Generating a boost (0.0596251,-0.1912,0.856823)
Event Vertex @ (157.527,-458.325,179.142) ... 2 particles...
  0th instance PDG -11
  1th instance PDG 2212
E: 0.0919879 , m: 0.000510999 , KE: 0.0914769
E: 1.31569 , m: 0.938272 , KE: 0.377419
total KE: 0.468896
gen_total_KE: 0.220265 , KE scale factor :  0.469752
KE range: 15 , pdg :  -11
particle KE sf: 7.04628, p : 0.0919865 , mass :  0.000510999 , mom_sf: 7.01279
particle E : 0.0919879 , scaled E : 0.645083
KE range: 1 , pdg :  2212
particle KE sf: 0.469752, p : 0.922327 , mass :  0.938272 , mom_sf: 0.65425
particle E : 1.31569 , scaled E : 1.11557
Total number particles: 0
Begin processing the 20th record. run: 200003 subRun: 0 event: 20 at 15-Jan-2026 22:21:12 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:12 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:12 CET run: 200003 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 869436332
%MSG
Processing a new event...
Generating a rain particle at (-219.271,112.386,858.77)
Generated boost parameter gamma beta = 2.29099, cos(theta) = 0.583155, phi = 3.04673
Generating a boost (-0.741178,0.0705201,0.534459)
Event Vertex @ (-219.271,112.386,858.77) ... 8 particles...
  0th instance PDG -13
  1th instance PDG 2112
  2th instance PDG -211
  3th instance PDG 211
  4th instance PDG 2112
  5th instance PDG 2212
  6th instance PDG 2112
  7th instance PDG 2212
E: 0.568877 , m: 0.105658 , KE: 0.463219
E: 1.09924 , m: 0.939565 , KE: 0.159672
E: 0.844421 , m: 0.13957 , KE: 0.704851
E: 1.08652 , m: 0.13957 , KE: 0.946951
E: 1.55244 , m: 0.939565 , KE: 0.612876
E: 1.80442 , m: 0.938272 , KE: 0.866151
E: 1.79107 , m: 0.939565 , KE: 0.851507
E: 1.40806 , m: 0.938272 , KE: 0.46979
total KE: 5.07502
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.558979 , mass :  0.105658 , mom_sf: 12.6179
particle E : 0.568877 , scaled E : 7.05394
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.832807 , mass :  0.13957 , mom_sf: 2.27732
particle E : 0.844421 , scaled E : 1.9017
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 1.07752 , mass :  0.13957 , mom_sf: 2.32298
particle E : 1.08652 , scaled E : 2.50695
Total number particles: 0
15-Jan-2026 22:21:13 CET  Closed output file "mpvmpr_monte-carlo-011977-000003_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000276347   0.000614858   0.00462875    0.000349917   0.000934584      20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.2362e-05    5.78664e-05   0.000351781    3.427e-05    6.99697e-05      20     
simulate:rns:RandomNumberSaver                 9.548e-06    2.38797e-05   0.000269274   1.0124e-05    5.63792e-05      20     
simulate:generator:MultiPartVertex             5.746e-05    0.000145546   0.00089663    0.000107099   0.00017455       20     
[art]:TriggerResults:TriggerResultInserter     4.909e-06    6.78885e-06   3.2903e-05     5.355e-06    6.00233e-06      20     
end_path:out1:RootOutput                       7.31e-07      1.539e-06    1.1712e-05     9.17e-07     2.37121e-06      20     
end_path:out1:RootOutput(write)               3.8343e-05    0.000227788   0.00240793    4.59935e-05   0.000525383      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:13 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           869436332   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 585.077 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.316427 Real = 1.584212

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 585.077

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 111K Jan 15 22:21 mpvmpr_monte-carlo-011977-000003_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000003
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:48:05 UTC       justIN version: 01.06.00