justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.24@dunegpschedd01.fnal.gov

Jobsub ID279313.24@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2026-01-15 22:21:19
From worker nodeHostnamewn-la-19.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:13
Input filesmonte-carlo-011977-000017
JobscriptExit code0
Real time0m (25s)
CPU time0m (19s = 75%)
Max RSS bytes589819904 (562 MiB)
Outputting started2026-01-15 21:21:39
Output files
Finished2026-01-15 22:21:19
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: 2.56631
Total number particles: 0
Begin processing the 18th record. run: 200017 subRun: 0 event: 18 at 15-Jan-2026 22:21:36 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:36 CET run: 200017 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 810187981
%MSG
Processing a new event...
Generating a rain particle at (254.281,89.8726,337.72)
Generated boost parameter gamma beta = 0.891881, cos(theta) = -0.263374, phi = 2.45025
Generating a boost (-0.494675,0.409392,-0.175305)
Event Vertex @ (254.281,89.8726,337.72) ... 3 particles...
  0th instance PDG -13
  1th instance PDG 211
  2th instance PDG 2112
E: 0.793799 , m: 0.105658 , KE: 0.688141
E: 0.51191 , m: 0.13957 , KE: 0.37234
E: 1.54102 , m: 0.939565 , KE: 0.601457
total KE: 1.66194
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.786736 , mass :  0.105658 , mom_sf: 13.2538
particle E : 0.793799 , scaled E : 10.4278
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.492516 , mass :  0.13957 , mom_sf: 2.15482
particle E : 0.51191 , scaled E : 1.07042
Total number particles: 0
Begin processing the 19th record. run: 200017 subRun: 0 event: 19 at 15-Jan-2026 22:21:36 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:36 CET run: 200017 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 514171592
%MSG
Processing a new event...
Generating a rain particle at (239.123,-383.529,291.055)
Generated boost parameter gamma beta = 2.37457, cos(theta) = -0.429806, phi = 0.483283
Generating a boost (0.73684,0.386687,-0.396113)
Event Vertex @ (239.123,-383.529,291.055) ... 5 particles...
  0th instance PDG 13
  1th instance PDG -211
  2th instance PDG 2112
  3th instance PDG -211
  4th instance PDG 2112
E: 0.328819 , m: 0.105658 , KE: 0.223161
E: 0.775947 , m: 0.13957 , KE: 0.636377
E: 1.40176 , m: 0.939565 , KE: 0.462198
E: 0.619164 , m: 0.13957 , KE: 0.479594
E: 1.30897 , m: 0.939565 , KE: 0.369407
total KE: 2.17074
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.311381 , mass :  0.105658 , mom_sf: 11.0843
particle E : 0.328819 , scaled E : 3.45307
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.763291 , mass :  0.13957 , mom_sf: 2.25979
particle E : 0.775947 , scaled E : 1.73051
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.603228 , mass :  0.13957 , mom_sf: 2.20689
particle E : 0.619164 , scaled E : 1.33855
Total number particles: 0
Begin processing the 20th record. run: 200017 subRun: 0 event: 20 at 15-Jan-2026 22:21:36 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:36 CET  run: 200017 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:36 CET run: 200017 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 20098748
%MSG
Processing a new event...
Generating a rain particle at (206.119,-390.671,607.275)
Generated boost parameter gamma beta = 1.03731, cos(theta) = -0.134659, phi = 3.55268
Generating a boost (-0.653946,-0.28507,-0.0969461)
Event Vertex @ (206.119,-390.671,607.275) ... 7 particles...
  0th instance PDG 13
  1th instance PDG -211
  2th instance PDG 2112
  3th instance PDG 2212
  4th instance PDG 2212
  5th instance PDG 2212
  6th instance PDG 2112
E: 0.513498 , m: 0.105658 , KE: 0.40784
E: 0.391303 , m: 0.13957 , KE: 0.251733
E: 1.49234 , m: 0.939565 , KE: 0.55278
E: 0.975955 , m: 0.938272 , KE: 0.037683
E: 1.6078 , m: 0.938272 , KE: 0.669529
E: 1.07604 , m: 0.938272 , KE: 0.137769
E: 1.50037 , m: 0.939565 , KE: 0.560804
total KE: 2.61814
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.50251 , mass :  0.105658 , mom_sf: 12.3826
particle E : 0.513498 , scaled E : 6.22326
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.365566 , mass :  0.13957 , mom_sf: 2.06838
particle E : 0.391303 , scaled E : 0.768902
Total number particles: 0
15-Jan-2026 22:21:38 CET  Closed output file "mpvmpr_monte-carlo-011977-000017_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000356431   0.000790035   0.00534273    0.000487425   0.00105826       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.3545e-05    7.57947e-05   0.000440306   4.8748e-05    8.5363e-05       20     
simulate:rns:RandomNumberSaver                 1.299e-05    2.82037e-05   0.000280398   1.3776e-05    5.79645e-05      20     
simulate:generator:MultiPartVertex            8.3705e-05    0.000199355   0.00092677    0.000156453   0.000176171      20     
[art]:TriggerResults:TriggerResultInserter     5.829e-06    8.4608e-06    4.4165e-05      6.6e-06     8.21608e-06      20     
end_path:out1:RootOutput                       1.231e-06    2.0769e-06    1.4751e-05     1.307e-06    2.92907e-06      20     
end_path:out1:RootOutput(write)               4.8733e-05    0.000280734   0.00284776    6.48065e-05   0.000611431      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:38 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)            20098748   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 584.577 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.746311 Real = 2.210153

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 584.577

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 107K Jan 15 22:21 mpvmpr_monte-carlo-011977-000017_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000017
=== GEN job completed successfully ===
justIN time: 2026-02-04 06:07:45 UTC       justIN version: 01.06.00