justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.16@dunegpschedd01.fnal.gov

Jobsub ID279313.16@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 22:21:32
From worker nodeHostnamewn-lb-17.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:19
Input filesmonte-carlo-011977-000022
JobscriptExit code0
Real time0m (28s)
CPU time0m (20s = 71%)
Max RSS bytes590946304 (563 MiB)
Outputting started2026-01-15 21:21:48
Output files
Finished2026-01-15 22:21:32
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

d failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:46 CET run: 200022 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 446377047
%MSG
Processing a new event...
Generating a rain particle at (-273.93,-525.661,138.847)
Generated boost parameter gamma beta = 0.378919, cos(theta) = 0.832814, phi = 3.67052
Generating a boost (-0.16934,-0.0989759,0.295095)
Event Vertex @ (-273.93,-525.661,138.847) ... 7 particles...
  0th instance PDG 11
  1th instance PDG 2112
  2th instance PDG 2112
  3th instance PDG 2212
  4th instance PDG 111
  5th instance PDG 2212
  6th instance PDG 211
E: 0.901551 , m: 0.000510999 , KE: 0.90104
E: 1.53745 , m: 0.939565 , KE: 0.59789
E: 1.23613 , m: 0.939565 , KE: 0.296564
E: 1.55303 , m: 0.938272 , KE: 0.614755
E: 0.235603 , m: 0.134977 , KE: 0.100626
E: 1.84351 , m: 0.938272 , KE: 0.905233
E: 0.92863 , m: 0.13957 , KE: 0.78906
total KE: 4.20517
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.90155 , mass :  0.000510999 , mom_sf: 14.9921
particle E : 0.901551 , scaled E : 13.5161
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.193106 , mass :  0.134977 , mom_sf: 1.8757
particle E : 0.235603 , scaled E : 0.386542
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.918081 , mass :  0.13957 , mom_sf: 2.29566
particle E : 0.92863 , scaled E : 2.11222
Total number particles: 0
Begin processing the 19th record. run: 200022 subRun: 0 event: 19 at 15-Jan-2026 22:21:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:46 CET run: 200022 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 543968223
%MSG
Processing a new event...
Generating a rain particle at (144.436,172.378,361.544)
Generated boost parameter gamma beta = 1.11799, cos(theta) = -0.397916, phi = 3.5696
Generating a boost (-0.622112,-0.283814,-0.296583)
Event Vertex @ (144.436,172.378,361.544) ... 6 particles...
  0th instance PDG 13
  1th instance PDG 2112
  2th instance PDG 22
  3th instance PDG 2112
  4th instance PDG -211
  5th instance PDG 2112
E: 0.530364 , m: 0.105658 , KE: 0.424706
E: 1.67537 , m: 0.939565 , KE: 0.735808
E: 0.306513 , m: 0 , KE: 0.306513
E: 1.0878 , m: 0.939565 , KE: 0.148238
E: 0.586085 , m: 0.13957 , KE: 0.446515
E: 1.87503 , m: 0.939565 , KE: 0.935467
total KE: 2.99725
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.519733 , mass :  0.105658 , mom_sf: 12.4591
particle E : 0.530364 , scaled E : 6.47625
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.306513 , mass :  0 , mom_sf: 2.5
particle E : 0.306513 , scaled E : 0.766282
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.569224 , mass :  0.13957 , mom_sf: 2.1926
particle E : 0.586085 , scaled E : 1.25586
Total number particles: 0
Begin processing the 20th record. run: 200022 subRun: 0 event: 20 at 15-Jan-2026 22:21:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:46 CET  run: 200022 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:46 CET run: 200022 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 583007353
%MSG
Processing a new event...
Generating a rain particle at (-74.0801,263.009,47.1581)
Generated boost parameter gamma beta = 0.318034, cos(theta) = -0.484649, phi = 5.24994
Generating a boost (0.135743,-0.227714,-0.146886)
Event Vertex @ (-74.0801,263.009,47.1581) ... 7 particles...
  0th instance PDG -11
  1th instance PDG 2212
  2th instance PDG 2112
  3th instance PDG 2112
  4th instance PDG 211
  5th instance PDG 2212
  6th instance PDG 2212
E: 0.731089 , m: 0.000510999 , KE: 0.730578
E: 1.07728 , m: 0.938272 , KE: 0.139012
E: 1.93 , m: 0.939565 , KE: 0.99044
E: 1.58413 , m: 0.939565 , KE: 0.64456
E: 1.10186 , m: 0.13957 , KE: 0.962285
E: 1.09548 , m: 0.938272 , KE: 0.15721
E: 1.86436 , m: 0.938272 , KE: 0.926085
total KE: 4.55017
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.731089 , mass :  0.000510999 , mom_sf: 14.9902
particle E : 0.731089 , scaled E : 10.9592
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 1.09298 , mass :  0.13957 , mom_sf: 2.32525
particle E : 1.10186 , scaled E : 2.54528
Total number particles: 0
15-Jan-2026 22:21:48 CET  Closed output file "mpvmpr_monte-carlo-011977-000022_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000393897   0.000882415   0.00620777    0.000510602    0.0012388       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.4737e-05    8.25206e-05   0.000480746   5.19535e-05   9.59849e-05      20     
simulate:rns:RandomNumberSaver                1.2899e-05    3.13185e-05   0.000292846   1.47175e-05   6.04761e-05      20     
simulate:generator:MultiPartVertex            0.000111465   0.000233698   0.00109683    0.000182352   0.000202919      20     
[art]:TriggerResults:TriggerResultInserter     6.179e-06    8.9297e-06    5.2658e-05    6.4505e-06    1.00549e-05      20     
end_path:out1:RootOutput                       1.092e-06    2.15585e-06   1.7085e-05    1.2625e-06    3.45828e-06      20     
end_path:out1:RootOutput(write)               5.1467e-05    0.000329046   0.00339473     7.399e-05    0.000724639      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:48 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           583007353   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 584.561 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.985771 Real = 2.450984

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 584.561

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 112K Jan 15 22:21 mpvmpr_monte-carlo-011977-000022_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000022
=== GEN job completed successfully ===
justIN time: 2026-02-04 06:07:22 UTC       justIN version: 01.06.00