justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.44@dunegpschedd01.fnal.gov

Jobsub ID279313.44@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2026-01-15 22:21:44
From worker nodeHostnamewn-la-19.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:41
Input filesmonte-carlo-011977-000046
JobscriptExit code0
Real time0m (20s)
CPU time0m (17s = 84%)
Max RSS bytes589983744 (562 MiB)
Outputting started2026-01-15 21:22:02
Output files
Finished2026-01-15 22:21:36
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ion step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:22:00 CET run: 200046 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 397448377
%MSG
Processing a new event...
Generating a rain particle at (126.103,48.944,390.387)
Generated boost parameter gamma beta = 2.45719, cos(theta) = 0.467883, phi = 2.05467
Generating a boost (-0.380821,0.724621,0.433369)
Event Vertex @ (126.103,48.944,390.387) ... 3 particles...
  0th instance PDG -11
  1th instance PDG 211
  2th instance PDG 2212
E: 0.862719 , m: 0.000510999 , KE: 0.862208
E: 0.691536 , m: 0.13957 , KE: 0.551966
E: 1.92816 , m: 0.938272 , KE: 0.989887
total KE: 2.40406
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.862719 , mass :  0.000510999 , mom_sf: 14.9917
particle E : 0.862719 , scaled E : 12.9336
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.677305 , mass :  0.13957 , mom_sf: 2.23394
particle E : 0.691536 , scaled E : 1.51949
Total number particles: 0
Begin processing the 19th record. run: 200046 subRun: 0 event: 19 at 15-Jan-2026 22:22:00 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:22:00 CET run: 200046 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 186315544
%MSG
Processing a new event...
Generating a rain particle at (-248.025,439.062,399.121)
Generated boost parameter gamma beta = 1.0776, cos(theta) = 0.532484, phi = 2.08678
Generating a boost (-0.306126,0.539668,0.390315)
Event Vertex @ (-248.025,439.062,399.121) ... 2 particles...
  0th instance PDG -11
  1th instance PDG 22
E: 0.0284563 , m: 0.000510999 , KE: 0.0279453
E: 0.208242 , m: 0 , KE: 0.208242
total KE: 0.236187
gen_total_KE: 0.242669 , KE scale factor :  1.02744
KE range: 15 , pdg :  -11
particle KE sf: 15.4117, p : 0.0284517 , mass :  0.000510999 , mom_sf: 15.1553
particle E : 0.0284563 , scaled E : 0.431194
KE range: 2.5 , pdg :  22
particle KE sf: 2.56861, p : 0.208242 , mass :  0 , mom_sf: 2.56861
particle E : 0.208242 , scaled E : 0.534892
Total number particles: 0
Begin processing the 20th record. run: 200046 subRun: 0 event: 20 at 15-Jan-2026 22:22:00 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:22:00 CET  run: 200046 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:22:00 CET run: 200046 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 59884520
%MSG
Processing a new event...
Generating a rain particle at (-113.889,-451.6,684.979)
Generated boost parameter gamma beta = 1.85049, cos(theta) = 0.716821, phi = 2.31943
Generating a boost (-0.417514,0.449405,0.63063)
Event Vertex @ (-113.889,-451.6,684.979) ... 10 particles...
  0th instance PDG 11
  1th instance PDG 2112
  2th instance PDG 2212
  3th instance PDG 211
  4th instance PDG 2112
  5th instance PDG 22
  6th instance PDG 2212
  7th instance PDG 211
  8th instance PDG 2112
  9th instance PDG 111
E: 0.202246 , m: 0.000510999 , KE: 0.201735
E: 1.16626 , m: 0.939565 , KE: 0.226695
E: 1.91433 , m: 0.938272 , KE: 0.976055
E: 0.976773 , m: 0.13957 , KE: 0.837203
E: 1.53732 , m: 0.939565 , KE: 0.59775
E: 0.167033 , m: 0 , KE: 0.167033
E: 1.62121 , m: 0.938272 , KE: 0.682934
E: 0.635089 , m: 0.13957 , KE: 0.495519
E: 1.12439 , m: 0.939565 , KE: 0.184822
E: 0.906672 , m: 0.134977 , KE: 0.771695
total KE: 5.14144
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.202246 , mass :  0.000510999 , mom_sf: 14.9647
particle E : 0.202246 , scaled E : 3.02654
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.96675 , mass :  0.13957 , mom_sf: 2.30485
particle E : 0.976773 , scaled E : 2.23258
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.167033 , mass :  0 , mom_sf: 2.5
particle E : 0.167033 , scaled E : 0.417581
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.619563 , mass :  0.13957 , mom_sf: 2.21331
particle E : 0.635089 , scaled E : 1.37837
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.896568 , mass :  0.134977 , mom_sf: 2.29742
particle E : 0.906672 , scaled E : 2.06421
Total number particles: 0
15-Jan-2026 22:22:01 CET  Closed output file "mpvmpr_monte-carlo-011977-000046_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000378993   0.000788495   0.00484118    0.000498262   0.000951168      20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.4916e-05    6.88786e-05   0.000279587   4.9913e-05    5.14313e-05      20     
simulate:rns:RandomNumberSaver                1.2739e-05    2.76368e-05   0.00023503    1.39955e-05   4.84607e-05      20     
simulate:generator:MultiPartVertex            8.6129e-05    0.000208149   0.000864317   0.00017905    0.000161921      20     
[art]:TriggerResults:TriggerResultInserter     5.889e-06    9.39945e-06   4.4076e-05     6.455e-06    8.98539e-06      20     
end_path:out1:RootOutput                       1.051e-06    2.6794e-06    1.7186e-05     1.202e-06    4.23982e-06      20     
end_path:out1:RootOutput(write)               5.1165e-05    0.000285074   0.00266708    6.19775e-05   0.000573605      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:22:01 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)            59884520   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 582.009 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.443979 Real = 1.547856

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 582.009

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 111K Jan 15 22:22 mpvmpr_monte-carlo-011977-000046_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000046
=== GEN job completed successfully ===
justIN time: 2026-02-04 09:15:15 UTC       justIN version: 01.06.00