justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.29@dunegpschedd01.fnal.gov

Jobsub ID279313.29@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 22:21:18
From worker nodeHostnamewn-da-12.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:40
Input filesmonte-carlo-011977-000042
JobscriptExit code0
Real time0m (15s)
CPU time0m (13s = 86%)
Max RSS bytes589819904 (562 MiB)
Outputting started2026-01-15 21:21:55
Output files
Finished2026-01-15 22:21:18
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:54 CET run: 200042 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 786033262
%MSG
Processing a new event...
Generating a rain particle at (-72.2614,92.4315,241.978)
Generated boost parameter gamma beta = 0.113479, cos(theta) = 0.212415, phi = 5.76972
Generating a boost (0.0959743,-0.0541215,0.023951)
Event Vertex @ (-72.2614,92.4315,241.978) ... 5 particles...
  0th instance PDG 13
  1th instance PDG 2212
  2th instance PDG 3122
  3th instance PDG 111
  4th instance PDG 22
E: 0.862578 , m: 0.105658 , KE: 0.75692
E: 1.51252 , m: 0.938272 , KE: 0.574247
E: 1.27569 , m: 1.11568 , KE: 0.160014
E: 0.374006 , m: 0.134977 , KE: 0.239029
E: 0.676404 , m: 0 , KE: 0.676404
total KE: 2.40662
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.856083 , mass :  0.105658 , mom_sf: 13.3854
particle E : 0.862578 , scaled E : 11.4595
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 0.61859 , mass :  1.11568 , mom_sf: 1.84431
particle E : 1.27569 , scaled E : 1.59572
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.348801 , mass :  0.134977 , mom_sf: 2.06424
particle E : 0.374006 , scaled E : 0.732551
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.676404 , mass :  0 , mom_sf: 2.5
particle E : 0.676404 , scaled E : 1.69101
Total number particles: 0
Begin processing the 19th record. run: 200042 subRun: 0 event: 19 at 15-Jan-2026 22:21:54 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:54 CET run: 200042 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 682669922
%MSG
Processing a new event...
Generating a rain particle at (-255.458,-485.108,499.596)
Generated boost parameter gamma beta = 2.92629, cos(theta) = -0.629158, phi = 5.98122
Generating a boost (0.702237,-0.218741,-0.595355)
Event Vertex @ (-255.458,-485.108,499.596) ... 4 particles...
  0th instance PDG 11
  1th instance PDG 111
  2th instance PDG 111
  3th instance PDG 2212
E: 0.878386 , m: 0.000510999 , KE: 0.877875
E: 1.06828 , m: 0.134977 , KE: 0.933307
E: 0.18246 , m: 0.134977 , KE: 0.0474826
E: 1.16136 , m: 0.938272 , KE: 0.223086
total KE: 2.08175
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.878386 , mass :  0.000510999 , mom_sf: 14.9919
particle E : 0.878386 , scaled E : 13.1686
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 1.05972 , mass :  0.134977 , mom_sf: 2.32566
particle E : 1.06828 , scaled E : 2.46824
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.122771 , mass :  0.134977 , mom_sf: 1.74955
particle E : 0.18246 , scaled E : 0.253684
Total number particles: 0
Begin processing the 20th record. run: 200042 subRun: 0 event: 20 at 15-Jan-2026 22:21:54 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:54 CET  run: 200042 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:54 CET run: 200042 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 342333020
%MSG
Processing a new event...
Generating a rain particle at (-158.833,-397.481,720.248)
Generated boost parameter gamma beta = 1.73807, cos(theta) = -0.132288, phi = 5.13966
Generating a boost (0.356024,-0.781919,-0.114663)
Event Vertex @ (-158.833,-397.481,720.248) ... 5 particles...
  0th instance PDG 13
  1th instance PDG 2112
  2th instance PDG -211
  3th instance PDG 22
  4th instance PDG 2112
E: 0.149854 , m: 0.105658 , KE: 0.0441957
E: 1.42693 , m: 0.939565 , KE: 0.487361
E: 0.231039 , m: 0.13957 , KE: 0.0914688
E: 0.826807 , m: 0 , KE: 0.826807
E: 1.07156 , m: 0.939565 , KE: 0.131996
total KE: 1.58183
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.106266 , mass :  0.105658 , mom_sf: 7.16405
particle E : 0.149854 , scaled E : 0.768593
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.184117 , mass :  0.13957 , mom_sf: 1.85082
particle E : 0.231039 , scaled E : 0.368242
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.826807 , mass :  0 , mom_sf: 2.5
particle E : 0.826807 , scaled E : 2.06702
Total number particles: 0
15-Jan-2026 22:21:55 CET  Closed output file "mpvmpr_monte-carlo-011977-000042_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000283441   0.000593659   0.00412773    0.000362596   0.000821273      20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.3954e-05    4.86784e-05   0.00020457    3.71305e-05   3.72712e-05      20     
simulate:rns:RandomNumberSaver                 9.969e-06    2.12775e-05   0.000211383   1.0555e-05    4.37098e-05      20     
simulate:generator:MultiPartVertex            6.1417e-05    0.00015145    0.000872112   0.000122844   0.000168365      20     
[art]:TriggerResults:TriggerResultInserter     5.16e-06     8.3668e-06    3.4004e-05    5.5905e-06    8.25698e-06      20     
end_path:out1:RootOutput                       8.51e-07     1.48535e-06   1.0349e-05     9.77e-07      2.049e-06       20     
end_path:out1:RootOutput(write)               3.7912e-05    0.000211539   0.00217752    5.01655e-05   0.000468075      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:55 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           342333020   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.56 MB
  Peak resident set size usage (VmHWM): 583.934 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.101352 Real = 1.152359

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.56 VmHWM = 583.934

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 107K Jan 15 22:21 mpvmpr_monte-carlo-011977-000042_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000042
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:49:07 UTC       justIN version: 01.06.00