justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.26@dunegpschedd01.fnal.gov

Jobsub ID279313.26@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 22:21:09
From worker nodeHostnamewn-da-12.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:30
Input filesmonte-carlo-011977-000035
JobscriptExit code0
Real time0m (13s)
CPU time0m (12s = 92%)
Max RSS bytes590835712 (563 MiB)
Outputting started2026-01-15 21:21:44
Output files
Finished2026-01-15 22:21:09
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ning on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:43 CET run: 200035 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 616656798
%MSG
Processing a new event...
Generating a rain particle at (-15.4184,522.341,45.6745)
Generated boost parameter gamma beta = 0.73319, cos(theta) = 0.0312178, phi = 0.715319
Generating a boost (0.446136,0.387612,0.0184587)
Event Vertex @ (-15.4184,522.341,45.6745) ... 3 particles...
  0th instance PDG 13
  1th instance PDG 22
  2th instance PDG 111
E: 0.975506 , m: 0.105658 , KE: 0.869848
E: 0.485921 , m: 0 , KE: 0.485921
E: 0.546399 , m: 0.134977 , KE: 0.411422
total KE: 1.76719
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.969767 , mass :  0.105658 , mom_sf: 13.563
particle E : 0.975506 , scaled E : 13.1534
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.485921 , mass :  0 , mom_sf: 2.5
particle E : 0.485921 , scaled E : 1.2148
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.529464 , mass :  0.134977 , mom_sf: 2.18272
particle E : 0.546399 , scaled E : 1.16353
Total number particles: 0
Begin processing the 19th record. run: 200035 subRun: 0 event: 19 at 15-Jan-2026 22:21:43 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:43 CET run: 200035 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 241893389
%MSG
Processing a new event...
Generating a rain particle at (-235.563,17.3555,1279.99)
Generated boost parameter gamma beta = 2.47143, cos(theta) = -0.8469, phi = 3.88874
Generating a boost (-0.361628,-0.334969,-0.785069)
Event Vertex @ (-235.563,17.3555,1279.99) ... 8 particles...
  0th instance PDG 11
  1th instance PDG 2212
  2th instance PDG 22
  3th instance PDG 22
  4th instance PDG 2112
  5th instance PDG 2112
  6th instance PDG 2212
  7th instance PDG -211
E: 0.935771 , m: 0.000510999 , KE: 0.93526
E: 1.50051 , m: 0.938272 , KE: 0.562234
E: 0.504952 , m: 0 , KE: 0.504952
E: 0.408494 , m: 0 , KE: 0.408494
E: 1.44537 , m: 0.939565 , KE: 0.505805
E: 1.6414 , m: 0.939565 , KE: 0.701839
E: 1.6748 , m: 0.938272 , KE: 0.736527
E: 0.167985 , m: 0.13957 , KE: 0.028415
total KE: 4.38352
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.935771 , mass :  0.000510999 , mom_sf: 14.9924
particle E : 0.935771 , scaled E : 14.0294
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.504952 , mass :  0 , mom_sf: 2.5
particle E : 0.504952 , scaled E : 1.26238
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.408494 , mass :  0 , mom_sf: 2.5
particle E : 0.408494 , scaled E : 1.02123
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.0934835 , mass :  0.13957 , mom_sf: 1.68715
particle E : 0.167985 , scaled E : 0.210607
Total number particles: 0
Begin processing the 20th record. run: 200035 subRun: 0 event: 20 at 15-Jan-2026 22:21:43 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:43 CET  run: 200035 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:43 CET run: 200035 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 348447156
%MSG
Processing a new event...
Generating a rain particle at (-264.344,493.221,580.051)
Generated boost parameter gamma beta = 0.125405, cos(theta) = -0.676914, phi = 5.41626
Generating a boost (0.0592734,-0.0698217,-0.0842285)
Event Vertex @ (-264.344,493.221,580.051) ... 8 particles...
  0th instance PDG -11
  1th instance PDG 111
  2th instance PDG 111
  3th instance PDG 211
  4th instance PDG 2112
  5th instance PDG 2212
  6th instance PDG 2112
  7th instance PDG 3122
E: 0.665424 , m: 0.000510999 , KE: 0.664913
E: 0.177298 , m: 0.134977 , KE: 0.0423207
E: 0.355466 , m: 0.134977 , KE: 0.220489
E: 0.893739 , m: 0.13957 , KE: 0.754169
E: 1.05074 , m: 0.939565 , KE: 0.111175
E: 1.84025 , m: 0.938272 , KE: 0.901977
E: 1.52539 , m: 0.939565 , KE: 0.585825
E: 1.69756 , m: 1.11568 , KE: 0.581878
total KE: 3.86275
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.665424 , mass :  0.000510999 , mom_sf: 14.9893
particle E : 0.665424 , scaled E : 9.97421
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.114959 , mass :  0.134977 , mom_sf: 1.73442
particle E : 0.177298 , scaled E : 0.240779
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.328842 , mass :  0.134977 , mom_sf: 2.04594
particle E : 0.355466 , scaled E : 0.686198
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.882774 , mass :  0.13957 , mom_sf: 2.28844
particle E : 0.893739 , scaled E : 2.02499
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 1.27944 , mass :  1.11568 , mom_sf: 2.05937
particle E : 1.69756 , scaled E : 2.86132
Total number particles: 0
15-Jan-2026 22:21:44 CET  Closed output file "mpvmpr_monte-carlo-011977-000035_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000273131   0.000626126   0.00419826    0.000369725   0.000830517      20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.3875e-05    4.85004e-05   0.000233094   3.53125e-05   4.36812e-05      20     
simulate:rns:RandomNumberSaver                1.0109e-05    2.24488e-05   0.000221663   1.1011e-05    4.58027e-05      20     
simulate:generator:MultiPartVertex            6.1307e-05    0.000172853   0.00086523    0.000138685   0.00016271       20     
[art]:TriggerResults:TriggerResultInserter     5.22e-06     7.55195e-06   3.3213e-05     5.741e-06    6.1929e-06       20     
end_path:out1:RootOutput                       8.52e-07     1.6035e-06    1.1271e-05     1.047e-06    2.23553e-06      20     
end_path:out1:RootOutput(write)               4.1288e-05    0.000218705   0.00217408    4.8843e-05    0.000465144      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:44 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           348447156   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 585.294 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.140788 Real = 1.197328

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 585.294

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 107K Jan 15 22:21 mpvmpr_monte-carlo-011977-000035_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000035
=== GEN job completed successfully ===
justIN time: 2026-02-04 06:07:33 UTC       justIN version: 01.06.00