justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.35@dunegpschedd01.fnal.gov

Jobsub ID279313.35@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 22:21:25
From worker nodeHostnamewn-da-22.gina.surf.nl
cpuinfoAMD EPYC-Rome Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:42
Input filesmonte-carlo-011977-000045
JobscriptExit code0
Real time0m (15s)
CPU time0m (13s = 86%)
Max RSS bytes588759040 (561 MiB)
Outputting started2026-01-15 21:21:58
Output files
Finished2026-01-15 22:21:25
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

tion or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:56 CET run: 200045 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 381371124
%MSG
Processing a new event...
Generating a rain particle at (-21.5135,475.609,682.894)
Generated boost parameter gamma beta = 0.631348, cos(theta) = 0.291734, phi = 0.25806
Generating a boost (0.493722,0.130315,0.155743)
Event Vertex @ (-21.5135,475.609,682.894) ... 7 particles...
  0th instance PDG 13
  1th instance PDG 22
  2th instance PDG 2112
  3th instance PDG 3122
  4th instance PDG 2112
  5th instance PDG 2112
  6th instance PDG 2212
E: 0.436469 , m: 0.105658 , KE: 0.330811
E: 0.818674 , m: 0 , KE: 0.818674
E: 1.74419 , m: 0.939565 , KE: 0.804623
E: 1.9774 , m: 1.11568 , KE: 0.861722
E: 1.61694 , m: 0.939565 , KE: 0.677375
E: 1.32871 , m: 0.939565 , KE: 0.389147
E: 1.31361 , m: 0.938272 , KE: 0.375339
total KE: 4.25769
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.423487 , mass :  0.105658 , mom_sf: 11.9643
particle E : 0.436469 , scaled E : 5.06782
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.818674 , mass :  0 , mom_sf: 2.5
particle E : 0.818674 , scaled E : 2.04669
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 1.6326 , mass :  1.11568 , mom_sf: 2.16138
particle E : 1.9774 , scaled E : 3.70085
Total number particles: 0
Begin processing the 19th record. run: 200045 subRun: 0 event: 19 at 15-Jan-2026 22:21:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:56 CET run: 200045 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 400008321
%MSG
Processing a new event...
Generating a rain particle at (-229.84,-560.614,1003.33)
Generated boost parameter gamma beta = 0.391064, cos(theta) = -0.442743, phi = 1.34159
Generating a boost (0.0741981,0.318023,-0.161249)
Event Vertex @ (-229.84,-560.614,1003.33) ... 5 particles...
  0th instance PDG 11
  1th instance PDG 111
  2th instance PDG 111
  3th instance PDG -211
  4th instance PDG 2212
E: 0.150448 , m: 0.000510999 , KE: 0.149937
E: 0.624868 , m: 0.134977 , KE: 0.489891
E: 0.884359 , m: 0.134977 , KE: 0.749382
E: 0.317613 , m: 0.13957 , KE: 0.178043
E: 1.212 , m: 0.938272 , KE: 0.273726
total KE: 1.84098
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.150447 , mass :  0.000510999 , mom_sf: 14.9525
particle E : 0.150448 , scaled E : 2.24956
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.610115 , mass :  0.134977 , mom_sf: 2.21759
particle E : 0.624868 , scaled E : 1.3597
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.873998 , mass :  0.134977 , mom_sf: 2.29279
particle E : 0.884359 , scaled E : 2.00843
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.285304 , mass :  0.13957 , mom_sf: 1.99007
particle E : 0.317613 , scaled E : 0.584678
Total number particles: 0
Begin processing the 20th record. run: 200045 subRun: 0 event: 20 at 15-Jan-2026 22:21:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:56 CET  run: 200045 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:56 CET run: 200045 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 140531715
%MSG
Processing a new event...
Generating a rain particle at (319.424,299.417,839.752)
Generated boost parameter gamma beta = 1.39143, cos(theta) = -0.534469, phi = 3.38757
Generating a boost (-0.665668,-0.167123,-0.43401)
Event Vertex @ (319.424,299.417,839.752) ... 5 particles...
  0th instance PDG 11
  1th instance PDG 22
  2th instance PDG 2212
  3th instance PDG 211
  4th instance PDG 2212
E: 0.0362669 , m: 0.000510999 , KE: 0.0357559
E: 0.637821 , m: 0 , KE: 0.637821
E: 1.24426 , m: 0.938272 , KE: 0.305989
E: 1.04132 , m: 0.13957 , KE: 0.901749
E: 1.86279 , m: 0.938272 , KE: 0.924522
total KE: 2.80584
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.0362633 , mass :  0.000510999 , mom_sf: 14.8042
particle E : 0.0362669 , scaled E : 0.536849
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.637821 , mass :  0 , mom_sf: 2.5
particle E : 0.637821 , scaled E : 1.59455
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 1.03192 , mass :  0.13957 , mom_sf: 2.31594
particle E : 1.04132 , scaled E : 2.39394
Total number particles: 0
15-Jan-2026 22:21:57 CET  Closed output file "mpvmpr_monte-carlo-011977-000045_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000310412   0.000765462   0.00596844    0.000440586   0.00120553       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                        3.684e-05    6.64173e-05   0.000413698   4.2686e-05    8.23414e-05      20     
simulate:rns:RandomNumberSaver                1.1131e-05    2.84403e-05   0.000308859   1.1988e-05    6.4713e-05       20     
simulate:generator:MultiPartVertex            7.2067e-05    0.000185933    0.0011775    0.000141715   0.000229808      20     
[art]:TriggerResults:TriggerResultInserter     5.651e-06    9.9797e-06    5.3712e-05    6.2275e-06    1.09167e-05      20     
end_path:out1:RootOutput                       9.32e-07     2.42515e-06    1.589e-05     1.107e-06    3.76046e-06      20     
end_path:out1:RootOutput(write)               4.2801e-05    0.000293615   0.00311265    7.1361e-05    0.000663844      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:57 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           140531715   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 583.123 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.429083 Real = 1.713690

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 583.123

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 111K Jan 15 22:21 mpvmpr_monte-carlo-011977-000045_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000045
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:48:12 UTC       justIN version: 01.06.00