justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278526.14@dunegpschedd01.fnal.gov

Jobsub ID278526.14@dunegpschedd01.fnal.gov
Workflow ID11939
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 01:25:14
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc01
Last heartbeat2026-01-15 01:29:49
From worker nodeHostnamewn-la-15.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 01:26:17
Input filesmonte-carlo-011939-000017
JobscriptExit code0
Real time0m (30s)
CPU time0m (21s = 69%)
Max RSS bytes588984320 (561 MiB)
Outputting started2026-01-15 01:26:48
Output files
Finished2026-01-15 01:29:49
Saved logsjustin-logs:278526.14-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

om_sf: 2.5
particle E : 0.464393 , scaled E : 1.16098
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.951868 , mass :  0.13957 , mom_sf: 2.30213
particle E : 0.962046 , scaled E : 2.19576
Total number particles: 0
Begin processing the 18th record. run: 200015 subRun: 0 event: 18 at 15-Jan-2026 02:26:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 02:26:46 CET run: 200015 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 787660525
%MSG
Processing a new event...
Generating a rain particle at (313.265,-71.4546,172)
Generated boost parameter gamma beta = 2.02736, cos(theta) = 0.336804, phi = 2.89315
Generating a boost (-0.818509,0.207643,0.302057)
Event Vertex @ (313.265,-71.4546,172) ... 5 particles...
  0th instance PDG -11
  1th instance PDG 111
  2th instance PDG 2112
  3th instance PDG 2112
  4th instance PDG 2212
E: 0.458377 , m: 0.000510999 , KE: 0.457866
E: 0.936481 , m: 0.134977 , KE: 0.801504
E: 1.29803 , m: 0.939565 , KE: 0.358463
E: 1.88287 , m: 0.939565 , KE: 0.943304
E: 0.972706 , m: 0.938272 , KE: 0.0344344
total KE: 2.59557
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.458376 , mass :  0.000510999 , mom_sf: 14.9844
particle E : 0.458377 , scaled E : 6.8685
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.926702 , mass :  0.134977 , mom_sf: 2.3033
particle E : 0.936481 , scaled E : 2.13874
Total number particles: 0
Begin processing the 19th record. run: 200015 subRun: 0 event: 19 at 15-Jan-2026 02:26:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 02:26:46 CET run: 200015 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 722651036
%MSG
Processing a new event...
Generating a rain particle at (-86.6534,-348.491,101.851)
Generated boost parameter gamma beta = 2.95533, cos(theta) = 0.855773, phi = 0.626618
Generating a boost (0.396954,0.287374,0.810624)
Event Vertex @ (-86.6534,-348.491,101.851) ... 7 particles...
  0th instance PDG -11
  1th instance PDG 2112
  2th instance PDG 111
  3th instance PDG -211
  4th instance PDG 2212
  5th instance PDG 2212
  6th instance PDG 2112
E: 0.736177 , m: 0.000510999 , KE: 0.735666
E: 1.89159 , m: 0.939565 , KE: 0.952021
E: 0.984148 , m: 0.134977 , KE: 0.849171
E: 0.166824 , m: 0.13957 , KE: 0.0272538
E: 1.04462 , m: 0.938272 , KE: 0.106353
E: 1.13058 , m: 0.938272 , KE: 0.192309
E: 1.51974 , m: 0.939565 , KE: 0.580173
total KE: 3.44295
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.736177 , mass :  0.000510999 , mom_sf: 14.9903
particle E : 0.736177 , scaled E : 11.0355
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.974848 , mass :  0.134977 , mom_sf: 2.31202
particle E : 0.984148 , scaled E : 2.2579
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.0913804 , mass :  0.13957 , mom_sf: 1.68332
particle E : 0.166824 , scaled E : 0.207704
Total number particles: 0
Begin processing the 20th record. run: 200015 subRun: 0 event: 20 at 15-Jan-2026 02:26:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 02:26:46 CET  run: 200015 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 02:26:46 CET run: 200015 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 534438709
%MSG
Processing a new event...
Generating a rain particle at (-95.0796,-257.218,1359.74)
Generated boost parameter gamma beta = 2.75522, cos(theta) = -0.953925, phi = 1.61644
Generating a boost (-0.0128686,0.281749,-0.896691)
Event Vertex @ (-95.0796,-257.218,1359.74) ... 2 particles...
  0th instance PDG -13
  1th instance PDG 2212
E: 0.502019 , m: 0.105658 , KE: 0.396361
E: 1.72288 , m: 0.938272 , KE: 0.784612
total KE: 1.18097
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.490775 , mass :  0.105658 , mom_sf: 12.3278
particle E : 0.502019 , scaled E : 6.05108
Total number particles: 0
15-Jan-2026 02:26:47 CET  Closed output file "mpvmpr_monte-carlo-011939-000017_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.00034079    0.00081863    0.00535948    0.000500069   0.00106239       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.4938e-05    7.68694e-05   0.000377864   5.3144e-05    7.30249e-05      20     
simulate:rns:RandomNumberSaver                1.2699e-05    2.73914e-05   0.000256035   1.4191e-05    5.26033e-05      20     
simulate:generator:MultiPartVertex            8.4877e-05    0.000223201   0.000970822   0.000184415   0.000179134      20     
[art]:TriggerResults:TriggerResultInserter     6.079e-06     8.571e-06    4.3175e-05     6.675e-06    7.96314e-06      20     
end_path:out1:RootOutput                       1.182e-06    2.07015e-06   1.3831e-05     1.372e-06    2.71752e-06      20     
end_path:out1:RootOutput(write)               4.8322e-05    0.000290206   0.00289768    6.0741e-05    0.00062795       20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 02:26:47 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           534438709   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 583.602 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.726269 Real = 2.197190

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 583.602

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 108K Jan 15 02:26 mpvmpr_monte-carlo-011939-000017_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011939-000017
=== GEN job completed successfully ===
justIN time: 2026-02-04 13:01:11 UTC       justIN version: 01.06.00