justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273436.37@dunegpschedd02.fnal.gov

Jobsub ID273436.37@dunegpschedd02.fnal.gov
Workflow ID11970
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 18:50:13
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce04
Last heartbeat2026-01-15 19:51:13
From worker nodeHostnameccwcondor0039
cpuinfoAMD EPYC 9334 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 18:51:28
Input filesmonte-carlo-011970-000048
JobscriptExit code0
Real time0m (19s)
CPU time0m (13s = 68%)
Max RSS bytes587976704 (560 MiB)
Outputting started2026-01-15 18:51:48
Output files
Finished2026-01-15 19:51:13
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ex @ (-118.148,40.624,877.796) ... 2 particles...
  0th instance PDG -13
  1th instance PDG 111
E: 0.841495 , m: 0.105658 , KE: 0.735837
E: 0.355651 , m: 0.134977 , KE: 0.220674
total KE: 0.956511
gen_total_KE: 0.546964 , KE scale factor :  0.571832
KE range: 15 , pdg :  -13
particle KE sf: 8.57749, p : 0.834835 , mass :  0.105658 , mom_sf: 7.68585
particle E : 0.841495 , scaled E : 6.41729
KE range: 2.5 , pdg :  111
particle KE sf: 1.42958, p : 0.329043 , mass :  0.134977 , mom_sf: 1.30606
particle E : 0.355651 , scaled E : 0.450449
Total number particles: 0
Begin processing the 18th record. run: 200048 subRun: 0 event: 18 at 15-Jan-2026 19:51:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:46 CET run: 200048 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 308424679
%MSG
Processing a new event...
Generating a rain particle at (150.101,159.52,435.797)
Generated boost parameter gamma beta = 1.51332, cos(theta) = 0.129138, phi = 1.93746
Generating a boost (-0.296597,0.772323,0.107741)
Event Vertex @ (150.101,159.52,435.797) ... 3 particles...
  0th instance PDG -11
  1th instance PDG 111
  2th instance PDG 2112
E: 0.268798 , m: 0.000510999 , KE: 0.268287
E: 0.922878 , m: 0.134977 , KE: 0.787901
E: 0.992282 , m: 0.939565 , KE: 0.0527174
total KE: 1.10891
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.268798 , mass :  0.000510999 , mom_sf: 14.9734
particle E : 0.268798 , scaled E : 4.02482
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.912954 , mass :  0.134977 , mom_sf: 2.30066
particle E : 0.922878 , scaled E : 2.10473
Total number particles: 0
Begin processing the 19th record. run: 200048 subRun: 0 event: 19 at 15-Jan-2026 19:51:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:46 CET run: 200048 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 286473652
%MSG
Processing a new event...
Generating a rain particle at (-210.217,249.79,1098.76)
Generated boost parameter gamma beta = 1.07937, cos(theta) = 0.326422, phi = 4.49978
Generating a boost (-0.146314,-0.677768,0.239451)
Event Vertex @ (-210.217,249.79,1098.76) ... 3 particles...
  0th instance PDG 11
  1th instance PDG 2212
  2th instance PDG 22
E: 0.264556 , m: 0.000510999 , KE: 0.264045
E: 1.28215 , m: 0.938272 , KE: 0.343878
E: 0.348562 , m: 0 , KE: 0.348562
total KE: 0.956485
gen_total_KE: 0.752377 , KE scale factor :  0.786606
KE range: 15 , pdg :  11
particle KE sf: 11.7991, p : 0.264555 , mass :  0.000510999 , mom_sf: 11.7783
particle E : 0.264556 , scaled E : 3.116
KE range: 1 , pdg :  2212
particle KE sf: 0.786606, p : 0.873817 , mass :  0.938272 , mom_sf: 0.87213
particle E : 1.28215 , scaled E : 1.20877
KE range: 2.5 , pdg :  22
particle KE sf: 1.96652, p : 0.348562 , mass :  0 , mom_sf: 1.96652
particle E : 0.348562 , scaled E : 0.685452
Total number particles: 0
Begin processing the 20th record. run: 200048 subRun: 0 event: 20 at 15-Jan-2026 19:51:46 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:46 CET  run: 200048 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:46 CET run: 200048 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 367555515
%MSG
Processing a new event...
Generating a rain particle at (236.677,390.733,1320.77)
Generated boost parameter gamma beta = 1.97626, cos(theta) = -0.0748316, phi = 2.47068
Generating a boost (-0.696919,0.553171,-0.0667702)
Event Vertex @ (236.677,390.733,1320.77) ... 1 particles...
  0th instance PDG 11
E: 0.071711 , m: 0.000510999 , KE: 0.0712
total KE: 0.0712
gen_total_KE: 0.293342 , KE scale factor :  4.11998
KE range: 15 , pdg :  11
particle KE sf: 61.7997, p : 0.0717092 , mass :  0.000510999 , mom_sf: 61.368
particle E : 0.071711 , scaled E : 4.40065
Total number particles: 0
15-Jan-2026 19:51:47 CET  Closed output file "mpvmpr_monte-carlo-011970-000048_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000285444   0.000661531    0.0049706    0.000372705    0.0010001       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.5303e-05    5.84736e-05   0.000373797   3.87485e-05   7.3535e-05       20     
simulate:rns:RandomNumberSaver                 9.925e-06    2.49639e-05   0.000275197   1.1127e-05    5.7494e-05       20     
simulate:generator:MultiPartVertex            7.0187e-05    0.000180733   0.000950711   0.000148986   0.000182811      20     
[art]:TriggerResults:TriggerResultInserter     5.498e-06    7.80845e-06   4.1523e-05     5.949e-06    7.75073e-06      20     
end_path:out1:RootOutput                       9.01e-07     1.6618e-06     1.317e-05     9.86e-07     2.65699e-06      20     
end_path:out1:RootOutput(write)                3.971e-05    0.000232596   0.00256244    4.8639e-05    0.000550509      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 19:51:47 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           367555515   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1334.44 MB
  Peak resident set size usage (VmHWM): 562.115 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.315516 Real = 1.598457

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1334.44 VmHWM = 562.115

Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 lbno 111K Jan 15 19:51 mpvmpr_monte-carlo-011970-000048_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011970-000048
=== GEN job completed successfully ===
justIN time: 2026-02-04 06:23:42 UTC       justIN version: 01.06.00