justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273436.60@dunegpschedd02.fnal.gov

Jobsub ID273436.60@dunegpschedd02.fnal.gov
Workflow ID11970
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 18:50:13
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2026-01-15 19:50:41
From worker nodeHostnameccwcondor0367
cpuinfoAMD EPYC 9334 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 18:51:00
Input filesmonte-carlo-011970-000016
JobscriptExit code0
Real time0m (21s)
CPU time0m (13s = 61%)
Max RSS bytes587132928 (559 MiB)
Outputting started2026-01-15 18:51:22
Output files
Finished2026-01-15 19:50:41
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

new event...
Generating a rain particle at (-242.995,-32.8102,351.88)
Generated boost parameter gamma beta = 1.04282, cos(theta) = 0.989665, phi = 4.88781
Generating a boost (0.0180632,-0.101914,0.714309)
Event Vertex @ (-242.995,-32.8102,351.88) ... 3 particles...
  0th instance PDG 11
  1th instance PDG 211
  2th instance PDG 2212
E: 0.475394 , m: 0.000510999 , KE: 0.474883
E: 0.948077 , m: 0.13957 , KE: 0.808507
E: 1.19749 , m: 0.938272 , KE: 0.259221
total KE: 1.54261
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.475394 , mass :  0.000510999 , mom_sf: 14.985
particle E : 0.475394 , scaled E : 7.12376
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.937747 , mass :  0.13957 , mom_sf: 2.29947
particle E : 0.948077 , scaled E : 2.16084
Total number particles: 0
Begin processing the 18th record. run: 200016 subRun: 0 event: 18 at 15-Jan-2026 19:51:20 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:20 CET run: 200016 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 860217083
%MSG
Processing a new event...
Generating a rain particle at (200.642,-147.583,706.51)
Generated boost parameter gamma beta = 0.0334554, cos(theta) = 0.696572, phi = 5.0965
Generating a boost (0.00899002,-0.0222423,0.023291)
Event Vertex @ (200.642,-147.583,706.51) ... 5 particles...
  0th instance PDG -13
  1th instance PDG 2112
  2th instance PDG 211
  3th instance PDG 2212
  4th instance PDG 2112
E: 0.670146 , m: 0.105658 , KE: 0.564488
E: 1.85365 , m: 0.939565 , KE: 0.914082
E: 0.531883 , m: 0.13957 , KE: 0.392313
E: 1.80781 , m: 0.938272 , KE: 0.86954
E: 1.39028 , m: 0.939565 , KE: 0.450719
total KE: 3.19114
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.661764 , mass :  0.105658 , mom_sf: 12.9537
particle E : 0.670146 , scaled E : 8.57298
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.513244 , mass :  0.13957 , mom_sf: 2.16588
particle E : 0.531883 , scaled E : 1.12035
Total number particles: 0
Begin processing the 19th record. run: 200016 subRun: 0 event: 19 at 15-Jan-2026 19:51:20 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:20 CET run: 200016 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 497505835
%MSG
Processing a new event...
Generating a rain particle at (-48.1881,399.641,390.173)
Generated boost parameter gamma beta = 1.76882, cos(theta) = 0.652856, phi = 2.85913
Generating a boost (-0.633267,0.183791,0.56832)
Event Vertex @ (-48.1881,399.641,390.173) ... 3 particles...
  0th instance PDG 13
  1th instance PDG 2112
  2th instance PDG 2212
E: 0.995051 , m: 0.105658 , KE: 0.889393
E: 1.51833 , m: 0.939565 , KE: 0.578768
E: 1.69114 , m: 0.938272 , KE: 0.752866
total KE: 2.22103
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.989426 , mass :  0.105658 , mom_sf: 13.5898
particle E : 0.995051 , scaled E : 13.4466
Total number particles: 0
Begin processing the 20th record. run: 200016 subRun: 0 event: 20 at 15-Jan-2026 19:51:20 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:20 CET  run: 200016 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:20 CET run: 200016 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 314869217
%MSG
Processing a new event...
Generating a rain particle at (200.137,-249.404,667.777)
Generated boost parameter gamma beta = 1.97911, cos(theta) = 0.665607, phi = 3.28807
Generating a boost (-0.658968,-0.0972231,0.594077)
Event Vertex @ (200.137,-249.404,667.777) ... 1 particles...
  0th instance PDG 13
E: 1.02123 , m: 0.105658 , KE: 0.915574
total KE: 0.915574
gen_total_KE: 0.392077 , KE scale factor :  0.428231
KE range: 15 , pdg :  13
particle KE sf: 6.42346, p : 1.01575 , mass :  0.105658 , mom_sf: 5.89306
particle E : 1.02123 , scaled E : 5.98682
Total number particles: 0
15-Jan-2026 19:51:22 CET  Closed output file "mpvmpr_monte-carlo-011970-000016_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000271296   0.000825756   0.00700147    0.000391276    0.0014395       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.5413e-05    7.86356e-05   0.000505106   4.5849e-05    0.000102572      20     
simulate:rns:RandomNumberSaver                 9.975e-06    3.25583e-05   0.000368091   1.1332e-05    7.74496e-05      20     
simulate:generator:MultiPartVertex            6.3385e-05    0.000194981   0.00127562    0.000116915   0.000255005      20     
[art]:TriggerResults:TriggerResultInserter     4.857e-06    8.5802e-06    5.0105e-05    5.8635e-06    9.71684e-06      20     
end_path:out1:RootOutput                       8.11e-07     2.02455e-06   1.7196e-05    1.0015e-06    3.53173e-06      20     
end_path:out1:RootOutput(write)               4.3906e-05    0.000342228   0.00378478    8.36855e-05   0.000813212      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 19:51:22 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           314869217   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1334.44 MB
  Peak resident set size usage (VmHWM): 569.856 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.534576 Real = 1.715996

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1334.44 VmHWM = 569.856

Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 lbno 112K Jan 15 19:51 mpvmpr_monte-carlo-011970-000016_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011970-000016
=== GEN job completed successfully ===
justIN time: 2026-02-04 10:40:29 UTC       justIN version: 01.06.00