justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273436.69@dunegpschedd02.fnal.gov

Jobsub ID273436.69@dunegpschedd02.fnal.gov
Workflow ID11970
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 18:50:13
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce02
Last heartbeat2026-01-15 19:50:54
From worker nodeHostnameccwcondor0722
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 18:51:02
Input filesmonte-carlo-011970-000018
JobscriptExit code0
Real time0m (28s)
CPU time0m (16s = 57%)
Max RSS bytes575795200 (549 MiB)
Outputting started2026-01-15 18:51:31
Output files
Finished2026-01-15 19:50:54
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

018 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:28 CET run: 200018 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 853102442
%MSG
Processing a new event...
Generating a rain particle at (-324.31,-442.114,493.558)
Generated boost parameter gamma beta = 1.90378, cos(theta) = -0.0763836, phi = 5.85628
Generating a boost (0.80349,-0.365495,-0.0676223)
Event Vertex @ (-324.31,-442.114,493.558) ... 8 particles...
  0th instance PDG -13
  1th instance PDG 111
  2th instance PDG 111
  3th instance PDG 2212
  4th instance PDG 211
  5th instance PDG -211
  6th instance PDG 2112
  7th instance PDG 2112
E: 0.993985 , m: 0.105658 , KE: 0.888327
E: 0.578328 , m: 0.134977 , KE: 0.443351
E: 1.09686 , m: 0.134977 , KE: 0.961882
E: 1.67142 , m: 0.938272 , KE: 0.733146
E: 0.382025 , m: 0.13957 , KE: 0.242455
E: 0.952161 , m: 0.13957 , KE: 0.812591
E: 1.35123 , m: 0.939565 , KE: 0.411669
E: 1.45955 , m: 0.939565 , KE: 0.519986
total KE: 5.01341
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.988353 , mass :  0.105658 , mom_sf: 13.5884
particle E : 0.993985 , scaled E : 13.4306
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.562356 , mass :  0.134977 , mom_sf: 2.19791
particle E : 0.578328 , scaled E : 1.24335
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 1.08852 , mass :  0.134977 , mom_sf: 2.32985
particle E : 1.09686 , scaled E : 2.53968
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.355617 , mass :  0.13957 , mom_sf: 2.05989
particle E : 0.382025 , scaled E : 0.745707
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.941877 , mass :  0.13957 , mom_sf: 2.30026
particle E : 0.952161 , scaled E : 2.17105
Total number particles: 0
Begin processing the 19th record. run: 200018 subRun: 0 event: 19 at 15-Jan-2026 19:51:28 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:28 CET run: 200018 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 1765263
%MSG
Processing a new event...
Generating a rain particle at (253.569,-46.0423,892.046)
Generated boost parameter gamma beta = 0.22547, cos(theta) = 0.868329, phi = 1.98543
Generating a boost (-0.0439482,0.0998481,0.190988)
Event Vertex @ (253.569,-46.0423,892.046) ... 2 particles...
  0th instance PDG -13
  1th instance PDG 2212
E: 0.952013 , m: 0.105658 , KE: 0.846355
E: 1.04511 , m: 0.938272 , KE: 0.106837
total KE: 0.953192
gen_total_KE: 0.966287 , KE scale factor :  1.01374
KE range: 15 , pdg :  -13
particle KE sf: 15.2061, p : 0.946131 , mass :  0.105658 , mom_sf: 13.7137
particle E : 0.952013 , scaled E : 12.9754
KE range: 1 , pdg :  2212
particle KE sf: 1.01374, p : 0.460324 , mass :  0.938272 , mom_sf: 1.00722
particle E : 1.04511 , scaled E : 1.04658
Total number particles: 0
Begin processing the 20th record. run: 200018 subRun: 0 event: 20 at 15-Jan-2026 19:51:28 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:28 CET  run: 200018 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:28 CET run: 200018 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 118304636
%MSG
Processing a new event...
Generating a rain particle at (-201.981,-25.9623,1353.65)
Generated boost parameter gamma beta = 1.54053, cos(theta) = -0.407221, phi = 5.19007
Generating a boost (0.352181,-0.680329,-0.341568)
Event Vertex @ (-201.981,-25.9623,1353.65) ... 7 particles...
  0th instance PDG -11
  1th instance PDG 2212
  2th instance PDG 2112
  3th instance PDG 2112
  4th instance PDG 211
  5th instance PDG 211
  6th instance PDG 2112
E: 0.407958 , m: 0.000510999 , KE: 0.407447
E: 1.50937 , m: 0.938272 , KE: 0.571098
E: 1.60556 , m: 0.939565 , KE: 0.665993
E: 1.43589 , m: 0.939565 , KE: 0.496326
E: 0.845976 , m: 0.13957 , KE: 0.706406
E: 0.92808 , m: 0.13957 , KE: 0.78851
E: 1.35901 , m: 0.939565 , KE: 0.419444
total KE: 4.05522
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.407958 , mass :  0.000510999 , mom_sf: 14.9825
particle E : 0.407958 , scaled E : 6.11222
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.834383 , mass :  0.13957 , mom_sf: 2.27769
particle E : 0.845976 , scaled E : 1.90559
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.917525 , mass :  0.13957 , mom_sf: 2.29555
particle E : 0.92808 , scaled E : 2.11084
Total number particles: 0
15-Jan-2026 19:51:30 CET  Closed output file "mpvmpr_monte-carlo-011970-000018_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000293984   0.000735299   0.00563958    0.000437639   0.00113565       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.6479e-05    6.59583e-05   0.000482078   3.8793e-05    9.67831e-05      20     
simulate:rns:RandomNumberSaver                1.0279e-05    3.02695e-05   0.000379275   1.1096e-05    8.01491e-05      20     
simulate:generator:MultiPartVertex            7.0102e-05    0.00019711    0.00102712    0.000173758   0.000194694      20     
[art]:TriggerResults:TriggerResultInserter     5.751e-06    8.19155e-06   4.0016e-05     6.457e-06    7.31662e-06      20     
end_path:out1:RootOutput                       8.91e-07     1.7659e-06    1.4027e-05     1.022e-06    2.85225e-06      20     
end_path:out1:RootOutput(write)               4.0376e-05    0.000264933   0.00287819    5.6226e-05    0.00061553       20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 19:51:30 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           118304636   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1334.44 MB
  Peak resident set size usage (VmHWM): 565.654 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.597750 Real = 2.844774

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1334.44 VmHWM = 565.654

Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 lbno 111K Jan 15 19:51 mpvmpr_monte-carlo-011970-000018_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011970-000018
=== GEN job completed successfully ===
justIN time: 2026-02-04 13:40:20 UTC       justIN version: 01.06.00