justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273436.40@dunegpschedd02.fnal.gov

Jobsub ID273436.40@dunegpschedd02.fnal.gov
Workflow ID11970
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 18:50:13
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2026-01-15 20:06:09
From worker nodeHostnamehnode80.pic.es
cpuinfoAMD EPYC 7443P 24-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 18:50:53
Input filesmonte-carlo-011970-000009
JobscriptExit code0
Real time0m (10s)
CPU time0m (7s = 69%)
Max RSS bytes606806016 (578 MiB)
Outputting started2026-01-15 18:51:04
Output files
Finished2026-01-15 20:06:09
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

KE: 0.15613
total KE: 1.63306
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.777746 , mass :  0.105658 , mom_sf: 13.2352
particle E : 0.78489 , scaled E : 10.2941
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.926816 , mass :  0.13957 , mom_sf: 2.29737
particle E : 0.937266 , scaled E : 2.13381
Total number particles: 0
Begin processing the 18th record. run: 200009 subRun: 0 event: 18 at 15-Jan-2026 19:51:03 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:03 CET run: 200009 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 41259513
%MSG
Processing a new event...
Generating a rain particle at (-55.3393,155.857,1310)
Generated boost parameter gamma beta = 2.32937, cos(theta) = -0.833434, phi = 4.8428
Generating a boost (0.0660374,-0.503491,-0.765844)
Event Vertex @ (-55.3393,155.857,1310) ... 3 particles...
  0th instance PDG -11
  1th instance PDG 2112
  2th instance PDG 2212
E: 0.983923 , m: 0.000510999 , KE: 0.983412
E: 1.58262 , m: 0.939565 , KE: 0.64305
E: 1.02145 , m: 0.938272 , KE: 0.0831814
total KE: 1.70964
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.983923 , mass :  0.000510999 , mom_sf: 14.9927
particle E : 0.983923 , scaled E : 14.7517
Total number particles: 0
Begin processing the 19th record. run: 200009 subRun: 0 event: 19 at 15-Jan-2026 19:51:03 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:03 CET run: 200009 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 521466683
%MSG
Processing a new event...
Generating a rain particle at (163.619,-523.74,993.665)
Generated boost parameter gamma beta = 1.0827, cos(theta) = 0.647354, phi = 2.63374
Generating a boost (-0.489245,0.272283,0.47555)
Event Vertex @ (163.619,-523.74,993.665) ... 10 particles...
  0th instance PDG -11
  1th instance PDG 2112
  2th instance PDG 2212
  3th instance PDG 2112
  4th instance PDG 2212
  5th instance PDG 2212
  6th instance PDG 2112
  7th instance PDG 2212
  8th instance PDG 111
  9th instance PDG 22
E: 0.440479 , m: 0.000510999 , KE: 0.439968
E: 1.882 , m: 0.939565 , KE: 0.942436
E: 1.2145 , m: 0.938272 , KE: 0.276223
E: 1.78991 , m: 0.939565 , KE: 0.850342
E: 1.32671 , m: 0.938272 , KE: 0.388436
E: 0.999389 , m: 0.938272 , KE: 0.0611172
E: 1.19778 , m: 0.939565 , KE: 0.258212
E: 1.89178 , m: 0.938272 , KE: 0.953504
E: 1.10514 , m: 0.134977 , KE: 0.970162
E: 0.0753578 , m: 0 , KE: 0.0753578
total KE: 5.21576
KE range: 15 , pdg :  -11
particle KE sf: 15, p : 0.440478 , mass :  0.000510999 , mom_sf: 14.9838
particle E : 0.440479 , scaled E : 6.60002
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 1.09687 , mass :  0.134977 , mom_sf: 2.33103
particle E : 1.10514 , scaled E : 2.56038
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.0753578 , mass :  0 , mom_sf: 2.5
particle E : 0.0753578 , scaled E : 0.188395
Total number particles: 0
Begin processing the 20th record. run: 200009 subRun: 0 event: 20 at 15-Jan-2026 19:51:03 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:03 CET  run: 200009 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:03 CET run: 200009 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 210411026
%MSG
Processing a new event...
Generating a rain particle at (-56.8364,404.845,449.044)
Generated boost parameter gamma beta = 0.48226, cos(theta) = 0.753594, phi = 3.77352
Generating a boost (-0.230399,-0.168667,0.32735)
Event Vertex @ (-56.8364,404.845,449.044) ... 1 particles...
  0th instance PDG 13
E: 0.989139 , m: 0.105658 , KE: 0.883481
total KE: 0.883481
gen_total_KE: 0.829077 , KE scale factor :  0.938421
KE range: 15 , pdg :  13
particle KE sf: 14.0763, p : 0.98348 , mass :  0.105658 , mom_sf: 12.752
particle E : 0.989139 , scaled E : 12.5418
Total number particles: 0
15-Jan-2026 19:51:03 CET  Closed output file "mpvmpr_monte-carlo-011970-000009_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000196646   0.00038937    0.00227749    0.000252892   0.000445155      20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                        2.638e-05    3.32472e-05   0.000122633   2.70805e-05   2.1217e-05       20     
simulate:rns:RandomNumberSaver                 7.53e-06     1.33323e-05   0.000108353    7.985e-06    2.18727e-05      20     
simulate:generator:MultiPartVertex            5.1161e-05    0.000110494   0.000512704   8.6843e-05    9.67974e-05      20     
[art]:TriggerResults:TriggerResultInserter     3.66e-06     4.8251e-06     2.123e-05     3.93e-06     3.77549e-06      20     
end_path:out1:RootOutput                       6.31e-07     9.9165e-07     6.041e-06     6.95e-07     1.16855e-06      20     
end_path:out1:RootOutput(write)               2.6471e-05    0.000129803   0.00115586    3.1861e-05    0.000254086      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 19:51:03 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           210411026   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 583.574 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 0.727087 Real = 0.845771

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 583.574

Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 dune 111K Jan 15 19:51 mpvmpr_monte-carlo-011970-000009_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011970-000009
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:52:51 UTC       justIN version: 01.06.00