justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 273436.25@dunegpschedd02.fnal.gov

Jobsub ID273436.25@dunegpschedd02.fnal.gov
Workflow ID11970
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 18:50:13
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce02
Last heartbeat2026-01-15 19:50:49
From worker nodeHostnameccwcondor0553
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 18:50:44
Input filesmonte-carlo-011970-000003
JobscriptExit code0
Real time0m (28s)
CPU time0m (17s = 60%)
Max RSS bytes579792896 (552 MiB)
Outputting started2026-01-15 18:51:13
Output files
Finished2026-01-15 19:50:39
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

: 200003 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:11 CET run: 200003 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 193612672
%MSG
Processing a new event...
Generating a rain particle at (288.695,428.853,1187.1)
Generated boost parameter gamma beta = 0.471441, cos(theta) = -0.907714, phi = 3.98262
Generating a boost (-0.119288,-0.133358,-0.387075)
Event Vertex @ (288.695,428.853,1187.1) ... 5 particles...
  0th instance PDG 11
  1th instance PDG -211
  2th instance PDG 2212
  3th instance PDG 2212
  4th instance PDG 2112
E: 0.85639 , m: 0.000510999 , KE: 0.855879
E: 0.997852 , m: 0.13957 , KE: 0.858282
E: 1.79865 , m: 0.938272 , KE: 0.860378
E: 1.86187 , m: 0.938272 , KE: 0.9236
E: 1.8271 , m: 0.939565 , KE: 0.887537
total KE: 4.38567
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.85639 , mass :  0.000510999 , mom_sf: 14.9916
particle E : 0.85639 , scaled E : 12.8387
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.988043 , mass :  0.13957 , mom_sf: 2.30861
particle E : 0.997852 , scaled E : 2.28527
Total number particles: 0
Begin processing the 19th record. run: 200003 subRun: 0 event: 19 at 15-Jan-2026 19:51:11 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:11 CET run: 200003 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 787466283
%MSG
Processing a new event...
Generating a rain particle at (-330.485,-453.552,870.65)
Generated boost parameter gamma beta = 0.859567, cos(theta) = -0.359221, phi = 5.76544
Generating a boost (0.528611,-0.30108,-0.234158)
Event Vertex @ (-330.485,-453.552,870.65) ... 5 particles...
  0th instance PDG 11
  1th instance PDG 211
  2th instance PDG 2112
  3th instance PDG 2212
  4th instance PDG 3122
E: 0.210127 , m: 0.000510999 , KE: 0.209616
E: 0.909823 , m: 0.13957 , KE: 0.770253
E: 1.35607 , m: 0.939565 , KE: 0.416507
E: 1.16125 , m: 0.938272 , KE: 0.222973
E: 1.37252 , m: 1.11568 , KE: 0.256844
total KE: 1.87619
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.210126 , mass :  0.000510999 , mom_sf: 14.966
particle E : 0.210127 , scaled E : 3.14475
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.899054 , mass :  0.13957 , mom_sf: 2.29183
particle E : 0.909823 , scaled E : 2.0652
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 0.799426 , mass :  1.11568 , mom_sf: 1.90246
particle E : 1.37252 , scaled E : 1.88621
Total number particles: 0
Begin processing the 20th record. run: 200003 subRun: 0 event: 20 at 15-Jan-2026 19:51:11 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 19:51:11 CET  run: 200003 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 19:51:11 CET run: 200003 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 131789452
%MSG
Processing a new event...
Generating a rain particle at (-80.7861,223.758,454.102)
Generated boost parameter gamma beta = 2.44428, cos(theta) = 0.0311902, phi = 5.02809
Generating a boost (0.28722,-0.87937,0.0288677)
Event Vertex @ (-80.7861,223.758,454.102) ... 6 particles...
  0th instance PDG 13
  1th instance PDG 111
  2th instance PDG 211
  3th instance PDG 2212
  4th instance PDG 2212
  5th instance PDG 2212
E: 0.696878 , m: 0.105658 , KE: 0.59122
E: 0.34543 , m: 0.134977 , KE: 0.210453
E: 0.708241 , m: 0.13957 , KE: 0.568671
E: 1.23025 , m: 0.938272 , KE: 0.291973
E: 1.52996 , m: 0.938272 , KE: 0.591683
E: 1.34205 , m: 0.938272 , KE: 0.40378
total KE: 2.65778
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.688822 , mass :  0.105658 , mom_sf: 13.0271
particle E : 0.696878 , scaled E : 8.97396
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.317967 , mass :  0.134977 , mom_sf: 2.03538
particle E : 0.34543 , scaled E : 0.661108
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.694353 , mass :  0.13957 , mom_sf: 2.23949
particle E : 0.708241 , scaled E : 1.56125
Total number particles: 0
15-Jan-2026 19:51:13 CET  Closed output file "mpvmpr_monte-carlo-011970-000003_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000358451   0.000814905   0.00590999    0.000504719   0.00117943       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.3561e-05    7.61901e-05   0.00044333    5.0705e-05    8.64462e-05      20     
simulate:rns:RandomNumberSaver                1.2683e-05    2.79994e-05   0.00028328    1.3786e-05    5.86673e-05      20     
simulate:generator:MultiPartVertex            0.000104035   0.000213384   0.00117524    0.000160936   0.000224373      20     
[art]:TriggerResults:TriggerResultInserter     7.774e-06    1.19613e-05   4.7619e-05     8.11e-06     1.08202e-05      20     
end_path:out1:RootOutput                       1.102e-06    2.11795e-06   1.4888e-05    1.3275e-06    2.95339e-06      20     
end_path:out1:RootOutput(write)                4.812e-05    0.000296226   0.00314699    7.04765e-05   0.000671144      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 19:51:13 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           131789452   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1334.44 MB
  Peak resident set size usage (VmHWM): 565.797 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.688003 Real = 2.064623

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1334.44 VmHWM = 565.797

Art has completed and will exit with status 0.
-rw-r--r-- 1 dune001 lbno 108K Jan 15 19:51 mpvmpr_monte-carlo-011970-000003_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011970-000003
=== GEN job completed successfully ===
justIN time: 2026-02-04 13:40:13 UTC       justIN version: 01.06.00