justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.0@dunegpschedd01.fnal.gov

Jobsub ID279313.0@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2026-01-15 22:20:47
From worker nodeHostnamewn-da-14.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:04
Input filesmonte-carlo-011977-000008
JobscriptExit code0
Real time0m (21s)
CPU time0m (13s = 61%)
Max RSS bytes590938112 (563 MiB)
Outputting started2026-01-15 21:21:25
Output files
Finished2026-01-15 22:20:47
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:24 CET run: 200008 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 729705290
%MSG
Processing a new event...
Generating a rain particle at (195.529,-396.258,645.508)
Generated boost parameter gamma beta = 2.62371, cos(theta) = 0.603709, phi = 6.22787
Generating a boost (0.743792,-0.0411846,0.564124)
Event Vertex @ (195.529,-396.258,645.508) ... 1 particles...
  0th instance PDG -13
E: 0.994968 , m: 0.105658 , KE: 0.88931
total KE: 0.88931
gen_total_KE: 0.966618 , KE scale factor :  1.08693
KE range: 15 , pdg :  -13
particle KE sf: 16.304, p : 0.989342 , mass :  0.105658 , mom_sf: 14.7619
particle E : 0.994968 , scaled E : 14.6049
Total number particles: 0
Begin processing the 19th record. run: 200008 subRun: 0 event: 19 at 15-Jan-2026 22:21:24 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:24 CET run: 200008 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 127224304
%MSG
Processing a new event...
Generating a rain particle at (-245.113,151.917,866.523)
Generated boost parameter gamma beta = 2.94219, cos(theta) = -0.708472, phi = 3.08463
Generating a boost (-0.667115,0.0380422,-0.670786)
Event Vertex @ (-245.113,151.917,866.523) ... 10 particles...
  0th instance PDG -13
  1th instance PDG 2112
  2th instance PDG 22
  3th instance PDG -211
  4th instance PDG 22
  5th instance PDG 211
  6th instance PDG 3122
  7th instance PDG 2112
  8th instance PDG 2112
  9th instance PDG 2212
E: 1.0528 , m: 0.105658 , KE: 0.947139
E: 1.05018 , m: 0.939565 , KE: 0.110613
E: 0.135165 , m: 0 , KE: 0.135165
E: 0.48584 , m: 0.13957 , KE: 0.34627
E: 0.296264 , m: 0 , KE: 0.296264
E: 0.15079 , m: 0.13957 , KE: 0.0112204
E: 1.52076 , m: 1.11568 , KE: 0.40508
E: 1.75969 , m: 0.939565 , KE: 0.820125
E: 1.73265 , m: 0.939565 , KE: 0.793081
E: 1.09674 , m: 0.938272 , KE: 0.158467
total KE: 4.02342
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 1.04748 , mass :  0.105658 , mom_sf: 13.6636
particle E : 1.0528 , scaled E : 14.3127
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.135165 , mass :  0 , mom_sf: 2.5
particle E : 0.135165 , scaled E : 0.337913
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.46536 , mass :  0.13957 , mom_sf: 2.13922
particle E : 0.48584 , scaled E : 1.00524
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.296264 , mass :  0 , mom_sf: 2.5
particle E : 0.296264 , scaled E : 0.74066
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.0570784 , mass :  0.13957 , mom_sf: 1.62632
particle E : 0.15079 , scaled E : 0.167621
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 1.03343 , mass :  1.11568 , mom_sf: 1.98037
particle E : 1.52076 , scaled E : 2.33092
Total number particles: 0
Begin processing the 20th record. run: 200008 subRun: 0 event: 20 at 15-Jan-2026 22:21:24 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:24 CET  run: 200008 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:24 CET run: 200008 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 479862410
%MSG
Processing a new event...
Generating a rain particle at (-212.305,-385.894,1160.68)
Generated boost parameter gamma beta = 2.09315, cos(theta) = -0.75012, phi = 3.15442
Generating a boost (-0.596653,-0.00765204,-0.676844)
Event Vertex @ (-212.305,-385.894,1160.68) ... 10 particles...
  0th instance PDG 11
  1th instance PDG 2112
  2th instance PDG 211
  3th instance PDG -211
  4th instance PDG 3122
  5th instance PDG 2212
  6th instance PDG 2112
  7th instance PDG 2112
  8th instance PDG 22
  9th instance PDG 2212
E: 0.144841 , m: 0.000510999 , KE: 0.14433
E: 1.18341 , m: 0.939565 , KE: 0.24384
E: 0.527337 , m: 0.13957 , KE: 0.387767
E: 0.219551 , m: 0.13957 , KE: 0.0799814
E: 1.84872 , m: 1.11568 , KE: 0.733037
E: 1.13818 , m: 0.938272 , KE: 0.199908
E: 1.18496 , m: 0.939565 , KE: 0.245393
E: 1.63881 , m: 0.939565 , KE: 0.699248
E: 0.141953 , m: 0 , KE: 0.141953
E: 1.34335 , m: 0.938272 , KE: 0.405074
total KE: 3.28053
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.14484 , mass :  0.000510999 , mom_sf: 14.9507
particle E : 0.144841 , scaled E : 2.16545
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.508532 , mass :  0.13957 , mom_sf: 2.16342
particle E : 0.527337 , scaled E : 1.10899
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.169479 , mass :  0.13957 , mom_sf: 1.82625
particle E : 0.219551 , scaled E : 0.339523
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 1.47411 , mass :  1.11568 , mom_sf: 2.11747
particle E : 1.84872 , scaled E : 3.31479
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.141953 , mass :  0 , mom_sf: 2.5
particle E : 0.141953 , scaled E : 0.354882
Total number particles: 0
15-Jan-2026 22:21:25 CET  Closed output file "mpvmpr_monte-carlo-011977-000008_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000278611   0.000599915   0.00396915    0.000413672   0.000782421      20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       3.2791e-05    4.56298e-05   0.000190852   3.54625e-05   3.44418e-05      20     
simulate:rns:RandomNumberSaver                 1.029e-05    2.0644e-05    0.000196634   1.08605e-05   4.04474e-05      20     
simulate:generator:MultiPartVertex            6.6376e-05    0.000167154   0.000887678   0.000130337   0.000170352      20     
[art]:TriggerResults:TriggerResultInserter     5.29e-06     7.0007e-06    3.0378e-05     5.786e-06    5.37087e-06      20     
end_path:out1:RootOutput                       8.62e-07     1.47815e-06    9.337e-06    1.0415e-06    1.8146e-06       20     
end_path:out1:RootOutput(write)               3.9826e-05    0.000210041   0.00206089    5.00705e-05   0.000441002      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:25 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           479862410   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 585.286 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.285697 Real = 1.561853

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 585.286

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 110K Jan 15 22:21 mpvmpr_monte-carlo-011977-000008_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000008
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:48:04 UTC       justIN version: 01.06.00