justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 279313.43@dunegpschedd01.fnal.gov

Jobsub ID279313.43@dunegpschedd01.fnal.gov
Workflow ID11977
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 21:20:19
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 22:21:19
From worker nodeHostnamewn-lb-08.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Started2026-01-15 21:21:09
Input filesmonte-carlo-011977-000013
JobscriptExit code0
Real time0m (25s)
CPU time0m (19s = 75%)
Max RSS bytes589975552 (562 MiB)
Outputting started2026-01-15 21:21:35
Output files
Finished2026-01-15 22:21:19
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rain particle at (-62.6657,-489.397,1224)
Generated boost parameter gamma beta = 0.111874, cos(theta) = 0.323774, phi = 1.1062
Generating a boost (0.0471325,0.0940419,0.0359975)
Event Vertex @ (-62.6657,-489.397,1224) ... 1 particles...
  0th instance PDG -11
E: 0.454903 , m: 0.000510999 , KE: 0.454392
total KE: 0.454392
gen_total_KE: 0.572062 , KE scale factor :  1.25896
KE range: 15 , pdg :  -11
particle KE sf: 18.8844, p : 0.454903 , mass :  0.000510999 , mom_sf: 18.8644
particle E : 0.454903 , scaled E : 8.58145
Total number particles: 0
Begin processing the 18th record. run: 200013 subRun: 0 event: 18 at 15-Jan-2026 22:21:32 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:32 CET run: 200013 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 321560867
%MSG
Processing a new event...
Generating a rain particle at (267.694,-434.454,776.892)
Generated boost parameter gamma beta = 2.76786, cos(theta) = 0.106354, phi = 2.97796
Generating a boost (-0.922674,0.152341,0.100026)
Event Vertex @ (267.694,-434.454,776.892) ... 5 particles...
  0th instance PDG -13
  1th instance PDG 22
  2th instance PDG 22
  3th instance PDG -211
  4th instance PDG 2112
E: 0.578665 , m: 0.105658 , KE: 0.473007
E: 0.77525 , m: 0 , KE: 0.77525
E: 0.27593 , m: 0 , KE: 0.27593
E: 0.586473 , m: 0.13957 , KE: 0.446903
E: 1.60722 , m: 0.939565 , KE: 0.667658
total KE: 2.63875
KE range: 15 , pdg :  -13
particle KE sf: 15, p : 0.568937 , mass :  0.105658 , mom_sf: 12.6552
particle E : 0.578665 , scaled E : 7.20076
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.77525 , mass :  0 , mom_sf: 2.5
particle E : 0.77525 , scaled E : 1.93812
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.27593 , mass :  0 , mom_sf: 2.5
particle E : 0.27593 , scaled E : 0.689825
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.569624 , mass :  0.13957 , mom_sf: 2.19277
particle E : 0.586473 , scaled E : 1.25683
Total number particles: 0
Begin processing the 19th record. run: 200013 subRun: 0 event: 19 at 15-Jan-2026 22:21:32 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:32 CET run: 200013 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 409987596
%MSG
Processing a new event...
Generating a rain particle at (165.3,335.314,1351.7)
Generated boost parameter gamma beta = 1.59846, cos(theta) = 0.730627, phi = 3.34124
Generating a boost (-0.567339,-0.114798,0.619402)
Event Vertex @ (165.3,335.314,1351.7) ... 1 particles...
  0th instance PDG -11
E: 0.839911 , m: 0.000510999 , KE: 0.8394
total KE: 0.8394
gen_total_KE: 0.739174 , KE scale factor :  0.880598
KE range: 15 , pdg :  -11
particle KE sf: 13.209, p : 0.839911 , mass :  0.000510999 , mom_sf: 13.2015
particle E : 0.839911 , scaled E : 11.0881
Total number particles: 0
Begin processing the 20th record. run: 200013 subRun: 0 event: 20 at 15-Jan-2026 22:21:32 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 22:21:32 CET  run: 200013 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  15-Jan-2026 22:21:32 CET run: 200013 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 224736576
%MSG
Processing a new event...
Generating a rain particle at (231.052,417.812,60.699)
Generated boost parameter gamma beta = 2.95891, cos(theta) = -0.504793, phi = 2.98786
Generating a boost (-0.808154,0.125225,-0.478221)
Event Vertex @ (231.052,417.812,60.699) ... 3 particles...
  0th instance PDG 11
  1th instance PDG 2112
  2th instance PDG 2112
E: 0.150388 , m: 0.000510999 , KE: 0.149877
E: 1.88789 , m: 0.939565 , KE: 0.948323
E: 1.86921 , m: 0.939565 , KE: 0.929643
total KE: 2.02784
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.150387 , mass :  0.000510999 , mom_sf: 14.9525
particle E : 0.150388 , scaled E : 2.24867
Total number particles: 0
15-Jan-2026 22:21:34 CET  Closed output file "mpvmpr_monte-carlo-011977-000013_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000356033   0.000803096   0.00559717    0.000470115   0.00111886       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.5178e-05    7.53244e-05   0.000389854   5.1267e-05    7.49054e-05      20     
simulate:rns:RandomNumberSaver                1.2779e-05    2.93771e-05   0.000284678   1.4972e-05    5.87608e-05      20     
simulate:generator:MultiPartVertex            8.4047e-05    0.000201342   0.000957315   0.000160585   0.000183808      20     
[art]:TriggerResults:TriggerResultInserter     6.029e-06    1.21995e-05    8.068e-05      6.7e-06     1.75348e-05      20     
end_path:out1:RootOutput                       1.151e-06    2.07185e-06   1.5222e-05     1.262e-06    3.04417e-06      20     
end_path:out1:RootOutput(write)               5.0145e-05    0.00028716    0.00299345    6.44515e-05   0.000643396      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 22:21:34 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           224736576   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1336.57 MB
  Peak resident set size usage (VmHWM): 583.5 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.761266 Real = 2.213874

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1336.57 VmHWM = 583.5

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 111K Jan 15 22:21 mpvmpr_monte-carlo-011977-000013_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011977-000013
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:48:18 UTC       justIN version: 01.06.00