justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278526.51@dunegpschedd01.fnal.gov

Jobsub ID278526.51@dunegpschedd01.fnal.gov
Workflow ID11939
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 01:25:14
SiteBR_CBPF
EntryDUNE_BR_CBPF_ce03
Last heartbeat2026-01-15 01:35:58
From worker nodeHostnamewn79
cpuinfoAMD EPYC 7713P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 01:26:24
Input filesmonte-carlo-011939-000026
JobscriptExit code0
Real time0m (44s)
CPU time0m (20s = 45%)
Max RSS bytes567934976 (541 MiB)
Outputting started2026-01-15 01:27:09
Output files
Finished2026-01-15 01:35:58
Saved logsjustin-logs:278526.51-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  14-Jan-2026 22:27:05 -03 run: 200022 subRun: 0 event: 18
Random seed for this event, engine 'generator.GenVertex': 712786461
%MSG
Processing a new event...
Generating a rain particle at (126.553,126.563,622.006)
Generated boost parameter gamma beta = 1.11352, cos(theta) = 0.77482, phi = 5.19559
Generating a boost (0.218534,-0.416502,0.576476)
Event Vertex @ (126.553,126.563,622.006) ... 4 particles...
  0th instance PDG 13
  1th instance PDG 2112
  2th instance PDG 22
  3th instance PDG 211
E: 0.415687 , m: 0.105658 , KE: 0.310029
E: 1.34164 , m: 0.939565 , KE: 0.402072
E: 0.286698 , m: 0 , KE: 0.286698
E: 0.723996 , m: 0.13957 , KE: 0.584426
total KE: 1.58322
KE range: 15 , pdg :  13
particle KE sf: 15, p : 0.402035 , mass :  0.105658 , mom_sf: 11.8271
particle E : 0.415687 , scaled E : 4.7561
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.286698 , mass :  0 , mom_sf: 2.5
particle E : 0.286698 , scaled E : 0.716745
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.710416 , mass :  0.13957 , mom_sf: 2.24451
particle E : 0.723996 , scaled E : 1.60063
Total number particles: 0
Begin processing the 19th record. run: 200022 subRun: 0 event: 19 at 14-Jan-2026 22:27:05 -03
%MSG-w ParticleInventory:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  14-Jan-2026 22:27:05 -03 run: 200022 subRun: 0 event: 19
Random seed for this event, engine 'generator.GenVertex': 494286318
%MSG
Processing a new event...
Generating a rain particle at (-279.564,373.633,267.298)
Generated boost parameter gamma beta = 1.89198, cos(theta) = -0.573779, phi = 3.10248
Generating a boost (-0.723537,0.0283118,-0.50728)
Event Vertex @ (-279.564,373.633,267.298) ... 7 particles...
  0th instance PDG 11
  1th instance PDG 2112
  2th instance PDG 22
  3th instance PDG 3122
  4th instance PDG 2112
  5th instance PDG 211
  6th instance PDG 2212
E: 0.888071 , m: 0.000510999 , KE: 0.88756
E: 1.63464 , m: 0.939565 , KE: 0.695079
E: 0.916565 , m: 0 , KE: 0.916565
E: 1.88412 , m: 1.11568 , KE: 0.768441
E: 1.1605 , m: 0.939565 , KE: 0.220935
E: 0.241128 , m: 0.13957 , KE: 0.101558
E: 1.12628 , m: 0.938272 , KE: 0.188007
total KE: 3.77815
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.88807 , mass :  0.000510999 , mom_sf: 14.9919
particle E : 0.888071 , scaled E : 13.3139
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.916565 , mass :  0 , mom_sf: 2.5
particle E : 0.916565 , scaled E : 2.29141
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 1.51828 , mass :  1.11568 , mom_sf: 2.13002
particle E : 1.88412 , scaled E : 3.421
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.196628 , mass :  0.13957 , mom_sf: 1.87093
particle E : 0.241128 , scaled E : 0.393464
Total number particles: 0
Begin processing the 20th record. run: 200022 subRun: 0 event: 20 at 14-Jan-2026 22:27:05 -03
%MSG-w ParticleInventory:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 14-Jan-2026 22:27:05 -03  run: 200022 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  MultiPartVertex:generator@BeginModule  14-Jan-2026 22:27:05 -03 run: 200022 subRun: 0 event: 20
Random seed for this event, engine 'generator.GenVertex': 55965634
%MSG
Processing a new event...
Generating a rain particle at (-300.919,-162.133,423.402)
Generated boost parameter gamma beta = 2.04971, cos(theta) = 0.208488, phi = 2.09857
Generating a boost (-0.442675,0.759388,0.187378)
Event Vertex @ (-300.919,-162.133,423.402) ... 9 particles...
  0th instance PDG 11
  1th instance PDG 2212
  2th instance PDG 3122
  3th instance PDG 22
  4th instance PDG 111
  5th instance PDG 211
  6th instance PDG -211
  7th instance PDG 2112
  8th instance PDG 2112
E: 0.688425 , m: 0.000510999 , KE: 0.687914
E: 1.73777 , m: 0.938272 , KE: 0.799497
E: 1.68799 , m: 1.11568 , KE: 0.572308
E: 0.200634 , m: 0 , KE: 0.200634
E: 0.889599 , m: 0.134977 , KE: 0.754622
E: 0.550673 , m: 0.13957 , KE: 0.411103
E: 0.289825 , m: 0.13957 , KE: 0.150255
E: 1.23138 , m: 0.939565 , KE: 0.291819
E: 1.49207 , m: 0.939565 , KE: 0.552501
total KE: 4.42065
KE range: 15 , pdg :  11
particle KE sf: 15, p : 0.688424 , mass :  0.000510999 , mom_sf: 14.9896
particle E : 0.688425 , scaled E : 10.3192
KE range: 3 , pdg :  3122
particle KE sf: 3, p : 1.26671 , mass :  1.11568 , mom_sf: 2.05542
particle E : 1.68799 , scaled E : 2.8326
KE range: 2.5 , pdg :  22
particle KE sf: 2.5, p : 0.200634 , mass :  0 , mom_sf: 2.5
particle E : 0.200634 , scaled E : 0.501584
KE range: 2.5 , pdg :  111
particle KE sf: 2.5, p : 0.879299 , mass :  0.134977 , mom_sf: 2.2939
particle E : 0.889599 , scaled E : 2.02153
KE range: 2.5 , pdg :  211
particle KE sf: 2.5, p : 0.532692 , mass :  0.13957 , mom_sf: 2.17565
particle E : 0.550673 , scaled E : 1.16733
KE range: 2.5 , pdg :  -211
particle KE sf: 2.5, p : 0.254005 , mass :  0.13957 , mom_sf: 1.95249
particle E : 0.289825 , scaled E : 0.515206
Total number particles: 0
14-Jan-2026 22:27:08 -03  Closed output file "mpvmpr_monte-carlo-011939-000026_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000514853   0.00106324    0.00744498    0.000625642   0.00147993       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       5.5092e-05    9.78347e-05   0.000558614   6.8928e-05    0.000107318      20     
simulate:rns:RandomNumberSaver                1.6101e-05    3.88217e-05   0.000358335   2.0701e-05    7.36521e-05      20     
simulate:generator:MultiPartVertex            0.000126355   0.000298329    0.0015229    0.000246076   0.000286221      20     
[art]:TriggerResults:TriggerResultInserter     9.33e-06     1.42952e-05   6.3103e-05    1.20505e-05   1.13574e-05      20     
end_path:out1:RootOutput                        1.4e-06     2.60415e-06   1.8191e-05     1.82e-06     3.58942e-06      20     
end_path:out1:RootOutput(write)               6.9963e-05    0.000363828    0.0038744    7.70835e-05    0.0008276       20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 14-Jan-2026 22:27:08 -03  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)            55965634   generator.GenVertex

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1334.44 MB
  Peak resident set size usage (VmHWM): 581.05 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 2.143090 Real = 3.784733

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1334.44 VmHWM = 581.05

Art has completed and will exit with status 0.
-rw-r--r-- 1 nobody nobody 107K Jan 14 22:27 mpvmpr_monte-carlo-011939-000026_gen.root
Input fcl file: mpvmpr_gen_1x2x6.fcl
genType: mpvmpr
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011939-000026
=== GEN job completed successfully ===
justIN time: 2026-02-04 13:01:39 UTC       justIN version: 01.06.00