justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 302848.16@dunegpschedd01.fnal.gov

Jobsub ID302848.16@dunegpschedd01.fnal.gov
Workflow ID12617
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit3600 (1 hours)
Submitted time2026-02-02 15:07:54
SiteUS_BNL
EntryDUNE_US_BNL_spoolce02
Last heartbeat2026-02-02 15:29:22
From worker nodeHostnamespool0814.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-02 15:27:18
Input filesmonte-carlo-012617-000005
JobscriptExit code0
Real time0m (20s)
CPU time0m (18s = 89%)
Max RSS bytes580390912 (553 MiB)
Outputting started2026-02-02 15:27:39
Output files
Finished2026-02-02 15:29:22
Saved logsjustin-logs:302848.16-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

:37 EST  run: 210005 subRun: 0 event: 45
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  02-Feb-2026 10:27:37 EST run: 210005 subRun: 0 event: 45
Random seed for this event, engine 'generator': 230777813
%MSG
Begin processing the 46th record. run: 210005 subRun: 0 event: 46 at 02-Feb-2026 10:27:37 EST
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 46
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 46
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 46
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 46
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 46
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  02-Feb-2026 10:27:37 EST run: 210005 subRun: 0 event: 46
Random seed for this event, engine 'generator': 231955577
%MSG
Begin processing the 47th record. run: 210005 subRun: 0 event: 47 at 02-Feb-2026 10:27:37 EST
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 47
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 47
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 47
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 47
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 47
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  02-Feb-2026 10:27:37 EST run: 210005 subRun: 0 event: 47
Random seed for this event, engine 'generator': 549694248
%MSG
Begin processing the 48th record. run: 210005 subRun: 0 event: 48 at 02-Feb-2026 10:27:37 EST
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 48
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 48
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 48
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 48
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 48
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  02-Feb-2026 10:27:37 EST run: 210005 subRun: 0 event: 48
Random seed for this event, engine 'generator': 895050145
%MSG
Begin processing the 49th record. run: 210005 subRun: 0 event: 49 at 02-Feb-2026 10:27:37 EST
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 49
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 49
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 49
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 49
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 49
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  02-Feb-2026 10:27:37 EST run: 210005 subRun: 0 event: 49
Random seed for this event, engine 'generator': 166316796
%MSG
Begin processing the 50th record. run: 210005 subRun: 0 event: 50 at 02-Feb-2026 10:27:37 EST
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 50
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 50
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 50
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 50
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 02-Feb-2026 10:27:37 EST  run: 210005 subRun: 0 event: 50
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  02-Feb-2026 10:27:37 EST run: 210005 subRun: 0 event: 50
Random seed for this event, engine 'generator': 272444952
%MSG
02-Feb-2026 10:27:38 EST  Closed output file "prod_monte-carlo-012617-000005_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000329606   0.000679824    0.0147745    0.000342602   0.00202435       50     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       5.6128e-05    7.11258e-05   0.000438541   6.07135e-05   5.3704e-05       50     
simulate:rns:RandomNumberSaver                1.6324e-05    2.48017e-05   0.000363951   1.71455e-05   4.85907e-05      50     
simulate:generator:SingleGen                   2.02e-05     0.000218025   0.00979493    2.13465e-05   0.00136814       50     
[art]:TriggerResults:TriggerResultInserter     9.512e-06    1.13793e-05   7.2828e-05    1.00815e-05   8.79246e-06      50     
end_path:out1:RootOutput                        1.5e-06      2.048e-06     1.968e-05     1.665e-06    2.52367e-06      50     
end_path:out1:RootOutput(write)               5.6274e-05    0.000160821   0.00300492    5.83445e-05   0.000455759      50     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 02-Feb-2026 10:27:38 EST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           272444952   generator

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1325.61 MB
  Peak resident set size usage (VmHWM): 577.245 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 50 passed = 50 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         50         50          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.780437 Real = 1.832528

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1325.61 VmHWM = 577.245

Art has completed and will exit with status 0.
-rw-r--r-- 1 fermipro fermilab 124K Feb  2 10:27 prod_monte-carlo-012617-000005_gen.root
Input fcl file: prod_muminus_0.1-5.0GeV_isotropic_dune10kt_1x2x6.fcl
genType: prod
Wrote processed DID to justin-processed-dids.txt: monte-carlo-012617-000005
=== GEN job completed successfully ===
justIN time: 2026-02-04 04:32:59 UTC       justIN version: 01.06.00