justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 272989.1@dunegpschedd02.fnal.gov

Jobsub ID272989.1@dunegpschedd02.fnal.gov
Workflow ID11947
Stage ID1
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit14400 (4 hours)
Submitted time2026-01-15 05:03:27
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc02
Last heartbeat2026-01-15 05:07:20
From worker nodeHostnamewn-la-01.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 05:04:36
Input filesmonte-carlo-011947-000002
JobscriptExit code0
Real time0m (21s)
CPU time0m (17s = 80%)
Max RSS bytes588926976 (561 MiB)
Outputting started2026-01-15 05:04:58
Output files
Finished2026-01-15 05:07:20
Saved logsjustin-logs:272989.1-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

026 06:04:56 CET  run: 200000 subRun: 0 event: 15
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  15-Jan-2026 06:04:56 CET run: 200000 subRun: 0 event: 15
Random seed for this event, engine 'generator': 30583958
%MSG
Begin processing the 16th record. run: 200000 subRun: 0 event: 16 at 15-Jan-2026 06:04:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 16
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 16
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 16
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 16
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 16
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  15-Jan-2026 06:04:56 CET run: 200000 subRun: 0 event: 16
Random seed for this event, engine 'generator': 135148415
%MSG
Begin processing the 17th record. run: 200000 subRun: 0 event: 17 at 15-Jan-2026 06:04:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 17
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 17
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 17
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 17
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 17
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  15-Jan-2026 06:04:56 CET run: 200000 subRun: 0 event: 17
Random seed for this event, engine 'generator': 18297999
%MSG
Begin processing the 18th record. run: 200000 subRun: 0 event: 18 at 15-Jan-2026 06:04:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 18
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 18
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 18
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  15-Jan-2026 06:04:56 CET run: 200000 subRun: 0 event: 18
Random seed for this event, engine 'generator': 527719238
%MSG
Begin processing the 19th record. run: 200000 subRun: 0 event: 19 at 15-Jan-2026 06:04:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 19
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 19
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 19
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  15-Jan-2026 06:04:56 CET run: 200000 subRun: 0 event: 19
Random seed for this event, engine 'generator': 300640162
%MSG
Begin processing the 20th record. run: 200000 subRun: 0 event: 20 at 15-Jan-2026 06:04:56 CET
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w ParticleInventory:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 20
Rebuild failed to get the MCParticles. This is expected when running on a generation or simulation step.
%MSG
%MSG-w BackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 20
Rebuild failed to get the SimChannels. This is expected when running on a generation or simulation step.
%MSG
%MSG-w PhotonBackTrackerService:  ProcessEvent 15-Jan-2026 06:04:56 CET  run: 200000 subRun: 0 event: 20
Rebuild failed to get the OpDetBTRs. This is expected when running on a generation or simulation step.
%MSG
%MSG-i NuRandomService:  SingleGen:generator@BeginModule  15-Jan-2026 06:04:56 CET run: 200000 subRun: 0 event: 20
Random seed for this event, engine 'generator': 811211713
%MSG
15-Jan-2026 06:04:58 CET  Closed output file "prod_monte-carlo-011947-000002_gen.root"

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                    0.000253208   0.000850758    0.010473     0.000268947   0.00221878       20     
--------------------------------------------------------------------------------------------------------------------------------
source:EmptyEvent(read)                       4.1072e-05    6.36698e-05   0.000276804   4.4281e-05    5.27828e-05      20     
simulate:rns:RandomNumberSaver                1.1657e-05    2.48601e-05   0.000230696   1.27045e-05   4.74159e-05      20     
simulate:generator:SingleGen                  1.4452e-05    0.000340405   0.00647634    1.62445e-05   0.00140769       20     
[art]:TriggerResults:TriggerResultInserter     5.488e-06    8.0639e-06    4.4988e-05    5.9235e-06    8.49679e-06      20     
end_path:out1:RootOutput                       1.052e-06    1.9074e-06    1.3971e-05     1.162e-06    2.7882e-06       20     
end_path:out1:RootOutput(write)               4.1042e-05    0.000232291   0.00266143    4.5448e-05    0.000599603      20     
================================================================================================================================
%MSG-i NuRandomService:  RootOutput:out1@EndJob 15-Jan-2026 06:04:58 CET  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'perEvent'
  algorithm version: EventTimestamp_v1
   Configured value          Last value   ModuleLabel.InstanceName
        (per event)           811211713   generator

%MSG

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1327.74 MB
  Peak resident set size usage (VmHWM): 583.59 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 20 passed = 20 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         20         20          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 1.615354 Real = 1.961554

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1327.74 VmHWM = 583.59

Art has completed and will exit with status 0.
-rw-r--r--. 1 dune009 dune 99K Jan 15 06:04 prod_monte-carlo-011947-000002_gen.root
Input fcl file: prod_muminus_0.1-5.0GeV_isotropic_dune10kt_1x2x6.fcl
genType: prod
Wrote processed DID to justin-processed-dids.txt: monte-carlo-011947-000002
=== GEN job completed successfully ===
justIN time: 2026-02-04 14:39:57 UTC       justIN version: 01.06.00