justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278645.11@dunegpschedd01.fnal.gov

Jobsub ID278645.11@dunegpschedd01.fnal.gov
Workflow ID11941
Stage ID4
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-01-15 02:55:21
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc01
Last heartbeat2026-01-15 03:15:38
From worker nodeHostnamewn-la-22.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 02:56:13
Input filesusertests:mpvmpr_monte-carlo-011941-000040_gen_g4_detsim.root
JobscriptExit code0
Real time15m (948s)
CPU time15m (934s = 98%)
Max RSS bytes1703522304 (1624 MiB)
Outputting started2026-01-15 03:12:03
Output filesusertests:mpvmpr_monte-carlo-011941-000040_gen_g4_detsim_reco.root
usertests:mpvmpr_monte-carlo-011941-000040_gen_g4_detsim_reco_larcv.root
Finished2026-01-15 03:15:38
Saved logsjustin-logs:278645.11-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 18th record. run: 200000 subRun: 0 event: 18 at 15-Jan-2026 04:09:29 CET
++++>>>> total num hits: 3828, num free: 3828

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2464!
bad particle: track id = 0 PDG = 16 StatusCode = 0
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 210928
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 0
 ... due to invalid 2d index 0
 ... due to invalid 3d index 105921

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 19th record. run: 200000 subRun: 0 event: 19 at 15-Jan-2026 04:09:36 CET
++++>>>> total num hits: 7232, num free: 7232

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2276!
bad particle: track id = 0 PDG = 16 StatusCode = 0
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 1150773
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 819
 ... due to invalid 2d index 0
 ... due to invalid 3d index 661471

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 20th record. run: 200000 subRun: 0 event: 20 at 15-Jan-2026 04:10:36 CET
++++>>>> total num hits: 54192, num free: 54192

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2725!
bad particle: track id = 0 PDG = 16 StatusCode = 0
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 1092998
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 2927
 ... due to invalid 2d index 0
 ... due to invalid 3d index 605247

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
15-Jan-2026 04:12:01 CET  Closed output file "mpvmpr_monte-carlo-011941-000040_gen_g4_detsim_reco.root"
15-Jan-2026 04:12:01 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/8b/d9/mpvmpr_monte-carlo-011941-000040_gen_g4_detsim.root"
    [NORMAL]  <IOManager::finalize> Writing particle_mpv_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing neutrino_mpv_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_mcst_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_sed_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_masked_true2reco_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_index_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_masked_true_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_highE_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_lowE_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_leftover_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_semantics_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing particle_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_sed_at_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_chi2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_occupancy_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_nhits_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_cryo_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tpc_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_sed_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_semantics_ghost_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing particle_corrected_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_rescaled_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Closing output file

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      3.04388       44.2276       154.016       30.5503       39.5866        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.00045536    0.00221761    0.00974587    0.00139022    0.00216825       20     
reco:gaushit:GausHitFinder                     0.0943952      0.20683      0.338111      0.214905      0.0735857       20     
reco:cluster3d:Cluster3D                       0.0565813      2.74904       16.4546       1.17003       3.94479        20     
reco:opdec:Deconvolution                       0.132643      0.241817      0.295333      0.246488      0.0401831       20     
reco:ophitspe:OpHitFinderDeco                  0.0105146     0.0145179     0.0186037     0.0143923    0.00184989       20     
reco:opflash:OpFlashFinder                    0.00121675    0.00203066    0.00366085    0.00203687    0.000490658      20     
reco:opslicer:OpSlicer                          0.14877      0.475203      0.771548       0.46214      0.150533        20     
reco:mcreco:MCReco                             0.232898      0.959511       2.23239      0.701156      0.626866        20     
[art]:TriggerResults:TriggerResultInserter    2.4226e-05    3.51958e-05   0.000104477    2.976e-05    1.7518e-05       20     
end_path:superaMC:LArSoftSuperaDriver           1.38396       39.3452       146.618       27.2012       36.7846        20     
end_path:out1:RootOutput                       7.021e-06    9.9583e-06    3.1447e-05    7.6215e-06    6.27904e-06      20     
end_path:out1:RootOutput(write)                0.120404      0.230316      0.392306      0.217454      0.064917        20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 18763.5 MB
  Peak resident set size usage (VmHWM): 1703.52 MB
====================================================================================================
Art has completed and will exit with status 0.
'larcv.root' -> 'mpvmpr_monte-carlo-011941-000040_gen_g4_detsim_reco_larcv.root'
Sandbox folder contains:
total 781M
-rw-r--r--. 1 dune009 dune   62 Jan 15 03:56 all-input-dids.txt
-rw-r--r--. 1 dune009 dune    0 Jan 15 03:56 debugprod.log
drwxr-xr-x. 2 dune009 dune 4.0K Jan 14 22:30 fhicl
-rw-r--r--. 1 dune009 dune  12K Jan 15 03:56 fhicl_bundle.tgz
-rw-r--r--. 1 dune009 dune  70K Jan 15 04:12 jobscript.log
-rw-r--r--. 1 dune009 dune 744M Jan 15 04:12 mpvmpr_monte-carlo-011941-000040_gen_g4_detsim_reco.root
-rw-r--r--. 1 dune009 dune  37M Jan 15 04:12 mpvmpr_monte-carlo-011941-000040_gen_g4_detsim_reco_larcv.root
-rw-r--r--. 1 dune009 dune  519 Jan 15 04:12 supera_hist.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-011941-000040_gen_g4_detsim.root
=== RECOjob completed successfully ===
justIN time: 2026-02-06 02:08:29 UTC       justIN version: 01.06.00