justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278651.0@dunegpschedd01.fnal.gov

Jobsub ID278651.0@dunegpschedd01.fnal.gov
Workflow ID11941
Stage ID4
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-01-15 02:59:21
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2026-01-15 03:16:15
From worker nodeHostnamewn-la-12.gina.surf.nl
cpuinfoAMD EPYC 9754 128-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 02:59:46
Input filesusertests:mpvmpr_monte-carlo-011941-000016_gen_g4_detsim.root
JobscriptExit code0
Real time13m (798s)
CPU time13m (786s = 98%)
Max RSS bytes1736245248 (1655 MiB)
Outputting started2026-01-15 03:13:05
Output filesusertests:mpvmpr_monte-carlo-011941-000016_gen_g4_detsim_reco.root
usertests:mpvmpr_monte-carlo-011941-000016_gen_g4_detsim_reco_larcv.root
Finished2026-01-15 03:16:15
Saved logsjustin-logs:278651.0-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ss> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 18th record. run: 200000 subRun: 0 event: 18 at 15-Jan-2026 04:11:58 CET
++++>>>> total num hits: 5439, num free: 5439

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2442!
bad particle: track id = 0 PDG = 16 StatusCode = 0
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 311772
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 4683
 ... due to invalid 2d index 0
 ... due to invalid 3d index 165302

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 19th record. run: 200000 subRun: 0 event: 19 at 15-Jan-2026 04:12:05 CET
++++>>>> total num hits: 1370, num free: 1370

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1300!
bad particle: track id = 0 PDG = 16 StatusCode = 0
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 106502
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 0
 ... due to invalid 2d index 0
 ... due to invalid 3d index 44852

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 20th record. run: 200000 subRun: 0 event: 20 at 15-Jan-2026 04:12:07 CET
++++>>>> total num hits: 26036, num free: 26036

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2252!
bad particle: track id = 0 PDG = 16 StatusCode = 0
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 420504
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 1478
 ... due to invalid 2d index 0
 ... due to invalid 3d index 187448

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
15-Jan-2026 04:13:04 CET  Closed output file "mpvmpr_monte-carlo-011941-000016_gen_g4_detsim_reco.root"
15-Jan-2026 04:13:04 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/0f/30/mpvmpr_monte-carlo-011941-000016_gen_g4_detsim.root"
    [NORMAL]  <IOManager::finalize> Writing particle_mpv_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing neutrino_mpv_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_mcst_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_sed_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_masked_true2reco_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_index_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_masked_true_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_highE_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_lowE_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_leftover_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_semantics_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing particle_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_sed_at_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_chi2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_occupancy_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_nhits_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_cryo_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tpc_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_sed_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_semantics_ghost_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing particle_corrected_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_rescaled_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Closing output file

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                      2.02825       36.5676       177.069       14.5166       46.366         20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000657885   0.00326499    0.00797652    0.00272889    0.00183589       20     
reco:gaushit:GausHitFinder                     0.0565643     0.212962      0.426899      0.216774      0.0958858       20     
reco:cluster3d:Cluster3D                       0.0543389      1.9028        10.2487       1.00511       2.55555        20     
reco:opdec:Deconvolution                       0.144322      0.241597      0.316036      0.247104      0.0430448       20     
reco:ophitspe:OpHitFinderDeco                 0.00953826     0.0123772     0.0181002     0.0123373    0.00177192       20     
reco:opflash:OpFlashFinder                    0.00124898    0.00211051    0.00428829    0.00205643    0.000602394      20     
reco:opslicer:OpSlicer                         0.171196      0.457663      0.774183      0.482824       0.15036        20     
reco:mcreco:MCReco                             0.121642       0.79656       2.77922      0.554326      0.656234        20     
[art]:TriggerResults:TriggerResultInserter    2.3295e-05    4.86058e-05   0.000145528   3.71105e-05   3.18806e-05      20     
end_path:superaMC:LArSoftSuperaDriver           1.30468       32.7066       166.128       11.6534       43.1676        20     
end_path:out1:RootOutput                       7.361e-06    8.3095e-06    1.6035e-05    7.8965e-06    1.79937e-06      20     
end_path:out1:RootOutput(write)                0.0927052     0.230771      0.419401      0.213634      0.086199        20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 18792.7 MB
  Peak resident set size usage (VmHWM): 1736.25 MB
====================================================================================================
Art has completed and will exit with status 0.
'larcv.root' -> 'mpvmpr_monte-carlo-011941-000016_gen_g4_detsim_reco_larcv.root'
Sandbox folder contains:
total 745M
-rw-r--r--. 1 dune009 dune   62 Jan 15 03:59 all-input-dids.txt
-rw-r--r--. 1 dune009 dune    0 Jan 15 04:00 debugprod.log
drwxr-xr-x. 2 dune009 dune 4.0K Jan 14 22:30 fhicl
-rw-r--r--. 1 dune009 dune  12K Jan 15 03:59 fhicl_bundle.tgz
-rw-r--r--. 1 dune009 dune  71K Jan 15 04:13 jobscript.log
-rw-r--r--. 1 dune009 dune 709M Jan 15 04:13 mpvmpr_monte-carlo-011941-000016_gen_g4_detsim_reco.root
-rw-r--r--. 1 dune009 dune  37M Jan 15 04:13 mpvmpr_monte-carlo-011941-000016_gen_g4_detsim_reco_larcv.root
-rw-r--r--. 1 dune009 dune  519 Jan 15 04:13 supera_hist.root
Wrote processed DID: usertests:mpvmpr_monte-carlo-011941-000016_gen_g4_detsim.root
=== RECOjob completed successfully ===
justIN time: 2026-02-06 02:08:29 UTC       justIN version: 01.06.00