justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 272929.0@dunegpschedd02.fnal.gov

Jobsub ID272929.0@dunegpschedd02.fnal.gov
Workflow ID11944
Stage ID4
User nameusher@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes8388608000 (8000 MiB)
Wall seconds limit28800 (8 hours)
Submitted time2026-01-15 03:27:23
SiteNL_SURFsara
EntryDUNE_SurfSARA_arc03
Last heartbeat2026-01-15 03:33:02
From worker nodeHostnamewn-da-10.gina.surf.nl
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes10485760000 (10000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-01-15 03:28:30
Input filesusertests:prod_monte-carlo-011944-000005_gen_g4_detsim.root
JobscriptExit code0
Real time1m (68s)
CPU time1m (61s = 89%)
Max RSS bytes938659840 (895 MiB)
Outputting started2026-01-15 03:29:39
Output filesusertests:prod_monte-carlo-011944-000005_gen_g4_detsim_reco.root
usertests:prod_monte-carlo-011944-000005_gen_g4_detsim_reco_larcv.root
Finished2026-01-15 03:33:02
Saved logsjustin-logs:272929.0-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

nvalid 3d index 401

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 18th record. run: 200000 subRun: 0 event: 18 at 15-Jan-2026 04:29:33 CET
++++>>>> total num hits: 1180, num free: 1180

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 967!
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 51558
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 0
 ... due to invalid 2d index 0
 ... due to invalid 3d index 8205

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 19th record. run: 200000 subRun: 0 event: 19 at 15-Jan-2026 04:29:35 CET
++++>>>> total num hits: 1694, num free: 1694

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1509!
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 45565
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 0
 ... due to invalid 2d index 0
 ... due to invalid 3d index 5025

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
Begin processing the 20th record. run: 200000 subRun: 0 event: 20 at 15-Jan-2026 04:29:36 CET
++++>>>> total num hits: 792, num free: 792

Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1883!
Filling voxel information...
   [WARNING]  <SuperaMCParticleCluster::AnalyzeSimChannel> Total IDE ctr 49890
 ... due to missing track ID 0 from 0 track IDs
 ... due to invalid particle 0
 ... due to invalid 2d index 0
 ... due to invalid 3d index 3934

    [NORMAL]  <SuperaMCParticleCluster::process> Saved interaction count: 1
    [NORMAL]  <SuperaMCParticleCluster::process> 0 particles have no ancestor, summed deposit energy = 0
15-Jan-2026 04:29:38 CET  Closed output file "prod_monte-carlo-011944-000005_gen_g4_detsim_reco.root"
15-Jan-2026 04:29:38 CET  Closed input file "root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/usertests/00/d0/prod_monte-carlo-011944-000005_gen_g4_detsim.root"
    [NORMAL]  <IOManager::finalize> Writing particle_mpv_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing neutrino_mpv_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_mcst_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_sed_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_masked_true2reco_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_index_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_masked_true_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_highE_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_pcluster_lowE_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_leftover_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_semantics_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing particle_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing cluster3d_sed_at_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_chi2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_occupancy_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_nhits_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_cryo_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_tpc_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_charge2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_time2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key0_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key1_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_hit_key2_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_sed_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_pcluster_semantics_ghost_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing particle_corrected_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Writing sparse3d_reco_rescaled_tree with 20 entries
    [NORMAL]  <IOManager::finalize> Closing output file

================================================================================================================================
TimeTracker printout (sec)                        Min           Avg           Max         Median          RMS         nEvts   
================================================================================================================================
Full event                                     0.136285       1.12885       3.37867      0.980463      0.792134        20     
--------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                        0.000208958   0.000543037   0.00196017    0.000324373   0.000568283      20     
reco:gaushit:GausHitFinder                     0.0152726     0.0574707     0.182778      0.047243      0.0414076       20     
reco:cluster3d:Cluster3D                      0.00189704     0.0361038     0.166007      0.0251969     0.0370875       20     
reco:opdec:Deconvolution                       0.0379762     0.130952      0.231795      0.140779      0.0454403       20     
reco:ophitspe:OpHitFinderDeco                 0.00452651    0.00765507     0.0103451    0.00763653    0.00140207       20     
reco:opflash:OpFlashFinder                    0.00021593    0.000893175    0.0016944    0.000925086   0.000347272      20     
reco:opslicer:OpSlicer                        0.00275667     0.159404      0.537061      0.157888      0.121842        20     
reco:mcreco:MCReco                            0.00917277     0.195559      0.755959      0.120267      0.210476        20     
[art]:TriggerResults:TriggerResultInserter    1.1542e-05    1.84603e-05   6.2168e-05    1.6366e-05    1.02474e-05      20     
end_path:superaMC:LArSoftSuperaDriver          0.0368293     0.471058       1.49115      0.421972      0.351317        20     
end_path:out1:RootOutput                       4.047e-06    5.5751e-06    1.3647e-05    5.2405e-06    1.89638e-06      20     
end_path:out1:RootOutput(write)                0.0168348     0.0686206      0.13195      0.0706191     0.0259488       20     
================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9699.96 MB
  Peak resident set size usage (VmHWM): 938.66 MB
====================================================================================================
Art has completed and will exit with status 0.
'larcv.root' -> 'prod_monte-carlo-011944-000005_gen_g4_detsim_reco_larcv.root'
Sandbox folder contains:
total 112M
-rw-r--r--. 1 dune009 dune   60 Jan 15 04:28 all-input-dids.txt
-rw-r--r--. 1 dune009 dune    0 Jan 15 04:28 debugprod.log
drwxr-xr-x. 2 dune009 dune 4.0K Jan 14 22:30 fhicl
-rw-r--r--. 1 dune009 dune  12K Jan 15 04:28 fhicl_bundle.tgz
-rw-r--r--. 1 dune009 dune  69K Jan 15 04:29 jobscript.log
-rw-r--r--. 1 dune009 dune 108M Jan 15 04:29 prod_monte-carlo-011944-000005_gen_g4_detsim_reco.root
-rw-r--r--. 1 dune009 dune 3.7M Jan 15 04:29 prod_monte-carlo-011944-000005_gen_g4_detsim_reco_larcv.root
-rw-r--r--. 1 dune009 dune  519 Jan 15 04:29 supera_hist.root
Wrote processed DID: usertests:prod_monte-carlo-011944-000005_gen_g4_detsim.root
=== RECOjob completed successfully ===
justIN time: 2026-02-06 01:32:23 UTC       justIN version: 01.06.00