justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 42563.172@dunegpschedd02.fnal.gov

Jobsub ID42563.172@dunegpschedd02.fnal.gov
Workflow ID2920
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-18 19:06:47
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep207
Last heartbeat2025-09-18 22:48:59
From worker nodeHostnameheplnc172.pp.rl.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-18 21:54:32
Input filesvd-protodune:np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613.hdf5
JobscriptExit code0
Real time50m (3049s)
CPU time45m (2758s = 90%)
Max RSS bytes2524225536 (2407 MiB)
Outputting started2025-09-18 22:45:22
Output filesvd-protodune-det-reco:np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup.root
Finished2025-09-18 22:48:59
Saved logsjustin-logs:42563.172-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

mpler:resmp0> EOS at call=81 
[23:44:38.525] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=81 anode=0 
[23:44:38.525] D [  glue  ] <FrameFanin:nfsp> EOS at call=81 with 8 
[23:44:38.525] D [  glue  ] frame sink sees EOS
[23:44:38.525] D [ pgraph ] <Pgrapher:> graph execution complete 
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.3 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.14 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 6.54 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 6.39 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.24 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.22 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.22 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.21 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Gen::Retagger : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[23:44:38.525] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[23:44:38.525] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:44:38.525] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[23:44:38.525] I [ timer  ] Timer: Total node execution : 28.289999870583415 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 27476 traces tagged "gauss"
FrameSaver: q=4.62802e+06 n=608325 tag=gauss
wclsFrameSaver: saving 36433 traces tagged "wiener"
FrameSaver: q=5.08444e+06 n=588993 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1228 XUs and 1765 XVs -> 57 XUVs
C:0 T:1 764 XUs and 1199 XVs -> 71 XUVs
C:0 T:2 860 XUs and 596 XVs -> 51 XUVs
C:0 T:3 17105 XUs and 29251 XVs -> 1742 XUVs
C:0 T:4 864 XUs and 866 XVs -> 78 XUVs
C:0 T:5 959 XUs and 1000 XVs -> 37 XUVs
C:0 T:6 6818 XUs and 8491 XVs -> 639 XUVs
C:0 T:7 1251 XUs and 1250 XVs -> 121 XUVs
2796 XUVs total
1350 collection wire objects
2796 potential space points
Neighbour search...
99264 tests to find 24722 neighbours
Iterating with no regularization...
Begin: 2.19539e+09
0 2.06195e+09
1 2.05463e+09
2 2.05433e+09
Now with regularization...
Begin: 2.01294e+09
0 2.0128e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
18-Sep-2025 23:45:11 BST  Closed output file "np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        44.8281       72.743        232.633       62.1056       33.1218        41     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       6.936e-05    0.000107461   0.000393754   9.0021e-05    5.23668e-05      41     
produce:tpcrawdecoder:PDVDTPCReader               5.35742       5.87994       6.88882       5.76136      0.388131        41     
produce:triggerrawdecoder:PDVDTriggerReader4     0.300738      0.306265       0.32491      0.304465     0.00537996       41     
produce:pdvddaphne:DAPHNEReaderPDVD               2.55281       2.75174       2.96484       2.75322      0.0999179       41     
produce:ophit:OpHitFinder                        0.0291554     0.0443659     0.0548486     0.044416     0.00425593       41     
produce:opflash:OpFlashFinderVerticalDrift      0.00457034     0.0099335     0.0190479    0.00953071     0.0028177       41     
produce:wclsdatavd:WireCellToolkit                23.4496       31.0191       53.2451       27.979        7.54963        41     
produce:gaushit:GausHitFinder                    0.360979      0.618128       1.1942       0.585673      0.171613        41     
produce:nhitsfilter:NumberOfHitsFilter          8.9801e-05    0.000144029   0.000403354   0.000133081   5.0068e-05       41     
produce:reco3d:SpacePointSolver                   2.46479       5.59408       13.8601       5.32427       2.24671        41     
produce:hitpdune:DisambigFromSpacePoints         0.027009      0.0776865     0.294193      0.0658878     0.0488521       41     
produce:pandora:StandardPandora                   5.32766       23.5281       152.916       14.8774       27.7395        41     
produce:pandoraTrack:LArPandoraTrackCreation     0.0778781     0.272203      0.816113      0.232408      0.138009        41     
produce:pandoraGnocalo:GnocchiCalorimetry       0.00719941     0.0150831     0.0262488     0.0149724     0.0041214       41     
[art]:TriggerResults:TriggerResultInserter       1.697e-05    3.15914e-05   6.4981e-05    3.1201e-05    9.57917e-06      41     
end_path:out1:RootOutput                         3.53e-06     7.5619e-06     2.584e-05     7.389e-06    3.52342e-06      41     
end_path:out1:RootOutput(write)                   2.26526       2.60511       3.2289        2.52411      0.223667        41     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4504.62 MB
  Peak resident set size usage (VmHWM): 2524.23 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup.root
\tHists: np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758235512.0,
    "core.end_time": 1758235512.0,
    "core.events": [
      17332,
      17338,
      17344,
      17350,
      17356,
      17362,
      17368,
      17374,
      17380,
      17386,
      17392,
      17398,
      17404,
      17410,
      17416,
      17422,
      17428,
      17434,
      17440,
      17446,
      17452,
      17458,
      17464,
      17470,
      17476,
      17482,
      17488,
      17494,
      17500,
      17506,
      17512,
      17518,
      17524,
      17530,
      17536,
      17542,
      17548,
      17554,
      17560,
      17566,
      17572
    ],
    "core.event_count": 41,
    "core.first_event_number": 17332,
    "core.last_event_number": 17572,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39499
    ],
    "core.runs_subruns": [
      3949900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613_reco_stage1_20250918T224511_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758235512.0,
    "core.end_time": 1758235512.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39499
    ],
    "core.runs_subruns": [
      3949900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039499_0071_df-s05-d4_dw_0_20250918T200613.hdf5"
    }
  ]
}
justIN time: 2025-09-18 23:40:34 UTC       justIN version: 01.05.00