justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 41739.48@dunegpschedd02.fnal.gov

Jobsub ID41739.48@dunegpschedd02.fnal.gov
Workflow ID2867
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-18 07:48:12
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2025-09-18 09:13:53
From worker nodeHostnamehd87.dice.priv
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-18 07:50:47
Input filesvd-protodune:np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714.hdf5
JobscriptExit code0
Real time1h (4908s)
CPU time37m (2272s = 46%)
Max RSS bytes3427045376 (3268 MiB)
Outputting started2025-09-18 09:12:36
Output filesvd-protodune-det-reco:np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091225_keepup.root
Finished2025-09-18 09:13:53
Saved logsjustin-logs:41739.48-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

:12:12.032] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=95 anode=0 
[09:12:12.032] D [  glue  ] <FrameFanin:nfsp> EOS at call=95 with 8 
[09:12:12.032] D [  glue  ] frame sink sees EOS
[09:12:12.032] D [ pgraph ] <Pgrapher:> graph execution complete 
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 5.24 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 5.15 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 4.48 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 4.37 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.26 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.26 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.26 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.25 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Gen::Retagger : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[09:12:12.032] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[09:12:12.032] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[09:12:12.032] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[09:12:12.032] I [ timer  ] Timer: Total node execution : 20.269999742507935 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 17978 traces tagged "gauss"
FrameSaver: q=3.26574e+06 n=397703 tag=gauss
wclsFrameSaver: saving 23082 traces tagged "wiener"
FrameSaver: q=3.4679e+06 n=378376 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 9311 XUs and 10967 XVs -> 638 XUVs
C:0 T:1 323 XUs and 280 XVs -> 12 XUVs
C:0 T:2 706 XUs and 624 XVs -> 42 XUVs
C:0 T:3 299 XUs and 291 XVs -> 27 XUVs
C:0 T:4 1377 XUs and 1145 XVs -> 40 XUVs
C:0 T:5 1541 XUs and 1407 XVs -> 71 XUVs
C:0 T:6 509 XUs and 485 XVs -> 34 XUVs
C:0 T:7 2959 XUs and 2197 XVs -> 217 XUVs
1081 XUVs total
797 collection wire objects
1081 potential space points
Neighbour search...
18471 tests to find 5178 neighbours
Iterating with no regularization...
Begin: 4.35147e+09
0 4.32667e+09
1 4.32643e+09
Now with regularization...
Begin: 4.23675e+09
0 4.23673e+09
18-Sep-2025 09:12:25 UTC  Closed output file "np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091225_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        58.8785       100.341       309.662       88.9693       37.7659        48     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.0247e-05    6.83885e-05   9.8579e-05    6.8907e-05    1.13306e-05      48     
produce:tpcrawdecoder:PDVDTPCReader               24.7505       44.8171       86.0309       43.1015       12.883         48     
produce:triggerrawdecoder:PDVDTriggerReader4     0.330835      0.400787       0.99119      0.362114      0.110477        48     
produce:pdvddaphne:DAPHNEReaderPDVD               2.79935       9.66328       17.8846       9.43479       3.30369        48     
produce:ophit:OpHitFinder                        0.0265365     0.0343586     0.0409187     0.0346382    0.00357303       48     
produce:opflash:OpFlashFinderVerticalDrift      0.00389951    0.00707712      0.01071     0.00708811    0.00151844       48     
produce:wclsdatavd:WireCellToolkit                17.3099       25.0827       38.5168       22.0181       5.76147        48     
produce:gaushit:GausHitFinder                    0.160755      0.376668      0.764442      0.366379      0.115269        48     
produce:nhitsfilter:NumberOfHitsFilter          4.6689e-05    8.73672e-05   0.000207307   8.01935e-05   3.24781e-05      48     
produce:reco3d:SpacePointSolver                  0.949652       3.61582       12.3573       3.14824       2.15698        48     
produce:hitpdune:DisambigFromSpacePoints         0.0122151     0.0417097     0.204171      0.0334457     0.0312024       48     
produce:pandora:StandardPandora                   1.93152       14.3846       203.429       7.62823       29.376         48     
produce:pandoraTrack:LArPandoraTrackCreation     0.0648145     0.166015       0.83383      0.132395      0.123751        48     
produce:pandoraGnocalo:GnocchiCalorimetry       0.00456718    0.00994189     0.0198492     0.0093945    0.00304402       48     
[art]:TriggerResults:TriggerResultInserter       1.071e-05    1.28379e-05   3.6019e-05    1.21485e-05   3.59239e-06      48     
end_path:out1:RootOutput                         2.755e-06    3.46317e-06   1.3145e-05    3.2615e-06    1.43753e-06      48     
end_path:out1:RootOutput(write)                   1.43138       1.72653       2.24815       1.66773      0.203846        48     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5383.73 MB
  Peak resident set size usage (VmHWM): 3427.05 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091225_keepup.root
\tHists: np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091227_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091225_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091225_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758186747.0,
    "core.end_time": 1758186747.0,
    "core.events": [
      109004,
      109010,
      109016,
      109022,
      109028,
      109034,
      109040,
      109046,
      109052,
      109058,
      109064,
      109070,
      109076,
      109082,
      109088,
      109094,
      109100,
      109106,
      109112,
      109118,
      109124,
      109130,
      109136,
      109142,
      109148,
      109154,
      109160,
      109166,
      109172,
      109178,
      109184,
      109190,
      109196,
      109202,
      109208,
      109214,
      109220,
      109226,
      109232,
      109238,
      109244,
      109250,
      109256,
      109262,
      109268,
      109274,
      109280,
      109286
    ],
    "core.event_count": 48,
    "core.first_event_number": 109004,
    "core.last_event_number": 109286,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39433
    ],
    "core.runs_subruns": [
      3943300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714_reco_stage1_20250918T091227_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758186747.0,
    "core.end_time": 1758186747.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39433
    ],
    "core.runs_subruns": [
      3943300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039433_0380_df-s05-d2_dw_0_20250918T065714.hdf5"
    }
  ]
}
justIN time: 2025-09-18 19:21:01 UTC       justIN version: 01.05.00