justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 242448.8@dunegpschedd01.fnal.gov

Jobsub ID242448.8@dunegpschedd01.fnal.gov
Workflow ID9531
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors2
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-11-03 17:07:05
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2025-11-03 21:44:46
From worker nodeHostnamedune001-286059.0-lcg2710.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors2
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 17:16:31
Input filesvd-protodune:np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100.hdf5
JobscriptExit code0
Real time4h (15997s)
CPU time4h (15374s = 96%)
Max RSS bytes7046004736 (6719 MiB)
Outputting started2025-11-03 21:43:09
Output filesvd-protodune-det-reco:np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214255_keepup.root
Finished2025-11-03 21:44:46
Saved logsjustin-logs:242448.8-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

] D [ pgraph ] <Pgrapher:> graph execution complete 
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 9.77 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.88 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.69 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.56 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.52 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.5 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 6.59 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 6.37 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.28 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.28 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.27 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.26 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.02 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.02 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:42:03.807] I [ timer  ] Timer: wcls::FrameSaver : 0.01 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Gen::Retagger : 0 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:42:03.807] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[21:42:03.807] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[21:42:03.807] I [ timer  ] Timer: Total node execution : 62.08000059239566 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 50116 traces tagged "gauss"
FrameSaver: q=1.17032e+07 n=1044808 tag=gauss
wclsFrameSaver: saving 64714 traces tagged "wiener"
FrameSaver: q=1.26992e+07 n=992106 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 622 XUs and 976 XVs -> 22 XUVs
C:0 T:1 3803 XUs and 2892 XVs -> 166 XUVs
C:0 T:2 5513 XUs and 3784 XVs -> 1401 XUVs
C:0 T:3 5801 XUs and 3835 XVs -> 1377 XUVs
C:0 T:4 21923 XUs and 18912 XVs -> 2536 XUVs
C:0 T:5 5243 XUs and 5837 XVs -> 472 XUVs
C:0 T:6 241 XUs and 218 XVs -> 11 XUVs
C:0 T:7 761 XUs and 978 XVs -> 44 XUVs
C:0 T:8 477 XUs and 1067 XVs -> 33 XUVs
C:0 T:9 1152 XUs and 991 XVs -> 63 XUVs
C:0 T:10 359 XUs and 448 XVs -> 97 XUVs
C:0 T:11 633 XUs and 772 XVs -> 123 XUVs
C:0 T:12 3132 XUs and 5581 XVs -> 426 XUVs
C:0 T:13 1071 XUs and 1507 XVs -> 69 XUVs
C:0 T:14 2238 XUs and 3415 XVs -> 581 XUVs
C:0 T:15 5290 XUs and 5887 XVs -> 796 XUVs
8217 XUVs total
1738 collection wire objects
8217 potential space points
Neighbour search...
909305 tests to find 417498 neighbours
Iterating with no regularization...
Begin: 4.32657e+09
0 3.76225e+09
1 3.70148e+09
2 3.69773e+09
3 3.69735e+09
Now with regularization...
Begin: 3.62449e+09
0 3.62396e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
03-Nov-2025 21:42:55 UTC  Closed output file "np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214255_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        88.3707       692.741       8655.8        121.615       1890.45        23     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      8.3076e-05    0.000131832   0.000218119   0.000115604   4.35511e-05      23     
produce:tpcrawdecoder:PDVDTPCReader               15.213        18.2308       23.0476       17.264        2.39534        23     
produce:triggerrawdecoder:PDVDTriggerReader4     0.670427      0.708387      0.767778      0.702101      0.0242026       23     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000227574   0.000413611   0.000601749   0.000415578   7.98634e-05      23     
produce:ophit:OpHitFinder                       8.3176e-05    0.000172547   0.000691415   0.000136336   0.000120987      23     
produce:opflash:OpFlashFinderVerticalDrift      4.7121e-05    8.9888e-05    0.000256798   8.3216e-05    3.97976e-05      23     
produce:wclsdatavd:WireCellToolkit                43.6295       75.1316       214.224       58.8736       40.0227        23     
produce:gaushit:GausHitFinder                    0.754221       1.51271       3.61729       1.38244      0.701305        23     
produce:nhitsfilter:NumberOfHitsFilter          0.000148455   0.000317965   0.000975013   0.000283729   0.000169044      23     
produce:reco3d:SpacePointSolver                   7.4228        17.4395       82.8832       11.1008       18.7071        23     
produce:hitpdune:DisambigFromSpacePoints         0.104435      0.396094       2.36948      0.197128      0.584128        23     
produce:pandora:StandardPandora                   10.7048       571.191       8297.43       24.9061       1828.16        23     
produce:pandoraTrack:LArPandoraTrackCreation     0.476056       2.89559       25.9171      0.999203       5.94403        23     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0228827     0.0456193     0.147197      0.0396574     0.0257039       23     
[art]:TriggerResults:TriggerResultInserter      2.9955e-05    5.44962e-05   0.000123967   4.9244e-05    2.06234e-05      23     
end_path:out1:RootOutput                         4.777e-06    1.14769e-05   3.5423e-05     9.485e-06    6.14606e-06      23     
end_path:out1:RootOutput(write)                   3.77458       5.09071       8.7308        4.99099      0.962948        23     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9453.31 MB
  Peak resident set size usage (VmHWM): 7046 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214255_keepup.root
\tHists: np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214256_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214255_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214255_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762206177.0,
    "core.end_time": 1762206177.0,
    "core.events": [
      213872,
      213876,
      213880,
      213884,
      213888,
      213892,
      213896,
      213900,
      213904,
      213908,
      213912,
      213916,
      213920,
      213924,
      213928,
      213932,
      213936,
      213940,
      213944,
      213948,
      213952,
      213956,
      213960
    ],
    "core.event_count": 23,
    "core.first_event_number": 213872,
    "core.last_event_number": 213960,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100_reco_stage1_20251103T214256_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762206177.0,
    "core.end_time": 1762206177.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_2317_df-s04-d0_dw_0_20251102T203100.hdf5"
    }
  ]
}
justIN time: 2025-11-05 05:02:51 UTC       justIN version: 01.05.01