justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 49050.72@dunegpschedd01.fnal.gov

Jobsub ID49050.72@dunegpschedd01.fnal.gov
Workflow ID2920
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-18 20:08:50
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2025-09-18 23:31:49
From worker nodeHostnamedune001-7806904.0-lcg2600.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-18 21:08:44
Input filesvd-protodune:np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732.hdf5
JobscriptExit code0
Real time2h (8477s)
CPU time2h (7847s = 92%)
Max RSS bytes3125432320 (2980 MiB)
Outputting started2025-09-18 23:30:02
Output filesvd-protodune-det-reco:np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup.root
Finished2025-09-18 23:31:49
Saved logsjustin-logs:49050.72-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

] <ChannelSelector:chsel0> see EOS at call=40 
[23:29:14.318] D [  aux   ] <Resampler:resmp0> EOS at call=81 
[23:29:14.318] D [sigproc ] <OmnibusSigProc:anode0sigproc0> EOS at call=81 anode=0 
[23:29:14.318] D [  glue  ] <FrameFanin:nfsp> EOS at call=81 with 8 
[23:29:14.318] D [  glue  ] frame sink sees EOS
[23:29:14.318] D [ pgraph ] <Pgrapher:> graph execution complete 
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.89 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.85 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.49 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.47 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.28 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.28 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.25 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.22 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Gen::Retagger : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[23:29:14.318] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[23:29:14.318] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 0 sec
[23:29:14.318] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[23:29:14.318] I [ timer  ] Timer: Total node execution : 35.75000076368451 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 21566 traces tagged "gauss"
FrameSaver: q=3.26893e+06 n=471085 tag=gauss
wclsFrameSaver: saving 27550 traces tagged "wiener"
FrameSaver: q=3.50665e+06 n=449771 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 959 XUs and 1463 XVs -> 148 XUVs
C:0 T:1 157 XUs and 207 XVs -> 9 XUVs
C:0 T:2 1860 XUs and 2368 XVs -> 232 XUVs
C:0 T:3 1678 XUs and 2172 XVs -> 109 XUVs
C:0 T:4 1137 XUs and 2168 XVs -> 75 XUVs
C:0 T:5 775 XUs and 1489 XVs -> 44 XUVs
C:0 T:6 10340 XUs and 18243 XVs -> 1007 XUVs
C:0 T:7 702 XUs and 749 XVs -> 36 XUVs
1660 XUVs total
1064 collection wire objects
1660 potential space points
Neighbour search...
51770 tests to find 15248 neighbours
Iterating with no regularization...
Begin: 1.01106e+09
0 9.29728e+08
1 9.26117e+08
2 9.26024e+08
Now with regularization...
Begin: 9.17306e+08
0 9.17289e+08
18-Sep-2025 23:29:46 UTC  Closed output file "np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        55.0232       204.118       4280.04       80.252        647.106        41     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.2331e-05    0.000135715   0.000255247   0.000119194   5.15536e-05      41     
produce:tpcrawdecoder:PDVDTPCReader               7.33412       8.39624       11.5632       7.98435       1.01256        41     
produce:triggerrawdecoder:PDVDTriggerReader4     0.389662      0.419008       0.76877      0.395857      0.0666296       41     
produce:pdvddaphne:DAPHNEReaderPDVD               2.88964       3.49253       4.18283       3.44835      0.331475        41     
produce:ophit:OpHitFinder                        0.0313658     0.0488399     0.0625411     0.0484718    0.00710492       41     
produce:opflash:OpFlashFinderVerticalDrift      0.00592967     0.0125266     0.0247589     0.0120361    0.00487514       41     
produce:wclsdatavd:WireCellToolkit                27.5439       38.7366       79.3085       36.6019       9.95407        41     
produce:gaushit:GausHitFinder                    0.350672      0.769907       2.07231      0.671985      0.333707        41     
produce:nhitsfilter:NumberOfHitsFilter          0.000103873   0.000342234   0.00103147    0.000251798   0.000226015      41     
produce:reco3d:SpacePointSolver                   2.16212       7.86439       38.0166       6.21857       6.59746        41     
produce:hitpdune:DisambigFromSpacePoints         0.0273318     0.131817      0.784052      0.0863104     0.156659        41     
produce:pandora:StandardPandora                   5.27723       140.743       4166.79       19.6983       638.531        41     
produce:pandoraTrack:LArPandoraTrackCreation     0.093742       0.65168       9.23338      0.321724       1.40321        41     
produce:pandoraGnocalo:GnocchiCalorimetry       0.00763999     0.0213392     0.0779802     0.019359      0.0115399       41     
[art]:TriggerResults:TriggerResultInserter       1.971e-05    4.57875e-05   0.000105503   4.2911e-05    1.83783e-05      41     
end_path:out1:RootOutput                         4.77e-06     1.12744e-05   3.7841e-05    1.0211e-05    6.22672e-06      41     
end_path:out1:RootOutput(write)                   2.37092       2.79596       4.33907       2.73588      0.358528        41     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5293.89 MB
  Peak resident set size usage (VmHWM): 3125.43 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup.root
\tHists: np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758238187.0,
    "core.end_time": 1758238187.0,
    "core.events": [
      13918,
      13924,
      13930,
      13936,
      13942,
      13948,
      13954,
      13960,
      13966,
      13972,
      13978,
      13984,
      13990,
      13996,
      14002,
      14008,
      14014,
      14020,
      14026,
      14032,
      14038,
      14044,
      14050,
      14056,
      14062,
      14068,
      14074,
      14080,
      14086,
      14092,
      14098,
      14104,
      14110,
      14116,
      14122,
      14128,
      14134,
      14140,
      14146,
      14152,
      14158
    ],
    "core.event_count": 41,
    "core.first_event_number": 13918,
    "core.last_event_number": 14158,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39499
    ],
    "core.runs_subruns": [
      3949900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732_reco_stage1_20250918T232946_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758238187.0,
    "core.end_time": 1758238187.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39499
    ],
    "core.runs_subruns": [
      3949900001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039499_0057_df-s05-d4_dw_0_20250918T193732.hdf5"
    }
  ]
}
justIN time: 2025-09-19 01:34:24 UTC       justIN version: 01.05.00