justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47676.39@dunegpschedd01.fnal.gov

Jobsub ID47676.39@dunegpschedd01.fnal.gov
Workflow ID2815
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 17:21:41
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk
Last heartbeat2025-09-17 19:21:50
From worker nodeHostnamewn-pep-011.farm.nikhef.nl
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 17:26:13
Input filesvd-protodune:np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748.hdf5
JobscriptExit code0
Real time1h (6883s)
CPU time59m (3577s = 51%)
Max RSS bytes2920435712 (2785 MiB)
Outputting started2025-09-17 19:20:57
Output filesvd-protodune-det-reco:np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup.root
Finished2025-09-17 19:21:50
Saved logsjustin-logs:47676.39-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

5] D [ pgraph ] <Pgrapher:> graph execution complete 
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 10.98 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 10.86 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 9.81 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 9.13 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.57 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.32 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 8.19 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 7.79 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.9 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.89 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.87 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.86 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.03 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Gen::Retagger : 0.01 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[21:19:08.755] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[21:19:08.755] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[21:19:08.755] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[21:19:08.755] I [ timer  ] Timer: Total node execution : 77.24999864399433 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 54561 traces tagged "gauss"
FrameSaver: q=9.776e+06 n=1219283 tag=gauss
wclsFrameSaver: saving 66425 traces tagged "wiener"
FrameSaver: q=1.03453e+07 n=1173495 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 166 XUs and 169 XVs -> 14 XUVs
C:0 T:1 284 XUs and 256 XVs -> 8 XUVs
C:0 T:2 873 XUs and 818 XVs -> 45 XUVs
C:0 T:3 2412 XUs and 2455 XVs -> 76 XUVs
C:0 T:4 1017 XUs and 941 XVs -> 50 XUVs
C:0 T:5 73 XUs and 80 XVs -> 4 XUVs
C:0 T:6 345 XUs and 447 XVs -> 17 XUVs
C:0 T:7 1214 XUs and 1275 XVs -> 60 XUVs
C:0 T:8 18658 XUs and 32843 XVs -> 4977 XUVs
C:0 T:9 2367 XUs and 1836 XVs -> 143 XUVs
C:0 T:10 1280 XUs and 1025 XVs -> 90 XUVs
C:0 T:11 1047 XUs and 1053 XVs -> 76 XUVs
C:0 T:12 4578 XUs and 5546 XVs -> 208 XUVs
C:0 T:13 2028 XUs and 1697 XVs -> 121 XUVs
C:0 T:14 2545 XUs and 3000 XVs -> 241 XUVs
C:0 T:15 16189 XUs and 23696 XVs -> 3351 XUVs
9481 XUVs total
1763 collection wire objects
9481 potential space points
Neighbour search...
1282005 tests to find 540184 neighbours
Iterating with no regularization...
Begin: 6.09133e+08
0 5.41503e+08
1 5.37222e+08
2 5.36479e+08
3 5.36226e+08
Now with regularization...
Begin: 5.25083e+08
0 5.2486e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 21:20:50 CEST  Closed output file "np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        203.694       360.146       515.406       375.924       74.0407        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       4.047e-05    6.16839e-05   0.00011239    6.1118e-05    1.68197e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               74.3052       177.137       234.693       190.977       48.4083        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.294085      0.444042      0.843427      0.427416      0.140964        19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000295825   0.000331615   0.000603903   0.000319876   6.49468e-05      19     
produce:ophit:OpHitFinder                       9.0354e-05    0.000149704   0.000651208   0.000103201   0.000131047      19     
produce:opflash:OpFlashFinderVerticalDrift       3.395e-05    5.50158e-05   0.00025877    4.0432e-05    4.9767e-05       19     
produce:wclsdatavd:WireCellToolkit                72.977        79.6604       101.83        78.1325       6.49132        19     
produce:gaushit:GausHitFinder                    0.954568       1.55195       2.43874       1.51981      0.375346        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000324695   0.000458083   0.000711739   0.000445621   0.000110935      19     
produce:reco3d:SpacePointSolver                   9.10524       16.4242       31.5348       15.4091       5.90028        19     
produce:hitpdune:DisambigFromSpacePoints         0.128211      0.270728      0.586976      0.247992      0.112539        19     
produce:pandora:StandardPandora                   25.9291       78.2209       186.401       68.6425       47.6001        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.650344       1.51608       3.08109       1.46084      0.616594        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0199379     0.0299407     0.0476217     0.0287586    0.00695784       19     
[art]:TriggerResults:TriggerResultInserter      1.7703e-05    2.13853e-05   5.0724e-05    1.9319e-05    7.0972e-06       19     
end_path:out1:RootOutput                         4.514e-06    7.77526e-06   2.0593e-05     7.345e-06    3.24609e-06      19     
end_path:out1:RootOutput(write)                   4.56432       4.86055       5.39893       4.83711      0.234197        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4800.75 MB
  Peak resident set size usage (VmHWM): 2920.44 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup.root
\tHists: np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758136850.0,
    "core.end_time": 1758136850.0,
    "core.events": [
      16891,
      16895,
      16899,
      16903,
      16907,
      16911,
      16915,
      16919,
      16923,
      16927,
      16931,
      16935,
      16939,
      16943,
      16947,
      16951,
      16955,
      16959,
      16963
    ],
    "core.event_count": 19,
    "core.first_event_number": 16891,
    "core.last_event_number": 16963,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748_reco_stage1_20250917T192050_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758136850.0,
    "core.end_time": 1758136850.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0219_df-s05-d3_dw_0_20250916T174748.hdf5"
    }
  ]
}
justIN time: 2025-09-18 21:16:01 UTC       justIN version: 01.05.00