justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40871.32@dunegpschedd02.fnal.gov

Jobsub ID40871.32@dunegpschedd02.fnal.gov
Workflow ID2741
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 08:51:02
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2025-09-17 10:15:52
From worker nodeHostnamedune001-7807062.0-lcg2699.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 09:20:52
Input filesvd-protodune:np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658.hdf5
JobscriptExit code0
Real time49m (2969s)
CPU time42m (2563s = 86%)
Max RSS bytes2783277056 (2654 MiB)
Outputting started2025-09-17 10:10:23
Output filesvd-protodune-det-reco:np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup.root
Finished2025-09-17 10:15:52
Saved logsjustin-logs:40871.32-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ithin desired window for channel 11215
wclsFrameSaver: no samples within desired window for channel 11433
wclsFrameSaver: no samples within desired window for channel 11751
wclsFrameSaver: no samples within desired window for channel 11751
wclsFrameSaver: no samples within desired window for channel 11751
wclsFrameSaver: no samples within desired window for channel 11752
wclsFrameSaver: no samples within desired window for channel 11752
wclsFrameSaver: no samples within desired window for channel 11885
wclsFrameSaver: no samples within desired window for channel 11886
wclsFrameSaver: no samples within desired window for channel 11927
wclsFrameSaver: no samples within desired window for channel 11952
wclsFrameSaver: no samples within desired window for channel 11952
wclsFrameSaver: no samples within desired window for channel 11954
wclsFrameSaver: no samples within desired window for channel 11954
wclsFrameSaver: no samples within desired window for channel 11955
wclsFrameSaver: no samples within desired window for channel 12062
wclsFrameSaver: no samples within desired window for channel 12062
wclsFrameSaver: no samples within desired window for channel 12062
wclsFrameSaver: no samples within desired window for channel 12063
wclsFrameSaver: no samples within desired window for channel 12064
wclsFrameSaver: no samples within desired window for channel 12065
wclsFrameSaver: no samples within desired window for channel 12065
wclsFrameSaver: no samples within desired window for channel 12066
wclsFrameSaver: no samples within desired window for channel 12066
wclsFrameSaver: no samples within desired window for channel 12067
wclsFrameSaver: no samples within desired window for channel 12069
wclsFrameSaver: no samples within desired window for channel 12095
wclsFrameSaver: no samples within desired window for channel 12259
wclsFrameSaver: no samples within desired window for channel 12259
wclsFrameSaver: no samples within desired window for channel 12260
wclsFrameSaver: no samples within desired window for channel 12260
wclsFrameSaver: no samples within desired window for channel 12261
wclsFrameSaver: no samples within desired window for channel 12262
wclsFrameSaver: no samples within desired window for channel 12263
FrameSaver: q=1.07948e+07 n=1199323 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 611 XUs and 935 XVs -> 28 XUVs
C:0 T:1 1543 XUs and 1691 XVs -> 59 XUVs
C:0 T:2 931 XUs and 705 XVs -> 24 XUVs
C:0 T:3 985 XUs and 1194 XVs -> 42 XUVs
C:0 T:4 649 XUs and 535 XVs -> 24 XUVs
C:0 T:5 780 XUs and 1127 XVs -> 50 XUVs
C:0 T:6 958 XUs and 1379 XVs -> 38 XUVs
C:0 T:7 782 XUs and 767 XVs -> 37 XUVs
C:0 T:8 991 XUs and 1439 XVs -> 60 XUVs
C:0 T:9 6421 XUs and 4547 XVs -> 228 XUVs
C:0 T:10 1876 XUs and 1673 XVs -> 96 XUVs
C:0 T:11 996 XUs and 1168 XVs -> 36 XUVs
C:0 T:12 4372 XUs and 3840 XVs -> 228 XUVs
C:0 T:13 2831 XUs and 2276 XVs -> 159 XUVs
C:0 T:14 3770 XUs and 3007 XVs -> 193 XUVs
C:0 T:15 3105 XUs and 1881 XVs -> 189 XUVs
1491 XUVs total
1310 collection wire objects
1491 potential space points
Neighbour search...
8895 tests to find 4546 neighbours
Iterating with no regularization...
Begin: 4.78738e+08
0 4.70585e+08
1 4.70353e+08
Now with regularization...
Begin: 4.63781e+08
0 4.63773e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 10:10:11 UTC  Closed output file "np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        107.714       152.066       301.474       136.873       47.8134        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      8.1142e-05    0.000120177   0.000250768   0.000109945   4.79531e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               19.8702       20.9361       22.5489       20.7101      0.669233        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.389985      0.401904      0.444445      0.395551      0.0144674       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000215715   0.000375055   0.00146375    0.000295385   0.000267648      19     
produce:ophit:OpHitFinder                       0.000131979   0.000406175   0.00175047    0.00023936    0.000428766      19     
produce:opflash:OpFlashFinderVerticalDrift       3.971e-05    9.54565e-05   0.000676319   6.1783e-05    0.000138368      19     
produce:wclsdatavd:WireCellToolkit                50.6326       60.965        77.939        59.6927       6.42442        19     
produce:gaushit:GausHitFinder                    0.806462       1.2447        2.05153       1.1511        0.36349        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000162745   0.000317703   0.000718913   0.000280843   0.000138287      19     
produce:reco3d:SpacePointSolver                   8.32865       13.3915       25.279        11.6183       4.73185        19     
produce:hitpdune:DisambigFromSpacePoints         0.104316      0.214591      0.468876      0.189097      0.0989623       19     
produce:pandora:StandardPandora                   19.4277       49.497        178.086       32.0136       38.3824        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.394104      0.991053       2.43268      0.831508       0.58459        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0173981     0.0299464     0.0512401     0.0275475    0.00926038       19     
[art]:TriggerResults:TriggerResultInserter      1.8658e-05    3.49365e-05   7.6195e-05    2.5729e-05    1.87146e-05      19     
end_path:out1:RootOutput                         4.166e-06     9.344e-06    2.1452e-05     8.703e-06    4.03112e-06      19     
end_path:out1:RootOutput(write)                   3.6235        4.3368        5.51256       3.96334      0.708935        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4966.56 MB
  Peak resident set size usage (VmHWM): 2783.28 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup.root
\tHists: np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758103812.0,
    "core.end_time": 1758103812.0,
    "core.events": [
      58245,
      58249,
      58253,
      58257,
      58261,
      58265,
      58269,
      58273,
      58277,
      58281,
      58285,
      58289,
      58293,
      58297,
      58301,
      58305,
      58309,
      58313,
      58317
    ],
    "core.event_count": 19,
    "core.first_event_number": 58245,
    "core.last_event_number": 58317,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658_reco_stage1_20250917T101011_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758103812.0,
    "core.end_time": 1758103812.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0755_df-s05-d1_dw_0_20250917T050658.hdf5"
    }
  ]
}
justIN time: 2025-09-19 04:35:01 UTC       justIN version: 01.05.00