justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40870.143@dunegpschedd02.fnal.gov

Jobsub ID40870.143@dunegpschedd02.fnal.gov
Workflow ID2740
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 08:51:00
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2025-09-17 10:17:54
From worker nodeHostnameheplnc171.pp.rl.ac.uk
cpuinfoAMD EPYC 9534 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 09:17:31
Input filesvd-protodune:np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854.hdf5
JobscriptExit code0
Real time54m (3289s)
CPU time49m (2985s = 90%)
Max RSS bytes2746314752 (2619 MiB)
Outputting started2025-09-17 10:12:21
Output filesvd-protodune-det-reco:np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101211_keepup.root
Finished2025-09-17 10:17:54
Saved logsjustin-logs:40870.143-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

les within desired window for channel 9966
wclsFrameSaver: no samples within desired window for channel 9967
wclsFrameSaver: no samples within desired window for channel 9968
wclsFrameSaver: no samples within desired window for channel 9969
wclsFrameSaver: no samples within desired window for channel 9969
wclsFrameSaver: no samples within desired window for channel 9971
wclsFrameSaver: no samples within desired window for channel 9973
wclsFrameSaver: no samples within desired window for channel 10248
wclsFrameSaver: no samples within desired window for channel 10252
wclsFrameSaver: no samples within desired window for channel 10524
wclsFrameSaver: no samples within desired window for channel 10833
wclsFrameSaver: no samples within desired window for channel 10833
wclsFrameSaver: no samples within desired window for channel 10847
wclsFrameSaver: no samples within desired window for channel 10848
wclsFrameSaver: no samples within desired window for channel 10848
wclsFrameSaver: no samples within desired window for channel 10849
wclsFrameSaver: no samples within desired window for channel 10849
wclsFrameSaver: no samples within desired window for channel 10850
wclsFrameSaver: no samples within desired window for channel 10850
wclsFrameSaver: no samples within desired window for channel 10851
wclsFrameSaver: no samples within desired window for channel 10851
wclsFrameSaver: no samples within desired window for channel 10852
wclsFrameSaver: no samples within desired window for channel 10853
wclsFrameSaver: no samples within desired window for channel 10854
wclsFrameSaver: no samples within desired window for channel 10860
wclsFrameSaver: no samples within desired window for channel 10945
wclsFrameSaver: no samples within desired window for channel 10999
wclsFrameSaver: no samples within desired window for channel 11924
wclsFrameSaver: no samples within desired window for channel 11952
wclsFrameSaver: no samples within desired window for channel 11952
wclsFrameSaver: no samples within desired window for channel 11998
wclsFrameSaver: no samples within desired window for channel 11999
wclsFrameSaver: no samples within desired window for channel 12000
wclsFrameSaver: no samples within desired window for channel 12000
wclsFrameSaver: no samples within desired window for channel 12244
wclsFrameSaver: no samples within desired window for channel 12244
wclsFrameSaver: no samples within desired window for channel 12244
wclsFrameSaver: no samples within desired window for channel 12245
wclsFrameSaver: no samples within desired window for channel 12246
FrameSaver: q=5.46162e+06 n=638092 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 618 XUs and 464 XVs -> 25 XUVs
C:0 T:1 716 XUs and 658 XVs -> 26 XUVs
C:0 T:2 1296 XUs and 938 XVs -> 29 XUVs
C:0 T:3 798 XUs and 707 XVs -> 29 XUVs
C:0 T:4 681 XUs and 573 XVs -> 31 XUVs
C:0 T:5 215 XUs and 404 XVs -> 20 XUVs
C:0 T:6 20 XUs and 21 XVs -> 0 XUVs
C:0 T:7 16 XUs and 19 XVs -> 0 XUVs
C:0 T:8 1035 XUs and 1841 XVs -> 73 XUVs
C:0 T:9 2138 XUs and 2608 XVs -> 126 XUVs
C:0 T:10 2166 XUs and 2171 XVs -> 115 XUVs
C:0 T:11 872 XUs and 1604 XVs -> 62 XUVs
C:0 T:12 1935 XUs and 1933 XVs -> 125 XUVs
C:0 T:13 2150 XUs and 2352 XVs -> 113 XUVs
C:0 T:14 411 XUs and 318 XVs -> 13 XUVs
C:0 T:15 1714 XUs and 1277 XVs -> 53 XUVs
840 XUVs total
722 collection wire objects
840 potential space points
Neighbour search...
4272 tests to find 2300 neighbours
Iterating with no regularization...
Begin: 1.99459e+08
0 1.93815e+08
1 1.93721e+08
Now with regularization...
Begin: 1.91048e+08
0 1.91037e+08
17-Sep-2025 11:12:11 BST  Closed output file "np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101211_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        120.733       170.049       303.549       153.291       42.4411        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      9.7191e-05    0.000143545   0.000300244   0.000137082   4.43892e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               14.6257       16.5721       43.4445       15.0625       6.33958        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.302952      0.310982      0.346469      0.307773      0.0093933       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000250893   0.000412947   0.00109471    0.000375825   0.000166605      19     
produce:ophit:OpHitFinder                       0.000225623   0.00039145     0.0012847    0.000281624   0.000308955      19     
produce:opflash:OpFlashFinderVerticalDrift       4.694e-05    9.35706e-05   0.000482516   7.1881e-05    9.24784e-05      19     
produce:wclsdatavd:WireCellToolkit                64.0608       71.1891       79.9168       69.9888       4.38505        19     
produce:gaushit:GausHitFinder                     0.7116         1.448        2.25956       1.46086      0.342936        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000150262   0.000361681   0.000770881   0.000355865   0.000136219      19     
produce:reco3d:SpacePointSolver                   7.11507       14.6799       25.7018       14.0861       4.41397        19     
produce:hitpdune:DisambigFromSpacePoints         0.082547      0.244688      0.435759      0.238783      0.090283        19     
produce:pandora:StandardPandora                   21.5894       58.3587       173.877       47.8646       35.0516        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.525475       1.2797        2.57362       1.16076      0.555653        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.017347      0.0376861     0.0562443     0.0376955    0.00988514       19     
[art]:TriggerResults:TriggerResultInserter       3.711e-05    5.97385e-05   0.000137842   5.3901e-05    2.36738e-05      19     
end_path:out1:RootOutput                         8.62e-06     1.42606e-05    4.608e-05      1.3e-05     7.86497e-06      19     
end_path:out1:RootOutput(write)                   4.40965       5.86923       6.35716       5.95747       0.39847        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4651.9 MB
  Peak resident set size usage (VmHWM): 2746.31 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101211_keepup.root
\tHists: np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101212_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101211_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101211_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758103932.0,
    "core.end_time": 1758103932.0,
    "core.events": [
      53479,
      53483,
      53487,
      53491,
      53495,
      53499,
      53503,
      53507,
      53511,
      53515,
      53519,
      53523,
      53527,
      53531,
      53535,
      53539,
      53543,
      53547,
      53551
    ],
    "core.event_count": 19,
    "core.first_event_number": 53479,
    "core.last_event_number": 53551,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854_reco_stage1_20250917T101212_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758103932.0,
    "core.end_time": 1758103932.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0694_df-s05-d3_dw_0_20250917T034854.hdf5"
    }
  ]
}
justIN time: 2025-09-18 17:35:42 UTC       justIN version: 01.05.00