Jobsub ID 40869.37@dunegpschedd02.fnal.gov

Jobsub ID	40869.37@dunegpschedd02.fnal.gov
Workflow ID	2740
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-17 08:47:00
Site	UK_Oxford
Entry	DUNE_UK_SGrid_Oxford_arc01
Last heartbeat	2025-09-17 10:50:19
From worker node	Hostname	t2wn173.physics.ox.ac.uk
	cpuinfo	AMD EPYC 9655 96-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-17 09:01:43
Input files	vd-protodune:np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521.hdf5
Jobscript	Exit code	0
	Real time	1h (6171s)
	CPU time	42m (2530s = 40%)
	Max RSS bytes	3665309696 (3495 MiB)
Outputting started	2025-09-17 10:44:35
Output files	vd-protodune-det-reco:np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup.root
Finished	2025-09-17 10:50:19
Saved logs	justin-logs:40869.37-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

28
wclsFrameSaver: no samples within desired window for channel 10728
wclsFrameSaver: no samples within desired window for channel 10728
wclsFrameSaver: no samples within desired window for channel 10729
wclsFrameSaver: no samples within desired window for channel 10730
wclsFrameSaver: no samples within desired window for channel 10771
wclsFrameSaver: no samples within desired window for channel 10935
wclsFrameSaver: no samples within desired window for channel 10968
wclsFrameSaver: no samples within desired window for channel 10969
wclsFrameSaver: no samples within desired window for channel 11015
wclsFrameSaver: no samples within desired window for channel 11016
wclsFrameSaver: no samples within desired window for channel 11017
wclsFrameSaver: no samples within desired window for channel 11018
wclsFrameSaver: no samples within desired window for channel 11778
wclsFrameSaver: no samples within desired window for channel 11778
wclsFrameSaver: no samples within desired window for channel 11778
wclsFrameSaver: no samples within desired window for channel 11779
wclsFrameSaver: no samples within desired window for channel 11779
wclsFrameSaver: no samples within desired window for channel 11780
wclsFrameSaver: no samples within desired window for channel 11780
wclsFrameSaver: no samples within desired window for channel 11780
wclsFrameSaver: no samples within desired window for channel 11781
wclsFrameSaver: no samples within desired window for channel 11781
wclsFrameSaver: no samples within desired window for channel 11782
wclsFrameSaver: no samples within desired window for channel 11782
wclsFrameSaver: no samples within desired window for channel 11783
wclsFrameSaver: no samples within desired window for channel 11783
wclsFrameSaver: no samples within desired window for channel 11784
wclsFrameSaver: no samples within desired window for channel 12013
wclsFrameSaver: no samples within desired window for channel 12013
wclsFrameSaver: no samples within desired window for channel 12014
wclsFrameSaver: no samples within desired window for channel 12015
wclsFrameSaver: no samples within desired window for channel 12016
wclsFrameSaver: no samples within desired window for channel 12017
wclsFrameSaver: no samples within desired window for channel 12042
wclsFrameSaver: no samples within desired window for channel 12043
wclsFrameSaver: no samples within desired window for channel 12045
wclsFrameSaver: no samples within desired window for channel 12045
wclsFrameSaver: no samples within desired window for channel 12046
FrameSaver: q=9.03225e+06 n=988836 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1985 XUs and 2577 XVs -> 54 XUVs
C:0 T:1 831 XUs and 873 XVs -> 32 XUVs
C:0 T:2 1945 XUs and 1875 XVs -> 137 XUVs
C:0 T:3 2123 XUs and 2502 XVs -> 206 XUVs
C:0 T:4 240 XUs and 737 XVs -> 18 XUVs
C:0 T:5 211 XUs and 226 XVs -> 9 XUVs
C:0 T:6 646 XUs and 785 XVs -> 58 XUVs
C:0 T:7 965 XUs and 1062 XVs -> 50 XUVs
C:0 T:8 24613 XUs and 61414 XVs -> 6078 XUVs
C:0 T:9 1890 XUs and 1260 XVs -> 216 XUVs
C:0 T:10 118 XUs and 136 XVs -> 7 XUVs
C:0 T:11 334 XUs and 680 XVs -> 18 XUVs
C:0 T:12 3062 XUs and 2457 XVs -> 179 XUVs
C:0 T:13 831 XUs and 363 XVs -> 40 XUVs
C:0 T:14 1913 XUs and 1731 XVs -> 116 XUVs
C:0 T:15 3639 XUs and 2760 XVs -> 176 XUVs
7394 XUVs total
1718 collection wire objects
7394 potential space points
Neighbour search...
612194 tests to find 272984 neighbours
Iterating with no regularization...
Begin: 8.21162e+08
0 7.52085e+08
1 7.46328e+08
2 7.45709e+08
Now with regularization...
Begin: 7.2725e+08
0 7.26913e+08
17-Sep-2025 11:44:26 BST  Closed output file "np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        228.331       321.363       508.695       292.611       70.8221        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       7.217e-05    0.000102826   0.000241847   8.4288e-05    4.6419e-05       19     
produce:tpcrawdecoder:PDVDTPCReader               135.871       193.306       264.302       171.13        43.2497        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.343061      0.469439      0.874761      0.442101       0.12107        19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000306675   0.000406273   0.00090234    0.00038204    0.00012359       19     
produce:ophit:OpHitFinder                       0.000140263   0.000270961    0.0011312    0.00023034    0.000208384      19     
produce:opflash:OpFlashFinderVerticalDrift       3.904e-05    8.88186e-05   0.000488642   6.9065e-05    9.54594e-05      19     
produce:wclsdatavd:WireCellToolkit                45.0035       59.1755       74.9756       57.9103       7.59434        19     
produce:gaushit:GausHitFinder                    0.663474       1.20976       2.0676        1.13562      0.414205        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000162507   0.000272613   0.00060631    0.000216609   0.000108962      19     
produce:reco3d:SpacePointSolver                   8.02477       13.8874       30.0068       11.3112       5.42503        19     
produce:hitpdune:DisambigFromSpacePoints         0.0726213     0.210872      0.602283      0.191807      0.117743        19     
produce:pandora:StandardPandora                   16.3274       47.5303       129.987       35.0866       32.2014        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.499499       1.02869       1.89382      0.926277      0.374763        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.017072      0.0292051     0.0425119     0.0286246    0.00747228       19     
[art]:TriggerResults:TriggerResultInserter      3.0346e-05    4.98294e-05   0.000148987   4.3827e-05    2.46459e-05      19     
end_path:out1:RootOutput                         6.049e-06    1.13472e-05   3.9891e-05     8.953e-06    7.13902e-06      19     
end_path:out1:RootOutput(write)                   3.44486       4.45924       5.31284       4.68233      0.556262        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5727.41 MB
  Peak resident set size usage (VmHWM): 3665.31 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup.root
\tHists: np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758105867.0,
    "core.end_time": 1758105867.0,
    "core.events": [
      45306,
      45310,
      45314,
      45318,
      45322,
      45326,
      45330,
      45334,
      45338,
      45342,
      45346,
      45350,
      45354,
      45358,
      45362,
      45366,
      45370,
      45374,
      45378
    ],
    "core.event_count": 19,
    "core.first_event_number": 45306,
    "core.last_event_number": 45378,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521_reco_stage1_20250917T104426_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758105867.0,
    "core.end_time": 1758105867.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0588_df-s05-d2_dw_0_20250917T013521.hdf5"
    }
  ]
}