Jobsub ID 41124.102@dunegpschedd02.fnal.gov

Jobsub ID	41124.102@dunegpschedd02.fnal.gov
Workflow ID	2815
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-17 17:27:29
Site	UK_Bristol
Entry	CMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat	2025-09-17 19:07:45
From worker node	Hostname	hd87.dice.priv
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	259200 (72 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-17 17:28:29
Input files	vd-protodune:np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958.hdf5
Jobscript	Exit code	0
	Real time	1h (5852s)
	CPU time	51m (3084s = 52%)
	Max RSS bytes	2751479808 (2624 MiB)
Outputting started	2025-09-17 19:06:02
Output files	vd-protodune-det-reco:np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190541_keepup.root
Finished	2025-09-17 19:07:45
Saved logs	justin-logs:41124.102-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

annel 12046
wclsFrameSaver: no samples within desired window for channel 12047
wclsFrameSaver: no samples within desired window for channel 12054
wclsFrameSaver: no samples within desired window for channel 12054
wclsFrameSaver: no samples within desired window for channel 12056
wclsFrameSaver: no samples within desired window for channel 12057
wclsFrameSaver: no samples within desired window for channel 12058
wclsFrameSaver: no samples within desired window for channel 12058
wclsFrameSaver: no samples within desired window for channel 12059
wclsFrameSaver: no samples within desired window for channel 12060
wclsFrameSaver: no samples within desired window for channel 12060
wclsFrameSaver: no samples within desired window for channel 12061
wclsFrameSaver: no samples within desired window for channel 12062
wclsFrameSaver: no samples within desired window for channel 12062
wclsFrameSaver: no samples within desired window for channel 12063
wclsFrameSaver: no samples within desired window for channel 12063
wclsFrameSaver: no samples within desired window for channel 12064
wclsFrameSaver: no samples within desired window for channel 12065
wclsFrameSaver: no samples within desired window for channel 12065
wclsFrameSaver: no samples within desired window for channel 12066
wclsFrameSaver: no samples within desired window for channel 12067
wclsFrameSaver: no samples within desired window for channel 12067
wclsFrameSaver: no samples within desired window for channel 12068
wclsFrameSaver: no samples within desired window for channel 12068
wclsFrameSaver: no samples within desired window for channel 12069
wclsFrameSaver: no samples within desired window for channel 12069
wclsFrameSaver: no samples within desired window for channel 12070
wclsFrameSaver: no samples within desired window for channel 12070
wclsFrameSaver: no samples within desired window for channel 12071
wclsFrameSaver: no samples within desired window for channel 12072
wclsFrameSaver: no samples within desired window for channel 12072
wclsFrameSaver: no samples within desired window for channel 12073
wclsFrameSaver: no samples within desired window for channel 12073
wclsFrameSaver: no samples within desired window for channel 12074
wclsFrameSaver: no samples within desired window for channel 12074
wclsFrameSaver: no samples within desired window for channel 12075
wclsFrameSaver: no samples within desired window for channel 12075
wclsFrameSaver: no samples within desired window for channel 12076
wclsFrameSaver: no samples within desired window for channel 12076
FrameSaver: q=7.22462e+06 n=842059 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 663 XUs and 526 XVs -> 43 XUVs
C:0 T:1 790 XUs and 498 XVs -> 34 XUVs
C:0 T:2 680 XUs and 612 XVs -> 42 XUVs
C:0 T:3 748 XUs and 680 XVs -> 27 XUVs
C:0 T:4 738 XUs and 1138 XVs -> 60 XUVs
C:0 T:5 946 XUs and 1273 XVs -> 45 XUVs
C:0 T:6 172 XUs and 169 XVs -> 10 XUVs
C:0 T:7 1327 XUs and 2150 XVs -> 113 XUVs
C:0 T:8 992 XUs and 1355 XVs -> 55 XUVs
C:0 T:9 929 XUs and 1519 XVs -> 60 XUVs
C:0 T:10 721 XUs and 828 XVs -> 50 XUVs
C:0 T:11 1749 XUs and 1774 XVs -> 72 XUVs
C:0 T:12 1053 XUs and 562 XVs -> 47 XUVs
C:0 T:13 2583 XUs and 3135 XVs -> 193 XUVs
C:0 T:14 4871 XUs and 5628 XVs -> 257 XUVs
C:0 T:15 3739 XUs and 4298 XVs -> 329 XUVs
1437 XUVs total
1201 collection wire objects
1437 potential space points
Neighbour search...
18693 tests to find 6930 neighbours
Iterating with no regularization...
Begin: 3.4143e+08
0 3.28449e+08
1 3.27714e+08
2 3.27709e+08
Now with regularization...
Begin: 3.23001e+08
0 3.22998e+08
17-Sep-2025 19:05:41 UTC  Closed output file "np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190541_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        207.721       304.161       469.241       299.972       62.7904        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.4284e-05    8.26179e-05   0.000180887   7.6437e-05    2.82352e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               58.8919       138.649       205.411       138.085       43.4786        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.333063      0.615703       4.19497      0.367173      0.849578        19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000228838   0.000310061   0.000822244   0.000275547   0.000124001      19     
produce:ophit:OpHitFinder                       9.4241e-05    0.000153652   0.000829177   0.000108057   0.000160613      19     
produce:opflash:OpFlashFinderVerticalDrift      3.4536e-05    5.93457e-05   0.000401298   4.0748e-05    8.07651e-05      19     
produce:wclsdatavd:WireCellToolkit                64.9581       76.2988       98.5779       75.1007       9.24053        19     
produce:gaushit:GausHitFinder                    0.936779       1.35566       2.54663       1.27853      0.333533        19     
produce:nhitsfilter:NumberOfHitsFilter           0.0003082    0.000449869   0.000888772   0.000424593   0.00013861       19     
produce:reco3d:SpacePointSolver                   10.8339       17.5949       29.8191       15.9443       5.28293        19     
produce:hitpdune:DisambigFromSpacePoints         0.129108      0.234434      0.439386      0.229424      0.0684397       19     
produce:pandora:StandardPandora                   26.1136       61.6133       151.266       55.4086       29.3469        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.695041       1.16213       2.23741       1.1037       0.367996        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0269632     0.0354232     0.0491217     0.0355693    0.00482263       19     
[art]:TriggerResults:TriggerResultInserter       1.562e-05    2.50659e-05   4.7381e-05    1.9467e-05    1.08007e-05      19     
end_path:out1:RootOutput                         3.396e-06    4.93637e-06   1.8265e-05     4.168e-06    3.17672e-06      19     
end_path:out1:RootOutput(write)                   4.84187       6.55641       18.3587       5.40681       3.18746        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4687.91 MB
  Peak resident set size usage (VmHWM): 2751.48 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190541_keepup.root
\tHists: np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190542_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190541_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190541_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758135943.0,
    "core.end_time": 1758135943.0,
    "core.events": [
      21271,
      21275,
      21279,
      21283,
      21287,
      21291,
      21295,
      21299,
      21303,
      21307,
      21311,
      21315,
      21319,
      21323,
      21327,
      21331,
      21335,
      21339,
      21343
    ],
    "core.event_count": 19,
    "core.first_event_number": 21271,
    "core.last_event_number": 21343,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958_reco_stage1_20250917T190542_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758135943.0,
    "core.end_time": 1758135943.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0276_df-s05-d3_dw_0_20250916T185958.hdf5"
    }
  ]
}