Jobsub ID 47409.8@dunegpschedd01.fnal.gov

Jobsub ID	47409.8@dunegpschedd01.fnal.gov
Workflow ID	2740
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-17 08:45:00
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_dissel
Last heartbeat	2025-09-17 09:55:26
From worker node	Hostname	wn-snel-020.farm.nikhef.nl
	cpuinfo	AMD EPYC 7H12 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-17 08:46:32
Input files	vd-protodune:np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001.hdf5
Jobscript	Exit code	0
	Real time	48m (2900s)
	CPU time	44m (2679s = 92%)
	Max RSS bytes	2780401664 (2651 MiB)
Outputting started	2025-09-17 09:34:54
Output files	vd-protodune-det-reco:np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093445_keepup.root
Finished	2025-09-17 09:55:26
Saved logs	justin-logs:47409.8-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

w for channel 10715
wclsFrameSaver: no samples within desired window for channel 10715
wclsFrameSaver: no samples within desired window for channel 10717
wclsFrameSaver: no samples within desired window for channel 10848
wclsFrameSaver: no samples within desired window for channel 10848
wclsFrameSaver: no samples within desired window for channel 10881
wclsFrameSaver: no samples within desired window for channel 10881
wclsFrameSaver: no samples within desired window for channel 10882
wclsFrameSaver: no samples within desired window for channel 10882
wclsFrameSaver: no samples within desired window for channel 10883
wclsFrameSaver: no samples within desired window for channel 10884
wclsFrameSaver: no samples within desired window for channel 10884
wclsFrameSaver: no samples within desired window for channel 10897
wclsFrameSaver: no samples within desired window for channel 10897
wclsFrameSaver: no samples within desired window for channel 10929
wclsFrameSaver: no samples within desired window for channel 11059
wclsFrameSaver: no samples within desired window for channel 11406
wclsFrameSaver: no samples within desired window for channel 11406
wclsFrameSaver: no samples within desired window for channel 11406
wclsFrameSaver: no samples within desired window for channel 11979
wclsFrameSaver: no samples within desired window for channel 11979
wclsFrameSaver: no samples within desired window for channel 11980
wclsFrameSaver: no samples within desired window for channel 11981
wclsFrameSaver: no samples within desired window for channel 11981
wclsFrameSaver: no samples within desired window for channel 11982
wclsFrameSaver: no samples within desired window for channel 12057
wclsFrameSaver: no samples within desired window for channel 12252
wclsFrameSaver: no samples within desired window for channel 12252
wclsFrameSaver: no samples within desired window for channel 12252
wclsFrameSaver: no samples within desired window for channel 12252
wclsFrameSaver: no samples within desired window for channel 12259
wclsFrameSaver: no samples within desired window for channel 12271
wclsFrameSaver: no samples within desired window for channel 12272
wclsFrameSaver: no samples within desired window for channel 12272
wclsFrameSaver: no samples within desired window for channel 12274
wclsFrameSaver: no samples within desired window for channel 12274
wclsFrameSaver: no samples within desired window for channel 12275
wclsFrameSaver: no samples within desired window for channel 12280
FrameSaver: q=6.67831e+06 n=835074 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 818 XUs and 1030 XVs -> 45 XUVs
C:0 T:1 117 XUs and 150 XVs -> 5 XUVs
C:0 T:2 279 XUs and 246 XVs -> 4 XUVs
C:0 T:3 341 XUs and 385 XVs -> 16 XUVs
C:0 T:4 750 XUs and 809 XVs -> 31 XUVs
C:0 T:5 1738 XUs and 1548 XVs -> 64 XUVs
C:0 T:6 494 XUs and 477 XVs -> 35 XUVs
C:0 T:7 607 XUs and 737 XVs -> 39 XUVs
C:0 T:8 213 XUs and 155 XVs -> 18 XUVs
C:0 T:9 3186 XUs and 3246 XVs -> 176 XUVs
C:0 T:10 462 XUs and 558 XVs -> 45 XUVs
C:0 T:11 1623 XUs and 1847 XVs -> 161 XUVs
C:0 T:12 596 XUs and 910 XVs -> 43 XUVs
C:0 T:13 2147 XUs and 1669 XVs -> 86 XUVs
C:0 T:14 2126 XUs and 2317 XVs -> 106 XUVs
C:0 T:15 2193 XUs and 2489 XVs -> 178 XUVs
1052 XUVs total
899 collection wire objects
1052 potential space points
Neighbour search...
6254 tests to find 3140 neighbours
Iterating with no regularization...
Begin: 2.58504e+08
0 2.51294e+08
1 2.51244e+08
Now with regularization...
Begin: 2.46659e+08
0 2.46643e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 11:34:45 CEST  Closed output file "np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093445_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        109.268       150.264       250.648       143.343       31.5927        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.6825e-05    8.57822e-05   0.000199013   8.2566e-05    2.7693e-05       19     
produce:tpcrawdecoder:PDVDTPCReader               16.709        17.4881       18.1322       17.4176      0.338038        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.293587      0.297917      0.316595      0.295427     0.00599375       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000365706   0.000439871   0.000752554   0.00042586    7.94171e-05      19     
produce:ophit:OpHitFinder                       0.000128802   0.000184116   0.000778432   0.000145834   0.000142478      19     
produce:opflash:OpFlashFinderVerticalDrift      5.2489e-05    7.22864e-05    0.0003408    5.8069e-05    6.3409e-05       19     
produce:wclsdatavd:WireCellToolkit                56.3844       63.1383       75.758        61.7924       4.76448        19     
produce:gaushit:GausHitFinder                    0.853653        1.239        1.93371       1.15111       0.24748        19     
produce:nhitsfilter:NumberOfHitsFilter          0.00032502    0.00059419    0.00107502    0.000550073   0.000213361      19     
produce:reco3d:SpacePointSolver                   9.0475        14.2282       23.1684       14.1203       3.64141        19     
produce:hitpdune:DisambigFromSpacePoints         0.107238      0.195048       0.39611      0.181485      0.0649419       19     
produce:pandora:StandardPandora                   20.7001       48.2498       132.373       39.6758       25.4768        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.351776      0.995433       1.79943      0.913283       0.38818        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0192819     0.030502      0.0439195     0.0299277    0.00689911       19     
[art]:TriggerResults:TriggerResultInserter       1.588e-05    2.08681e-05   5.4943e-05    1.9176e-05    8.19177e-06      19     
end_path:out1:RootOutput                         3.888e-06    5.49679e-06   2.2312e-05     4.669e-06    3.97443e-06      19     
end_path:out1:RootOutput(write)                   4.09425       4.35119       4.66097       4.37092      0.158262        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4661.4 MB
  Peak resident set size usage (VmHWM): 2780.4 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093445_keepup.root
\tHists: np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093446_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093445_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093445_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758101686.0,
    "core.end_time": 1758101686.0,
    "core.events": [
      35840,
      35844,
      35848,
      35852,
      35856,
      35860,
      35864,
      35868,
      35872,
      35876,
      35880,
      35884,
      35888,
      35892,
      35896,
      35900,
      35904,
      35908,
      35912
    ],
    "core.event_count": 19,
    "core.first_event_number": 35840,
    "core.last_event_number": 35912,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001_reco_stage1_20250917T093446_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758101686.0,
    "core.end_time": 1758101686.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0466_df-s05-d0_dw_0_20250916T230001.hdf5"
    }
  ]
}