Jobsub ID 46945.49@dunegpschedd01.fnal.gov

Jobsub ID	46945.49@dunegpschedd01.fnal.gov
Workflow ID	2641
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-16 06:46:39
Site	CERN
Entry	CMSHTPC_T2_CH_CERN_ce511
Last heartbeat	2025-09-16 07:38:28
From worker node	Hostname	b9p09p4833.cern.ch
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	343800 (95 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-16 06:47:42
Input files	vd-protodune:np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711.hdf5
Jobscript	Exit code	0
	Real time	49m (2972s)
	CPU time	47m (2875s = 96%)
	Max RSS bytes	3189522432 (3041 MiB)
Outputting started	2025-09-16 07:37:15
Output files	vd-protodune-det-reco:np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073702_keepup.root
Finished	2025-09-16 07:38:28
Saved logs	justin-logs:46945.49-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ow for channel 8770
wclsFrameSaver: no samples within desired window for channel 8775
wclsFrameSaver: no samples within desired window for channel 9012
wclsFrameSaver: no samples within desired window for channel 9012
wclsFrameSaver: no samples within desired window for channel 9013
wclsFrameSaver: no samples within desired window for channel 9013
wclsFrameSaver: no samples within desired window for channel 9014
wclsFrameSaver: no samples within desired window for channel 9014
wclsFrameSaver: no samples within desired window for channel 9015
wclsFrameSaver: no samples within desired window for channel 9015
wclsFrameSaver: no samples within desired window for channel 9018
wclsFrameSaver: no samples within desired window for channel 9181
wclsFrameSaver: no samples within desired window for channel 9182
wclsFrameSaver: no samples within desired window for channel 9184
wclsFrameSaver: no samples within desired window for channel 9185
wclsFrameSaver: no samples within desired window for channel 9185
wclsFrameSaver: no samples within desired window for channel 9185
wclsFrameSaver: no samples within desired window for channel 9186
wclsFrameSaver: no samples within desired window for channel 9186
wclsFrameSaver: no samples within desired window for channel 9187
wclsFrameSaver: no samples within desired window for channel 9188
wclsFrameSaver: no samples within desired window for channel 9188
wclsFrameSaver: no samples within desired window for channel 9575
wclsFrameSaver: no samples within desired window for channel 9575
wclsFrameSaver: no samples within desired window for channel 9769
wclsFrameSaver: no samples within desired window for channel 9770
wclsFrameSaver: no samples within desired window for channel 10070
wclsFrameSaver: no samples within desired window for channel 10297
wclsFrameSaver: no samples within desired window for channel 10359
wclsFrameSaver: no samples within desired window for channel 10695
wclsFrameSaver: no samples within desired window for channel 10696
wclsFrameSaver: no samples within desired window for channel 10697
wclsFrameSaver: no samples within desired window for channel 10698
wclsFrameSaver: no samples within desired window for channel 10699
wclsFrameSaver: no samples within desired window for channel 10699
wclsFrameSaver: no samples within desired window for channel 11883
wclsFrameSaver: no samples within desired window for channel 11884
wclsFrameSaver: no samples within desired window for channel 11886
FrameSaver: q=8.41816e+06 n=985980 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1659 XUs and 1915 XVs -> 51 XUVs
C:0 T:1 564 XUs and 568 XVs -> 57 XUVs
C:0 T:2 1994 XUs and 1849 XVs -> 66 XUVs
C:0 T:3 617 XUs and 940 XVs -> 29 XUVs
C:0 T:4 471 XUs and 689 XVs -> 25 XUVs
C:0 T:5 280 XUs and 349 XVs -> 16 XUVs
C:0 T:6 177 XUs and 252 XVs -> 18 XUVs
C:0 T:7 829 XUs and 1191 XVs -> 51 XUVs
C:0 T:8 9604 XUs and 11066 XVs -> 665 XUVs
C:0 T:9 610 XUs and 747 XVs -> 51 XUVs
C:0 T:10 2133 XUs and 2271 XVs -> 129 XUVs
C:0 T:11 4400 XUs and 4452 XVs -> 213 XUVs
C:0 T:12 1488 XUs and 1932 XVs -> 77 XUVs
C:0 T:13 974 XUs and 1331 XVs -> 95 XUVs
C:0 T:14 1733 XUs and 2735 XVs -> 168 XUVs
C:0 T:15 1257 XUs and 1650 XVs -> 155 XUVs
1866 XUVs total
1428 collection wire objects
1866 potential space points
Neighbour search...
22580 tests to find 8092 neighbours
Iterating with no regularization...
Begin: 6.75806e+08
0 6.5987e+08
1 6.59279e+08
Now with regularization...
Begin: 6.48936e+08
0 6.48893e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
16-Sep-2025 09:37:02 CEST  Closed output file "np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073702_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        93.9743       146.128       238.466       142.661       39.2359        20     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.2001e-05    8.58079e-05   0.000129922   7.63105e-05   2.58564e-05      20     
produce:tpcrawdecoder:PDVDTPCReader               1.03147       5.4301        6.40257       5.55621       1.06417        20     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00530982     0.0071809    0.00908073    0.00732083    0.000819784      20     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000211942   0.000340751   0.000770248   0.000320843   0.000103743      20     
produce:ophit:OpHitFinder                       0.000109141   0.000242501   0.00097108    0.000216747   0.000177242      20     
produce:opflash:OpFlashFinderVerticalDrift       3.997e-05    8.18759e-05   0.000389054   6.49905e-05   7.12278e-05      20     
produce:wclsdatavd:WireCellToolkit                15.9845       63.6308       80.4877       65.0882       13.1081        20     
produce:gaushit:GausHitFinder                    0.767487       1.32647       2.17033       1.32172      0.398063        20     
produce:nhitsfilter:NumberOfHitsFilter          0.000169702   0.000314333   0.000597626   0.000321759   0.000100978      20     
produce:reco3d:SpacePointSolver                   6.44532        14.45        25.4181       14.0511       5.55685        20     
produce:hitpdune:DisambigFromSpacePoints         0.0908212     0.230752      0.568192      0.187565      0.125227        20     
produce:pandora:StandardPandora                   14.3209       54.8945       124.11        46.9528       27.7904        20     
produce:pandoraTrack:LArPandoraTrackCreation     0.351342       1.04121       2.49933      0.894812      0.535725        20     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0161204     0.0305061     0.0639578     0.0282089     0.0116736       20     
[art]:TriggerResults:TriggerResultInserter       1.876e-05    2.8433e-05    7.7691e-05    2.3726e-05    1.40245e-05      20     
end_path:out1:RootOutput                         3.75e-06     9.1007e-06     3.239e-05    8.4755e-06    5.64441e-06      20     
end_path:out1:RootOutput(write)                   1.63548       5.05368       6.5389        5.30173       1.09028        20     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5127.75 MB
  Peak resident set size usage (VmHWM): 3189.52 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073702_keepup.root
\tHists: np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073703_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073702_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073702_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758008223.0,
    "core.end_time": 1758008223.0,
    "core.events": [
      54062,
      54066,
      54070,
      54074,
      54078,
      54082,
      54086,
      54090,
      54094,
      54098,
      54102,
      54106,
      54110,
      54114,
      54118,
      54122,
      54126,
      54130,
      54134,
      54138
    ],
    "core.event_count": 20,
    "core.first_event_number": 54062,
    "core.last_event_number": 54138,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711_reco_stage1_20250916T073703_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758008223.0,
    "core.end_time": 1758008223.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0702_df-s05-d2_dw_0_20250916T054711.hdf5"
    }
  ]
}