Jobsub ID 47422.18@dunegpschedd01.fnal.gov

Jobsub ID	47422.18@dunegpschedd01.fnal.gov
Workflow ID	2744
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-17 09:05:01
Site	CERN
Entry	CMSHTPC_T2_CH_CERN_ce503
Last heartbeat	2025-09-17 11:25:05
From worker node	Hostname	b9p09p9337.cern.ch
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	343800 (95 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-17 10:19:00
Input files	vd-protodune:np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145.hdf5
Jobscript	Exit code	0
	Real time	1h (3878s)
	CPU time	1h (3725s = 96%)
	Max RSS bytes	3243286528 (3093 MiB)
Outputting started	2025-09-17 11:23:39
Output files	vd-protodune-det-reco:np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112328_keepup.root
Finished	2025-09-17 11:25:05
Saved logs	justin-logs:47422.18-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

for channel 11571
wclsFrameSaver: no samples within desired window for channel 11612
wclsFrameSaver: no samples within desired window for channel 11614
wclsFrameSaver: no samples within desired window for channel 11614
wclsFrameSaver: no samples within desired window for channel 11615
wclsFrameSaver: no samples within desired window for channel 11615
wclsFrameSaver: no samples within desired window for channel 11616
wclsFrameSaver: no samples within desired window for channel 11616
wclsFrameSaver: no samples within desired window for channel 11617
wclsFrameSaver: no samples within desired window for channel 11617
wclsFrameSaver: no samples within desired window for channel 11642
wclsFrameSaver: no samples within desired window for channel 11643
wclsFrameSaver: no samples within desired window for channel 11643
wclsFrameSaver: no samples within desired window for channel 11644
wclsFrameSaver: no samples within desired window for channel 11644
wclsFrameSaver: no samples within desired window for channel 11645
wclsFrameSaver: no samples within desired window for channel 11646
wclsFrameSaver: no samples within desired window for channel 11646
wclsFrameSaver: no samples within desired window for channel 11801
wclsFrameSaver: no samples within desired window for channel 11801
wclsFrameSaver: no samples within desired window for channel 11802
wclsFrameSaver: no samples within desired window for channel 11802
wclsFrameSaver: no samples within desired window for channel 11803
wclsFrameSaver: no samples within desired window for channel 11804
wclsFrameSaver: no samples within desired window for channel 11987
wclsFrameSaver: no samples within desired window for channel 12026
wclsFrameSaver: no samples within desired window for channel 12026
wclsFrameSaver: no samples within desired window for channel 12027
wclsFrameSaver: no samples within desired window for channel 12028
wclsFrameSaver: no samples within desired window for channel 12029
wclsFrameSaver: no samples within desired window for channel 12031
wclsFrameSaver: no samples within desired window for channel 12035
wclsFrameSaver: no samples within desired window for channel 12036
wclsFrameSaver: no samples within desired window for channel 12036
wclsFrameSaver: no samples within desired window for channel 12037
wclsFrameSaver: no samples within desired window for channel 12037
wclsFrameSaver: no samples within desired window for channel 12037
wclsFrameSaver: no samples within desired window for channel 12038
wclsFrameSaver: no samples within desired window for channel 12038
FrameSaver: q=1.26936e+07 n=1477866 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 5231 XUs and 4549 XVs -> 243 XUVs
C:0 T:1 2822 XUs and 3026 XVs -> 91 XUVs
C:0 T:2 2579 XUs and 2456 XVs -> 100 XUVs
C:0 T:3 687 XUs and 1464 XVs -> 43 XUVs
C:0 T:4 380 XUs and 444 XVs -> 21 XUVs
C:0 T:5 141 XUs and 125 XVs -> 6 XUVs
C:0 T:6 1474 XUs and 1527 XVs -> 52 XUVs
C:0 T:7 2031 XUs and 2530 XVs -> 138 XUVs
C:0 T:8 11044 XUs and 25064 XVs -> 2246 XUVs
C:0 T:9 2688 XUs and 1941 XVs -> 174 XUVs
C:0 T:10 3911 XUs and 3895 XVs -> 220 XUVs
C:0 T:11 4134 XUs and 2775 XVs -> 262 XUVs
C:0 T:12 7002 XUs and 8000 XVs -> 738 XUVs
C:0 T:13 2777 XUs and 2258 XVs -> 100 XUVs
C:0 T:14 2917 XUs and 3340 XVs -> 150 XUVs
C:0 T:15 3740 XUs and 3418 XVs -> 244 XUVs
4828 XUVs total
2324 collection wire objects
4828 potential space points
Neighbour search...
213466 tests to find 84612 neighbours
Iterating with no regularization...
Begin: 1.06182e+09
0 1.00151e+09
1 9.96836e+08
2 9.96504e+08
Now with regularization...
Begin: 9.79337e+08
0 9.79249e+08
17-Sep-2025 13:23:28 CEST  Closed output file "np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112328_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        118.01        213.06        329.152       208.236       56.851         18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.3421e-05    0.000133497   0.000340526   9.88115e-05   7.58502e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               6.82348       8.02746       10.6791       7.76278      0.986106        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.000975108   0.00206491    0.00510451    0.00191849    0.00105551       18     
produce:pdvddaphne:DAPHNEReaderPDVD               3.08755       4.37684       5.54711       4.47957      0.754215        18     
produce:ophit:OpHitFinder                        0.0396402     0.0591294     0.0847408     0.0600248     0.0119853       18     
produce:opflash:OpFlashFinderVerticalDrift      0.00616855     0.0178037     0.0420049     0.0176517    0.00890356       18     
produce:wclsdatavd:WireCellToolkit                52.7841       80.3539       110.849       79.3595       17.8685        18     
produce:gaushit:GausHitFinder                     0.85713       1.86101       3.25224       1.98748      0.749156        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000220435   0.00150202     0.0054075    0.000442124   0.00175891       18     
produce:reco3d:SpacePointSolver                   10.983        21.0764       33.7125       20.9241       6.43406        18     
produce:hitpdune:DisambigFromSpacePoints         0.169002      0.380619      0.651174       0.32564      0.158798        18     
produce:pandora:StandardPandora                   29.9625       89.3596       179.345       80.3043       40.2204        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.582722       1.61136       3.87887       1.25583      0.905085        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0196928     0.0479611     0.0876778     0.0454519     0.0232417       18     
[art]:TriggerResults:TriggerResultInserter      1.3801e-05    3.23946e-05   9.1442e-05    2.71755e-05   2.02826e-05      18     
end_path:out1:RootOutput                         3.78e-06     9.31017e-06   2.4321e-05     7.33e-06     5.68689e-06      18     
end_path:out1:RootOutput(write)                   4.24447       5.82202       8.49024       5.12578       1.36021        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5227.22 MB
  Peak resident set size usage (VmHWM): 3243.29 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112328_keepup.root
\tHists: np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112329_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112328_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112328_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758108209.0,
    "core.end_time": 1758108209.0,
    "core.events": [
      8647,
      8667,
      8687,
      8707,
      8727,
      8747,
      8767,
      8787,
      8807,
      8827,
      8847,
      8867,
      8887,
      8907,
      8927,
      8947,
      8967,
      8987
    ],
    "core.event_count": 18,
    "core.first_event_number": 8647,
    "core.last_event_number": 8987,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145_reco_stage1_20250917T112329_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758108209.0,
    "core.end_time": 1758108209.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0024_df-s03-d1_dw_0_20250902T105145.hdf5"
    }
  ]
}