Jobsub ID 40383.173@dunegpschedd02.fnal.gov

Jobsub ID	40383.173@dunegpschedd02.fnal.gov
Workflow ID	2650
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-16 11:40:54
Site	CERN
Entry	CMSHTPC_T2_CH_CERN_ce513
Last heartbeat	2025-09-16 12:55:48
From worker node	Hostname	b9p04p1288.cern.ch
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	343800 (95 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-16 11:47:56
Input files	vd-protodune:np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527.hdf5
Jobscript	Exit code	0
	Real time	1h (3990s)
	CPU time	1h (3858s = 96%)
	Max RSS bytes	3431817216 (3272 MiB)
Outputting started	2025-09-16 12:54:27
Output files	vd-protodune-det-reco:np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup.root
Finished	2025-09-16 12:55:48
Saved logs	justin-logs:40383.173-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

hannel 10969
wclsFrameSaver: no samples within desired window for channel 11001
wclsFrameSaver: no samples within desired window for channel 11092
wclsFrameSaver: no samples within desired window for channel 11094
wclsFrameSaver: no samples within desired window for channel 11094
wclsFrameSaver: no samples within desired window for channel 11332
wclsFrameSaver: no samples within desired window for channel 11333
wclsFrameSaver: no samples within desired window for channel 11334
wclsFrameSaver: no samples within desired window for channel 11336
wclsFrameSaver: no samples within desired window for channel 11350
wclsFrameSaver: no samples within desired window for channel 11350
wclsFrameSaver: no samples within desired window for channel 11351
wclsFrameSaver: no samples within desired window for channel 11351
wclsFrameSaver: no samples within desired window for channel 11351
wclsFrameSaver: no samples within desired window for channel 11728
wclsFrameSaver: no samples within desired window for channel 11789
wclsFrameSaver: no samples within desired window for channel 11790
wclsFrameSaver: no samples within desired window for channel 11790
wclsFrameSaver: no samples within desired window for channel 12047
wclsFrameSaver: no samples within desired window for channel 12047
wclsFrameSaver: no samples within desired window for channel 12048
wclsFrameSaver: no samples within desired window for channel 12048
wclsFrameSaver: no samples within desired window for channel 12048
wclsFrameSaver: no samples within desired window for channel 12049
wclsFrameSaver: no samples within desired window for channel 12049
wclsFrameSaver: no samples within desired window for channel 12049
wclsFrameSaver: no samples within desired window for channel 12050
wclsFrameSaver: no samples within desired window for channel 12052
wclsFrameSaver: no samples within desired window for channel 12175
wclsFrameSaver: no samples within desired window for channel 12176
wclsFrameSaver: no samples within desired window for channel 12176
wclsFrameSaver: no samples within desired window for channel 12176
wclsFrameSaver: no samples within desired window for channel 12177
wclsFrameSaver: no samples within desired window for channel 12177
wclsFrameSaver: no samples within desired window for channel 12179
wclsFrameSaver: no samples within desired window for channel 12179
FrameSaver: q=8.86071e+06 n=932394 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 310 XUs and 250 XVs -> 5 XUVs
C:0 T:1 1484 XUs and 2012 XVs -> 99 XUVs
C:0 T:2 59 XUs and 84 XVs -> 5 XUVs
C:0 T:3 236 XUs and 200 XVs -> 7 XUVs
C:0 T:4 652 XUs and 738 XVs -> 31 XUVs
C:0 T:5 329 XUs and 339 XVs -> 26 XUVs
C:0 T:6 1270 XUs and 1227 XVs -> 46 XUVs
C:0 T:7 79 XUs and 100 XVs -> 4 XUVs
C:0 T:8 2421 XUs and 4102 XVs -> 466 XUVs
C:0 T:9 14304 XUs and 23446 XVs -> 2742 XUVs
C:0 T:10 20435 XUs and 68769 XVs -> 8276 XUVs
C:0 T:11 2311 XUs and 5092 XVs -> 176 XUVs
C:0 T:12 9659 XUs and 14718 XVs -> 2747 XUVs
C:0 T:13 3672 XUs and 6557 XVs -> 915 XUVs
C:0 T:14 7159 XUs and 22545 XVs -> 3142 XUVs
C:0 T:15 6629 XUs and 8809 XVs -> 993 XUVs
19680 XUVs total
2225 collection wire objects
19680 potential space points
Neighbour search...
2740536 tests to find 1133648 neighbours
Iterating with no regularization...
Begin: 4.73206e+08
0 3.97716e+08
1 3.92078e+08
2 3.91116e+08
3 3.90744e+08
Now with regularization...
Begin: 3.81627e+08
0 3.81256e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
16-Sep-2025 14:54:15 CEST  Closed output file "np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        141.069       218.815       360.857       202.389       56.8391        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.4241e-05    9.5552e-05    0.000227433   8.44565e-05   3.77035e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               6.25973       6.62233       7.10748       6.55085      0.282345        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.000988944   0.00138801    0.00219272    0.00139754    0.000257274      18     
produce:pdvddaphne:DAPHNEReaderPDVD               3.48548       4.51522       5.33676       4.57897      0.518147        18     
produce:ophit:OpHitFinder                        0.0462964     0.0630716     0.0734218     0.0663788    0.00823312       18     
produce:opflash:OpFlashFinderVerticalDrift      0.00706841     0.0155162     0.0282683     0.0154668    0.00528438       18     
produce:wclsdatavd:WireCellToolkit                70.1308       83.6123       98.709        83.4687       8.0486         18     
produce:gaushit:GausHitFinder                    0.956105       1.71278       2.5819        1.71712      0.422982        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000263444   0.000407266   0.000698501   0.000388385   9.69688e-05      18     
produce:reco3d:SpacePointSolver                   11.9285       20.2391       33.1973       19.0081       5.98141        18     
produce:hitpdune:DisambigFromSpacePoints         0.159502      0.319809      0.653491      0.294101      0.131325        18     
produce:pandora:StandardPandora                   29.9469       94.1518       218.054       82.4588       45.0322        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.589741       1.53757       3.18813       1.5585       0.619683        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0186204     0.044612      0.0708362      0.04587      0.0165701       18     
[art]:TriggerResults:TriggerResultInserter       2.041e-05    4.34401e-05   0.000105331   3.86055e-05   1.95765e-05      18     
end_path:out1:RootOutput                         3.75e-06     9.91122e-06    4.145e-05    8.9455e-06    8.04041e-06      18     
end_path:out1:RootOutput(write)                   4.54846       5.92937       7.65497       5.99705      0.973345        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5372.81 MB
  Peak resident set size usage (VmHWM): 3431.82 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup.root
\tHists: np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758027256.0,
    "core.end_time": 1758027256.0,
    "core.events": [
      117011,
      117031,
      117051,
      117071,
      117091,
      117111,
      117131,
      117151,
      117171,
      117191,
      117211,
      117231,
      117251,
      117271,
      117291,
      117311,
      117331,
      117351
    ],
    "core.event_count": 18,
    "core.first_event_number": 117011,
    "core.last_event_number": 117351,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39275
    ],
    "core.runs_subruns": [
      3927500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527_reco_stage1_20250916T125415_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758027256.0,
    "core.end_time": 1758027256.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39275
    ],
    "core.runs_subruns": [
      3927500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039275_0325_df-s04-d1_dw_0_20250902T020527.hdf5"
    }
  ]
}