Jobsub ID 242471.183@dunegpschedd01.fnal.gov

Jobsub ID	242471.183@dunegpschedd01.fnal.gov
Workflow ID	9538
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	2
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-11-03 17:53:07
Site	UK_RAL-PPD
Entry	CMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat	2025-11-03 19:06:45
From worker node	Hostname	heplnc170.pp.rl.ac.uk
	cpuinfo	AMD EPYC 7763 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	2
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-03 17:54:02
Input files	vd-protodune:np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350.hdf5
Jobscript	Exit code	0
	Real time	1h (4215s)
	CPU time	1h (3897s = 92%)
	Max RSS bytes	4896608256 (4669 MiB)
Outputting started	2025-11-03 19:04:17
Output files	vd-protodune-det-reco:np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190405_keepup.root
Finished	2025-11-03 19:06:45
Saved logs	justin-logs:242471.183-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

:13.411] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 6.9 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 6.89 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 5.96 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 5.95 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::OmnibusSigProc : 5.92 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.3 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.23 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.2 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Aux::Resampler : 0.19 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Gen::FrameFanin : 0.01 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0.01 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Gen::DumpFrames : 0 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::SigProc::ChannelSelector : 0 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Gen::Retagger : 0 sec
[19:03:13.411] I [ timer  ] Timer: WireCell::Gen::FrameFanout : 0 sec
[19:03:13.411] I [ timer  ] Timer: wcls::RawFrameSource : 0 sec
[19:03:13.411] I [ timer  ] Timer: wcls::FrameSaver : 0 sec
[19:03:13.411] I [ timer  ] Timer: Total node execution : 58.120000110939145 sec
wclsFrameSaver saving cooked to 10000 ticks
wclsFrameSaver: saving 51516 traces tagged "gauss"
FrameSaver: q=1.29822e+07 n=1159304 tag=gauss
wclsFrameSaver: saving 63137 traces tagged "wiener"
FrameSaver: q=1.38678e+07 n=1118838 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 588 XUs and 720 XVs -> 18 XUVs
C:0 T:1 598 XUs and 461 XVs -> 25 XUVs
C:0 T:2 2757 XUs and 2275 XVs -> 80 XUVs
C:0 T:3 1120 XUs and 991 XVs -> 30 XUVs
C:0 T:4 3933 XUs and 4454 XVs -> 336 XUVs
C:0 T:5 823 XUs and 1066 XVs -> 48 XUVs
C:0 T:6 7203 XUs and 6118 XVs -> 563 XUVs
C:0 T:7 617 XUs and 458 XVs -> 35 XUVs
C:0 T:8 2257 XUs and 2315 XVs -> 115 XUVs
C:0 T:9 660 XUs and 810 XVs -> 53 XUVs
C:0 T:10 661 XUs and 1353 XVs -> 37 XUVs
C:0 T:11 335 XUs and 335 XVs -> 27 XUVs
C:0 T:12 3756 XUs and 3174 XVs -> 366 XUVs
C:0 T:13 2007 XUs and 2315 XVs -> 130 XUVs
C:0 T:14 1130 XUs and 1468 XVs -> 98 XUVs
C:0 T:15 903 XUs and 788 XVs -> 33 XUVs
1994 XUVs total
1384 collection wire objects
1994 potential space points
Neighbour search...
55700 tests to find 17460 neighbours
Iterating with no regularization...
Begin: 2.80536e+09
0 2.65139e+09
1 2.64624e+09
2 2.64618e+09
Now with regularization...
Begin: 2.59828e+09
0 2.59822e+09
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
03-Nov-2025 19:04:05 GMT  Closed output file "np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190405_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        73.985         173.2        743.64        118.913       153.334        24     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      8.0741e-05    0.000108231   0.00018717    9.49625e-05   2.75272e-05      24     
produce:tpcrawdecoder:PDVDTPCReader               11.236        12.1727       14.297        11.7436      0.944044        24     
produce:triggerrawdecoder:PDVDTriggerReader4     0.524961      0.535687      0.556517      0.533718     0.00830289       24     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000378888   0.000498889   0.00111135    0.000449494   0.000161602      24     
produce:ophit:OpHitFinder                       7.3798e-05    0.000155457   0.000929056   0.000126567   0.000163093      24     
produce:opflash:OpFlashFinderVerticalDrift      5.4321e-05    0.000103747   0.000584241   8.21285e-05   0.000101894      24     
produce:wclsdatavd:WireCellToolkit                41.7153       65.3124       109.745       62.1717       18.0521        24     
produce:gaushit:GausHitFinder                    0.606356       1.14447       2.66849       1.02172      0.422592        24     
produce:nhitsfilter:NumberOfHitsFilter          0.000177732   0.000289914   0.00057791    0.000265746   9.79372e-05      24     
produce:reco3d:SpacePointSolver                   5.31807       11.4274       26.3684       10.5429       4.12867        24     
produce:hitpdune:DisambigFromSpacePoints         0.0663262     0.187097      0.498858      0.155157      0.0973279       24     
produce:pandora:StandardPandora                   10.2109       77.097        583.845       26.0341       137.646        24     
produce:pandoraTrack:LArPandoraTrackCreation     0.369359      0.857348       1.66223      0.789588      0.321347        24     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0150972     0.0279866     0.0465883     0.0239156    0.00883646       24     
[art]:TriggerResults:TriggerResultInserter      1.4958e-05    2.58064e-05   7.9769e-05    2.2928e-05    1.22528e-05      24     
end_path:out1:RootOutput                         4.739e-06    8.06671e-06   2.4857e-05    7.2335e-06    3.8089e-06       24     
end_path:out1:RootOutput(write)                   3.35106       4.38681       6.4992        3.97736       1.00574        24     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7023.6 MB
  Peak resident set size usage (VmHWM): 4896.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190405_keepup.root
\tHists: np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190406_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190405_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190405_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762196646.0,
    "core.end_time": 1762196646.0,
    "core.events": [
      563,
      567,
      571,
      575,
      579,
      583,
      587,
      591,
      595,
      599,
      603,
      607,
      611,
      615,
      619,
      623,
      627,
      631,
      635,
      639,
      643,
      647,
      651,
      655
    ],
    "core.event_count": 24,
    "core.first_event_number": 563,
    "core.last_event_number": 655,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40347
    ],
    "core.runs_subruns": [
      4034700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350_reco_stage1_20251103T190406_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762196646.0,
    "core.end_time": 1762196646.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40347
    ],
    "core.runs_subruns": [
      4034700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040347_0006_df-s04-d3_dw_0_20251103T173350.hdf5"
    }
  ]
}