Jobsub ID 236601.33@dunegpschedd02.fnal.gov

Jobsub ID	236601.33@dunegpschedd02.fnal.gov
Workflow ID	9538
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	2
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-11-03 10:42:44
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_brug_multicore
Last heartbeat	2025-11-03 12:15:36
From worker node	Hostname	wn-lot-013.farm.nikhef.nl
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	2
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-03 10:53:00
Input files	vd-protodune:np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723.hdf5
Jobscript	Exit code	0
	Real time	1h (4829s)
	CPU time	51m (3066s = 63%)
	Max RSS bytes	3779174400 (3604 MiB)
Outputting started	2025-11-03 12:13:30
Output files	vd-protodune-det-reco:np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121320_keepup.root
Finished	2025-11-03 12:15:36
Saved logs	justin-logs:236601.33-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

in desired window for channel 8429
wclsFrameSaver: no samples within desired window for channel 8430
wclsFrameSaver: no samples within desired window for channel 8430
wclsFrameSaver: no samples within desired window for channel 8596
wclsFrameSaver: no samples within desired window for channel 8598
wclsFrameSaver: no samples within desired window for channel 8598
wclsFrameSaver: no samples within desired window for channel 8598
wclsFrameSaver: no samples within desired window for channel 8598
wclsFrameSaver: no samples within desired window for channel 8799
wclsFrameSaver: no samples within desired window for channel 8799
wclsFrameSaver: no samples within desired window for channel 8799
wclsFrameSaver: no samples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9579
wclsFrameSaver: no samples within desired window for channel 9731
wclsFrameSaver: no samples within desired window for channel 9961
wclsFrameSaver: no samples within desired window for channel 9961
wclsFrameSaver: no samples within desired window for channel 9962
wclsFrameSaver: no samples within desired window for channel 9962
wclsFrameSaver: no samples within desired window for channel 9963
wclsFrameSaver: no samples within desired window for channel 9964
wclsFrameSaver: no samples within desired window for channel 9966
wclsFrameSaver: no samples within desired window for channel 10053
wclsFrameSaver: no samples within desired window for channel 10548
wclsFrameSaver: no samples within desired window for channel 10623
wclsFrameSaver: no samples within desired window for channel 10624
wclsFrameSaver: no samples within desired window for channel 10971
wclsFrameSaver: no samples within desired window for channel 10972
wclsFrameSaver: no samples within desired window for channel 10972
wclsFrameSaver: no samples within desired window for channel 10973
wclsFrameSaver: no samples within desired window for channel 10973
wclsFrameSaver: no samples within desired window for channel 10974
wclsFrameSaver: no samples within desired window for channel 10977
wclsFrameSaver: no samples within desired window for channel 10977
wclsFrameSaver: no samples within desired window for channel 11029
wclsFrameSaver: no samples within desired window for channel 11419
wclsFrameSaver: no samples within desired window for channel 12052
wclsFrameSaver: no samples within desired window for channel 12054
FrameSaver: q=1.11147e+07 n=935139 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 591 XUs and 784 XVs -> 26 XUVs
C:0 T:1 614 XUs and 706 XVs -> 27 XUVs
C:0 T:2 2328 XUs and 2504 XVs -> 82 XUVs
C:0 T:3 1135 XUs and 1047 XVs -> 79 XUVs
C:0 T:4 275 XUs and 372 XVs -> 9 XUVs
C:0 T:5 1257 XUs and 1522 XVs -> 93 XUVs
C:0 T:6 724 XUs and 699 XVs -> 20 XUVs
C:0 T:7 572 XUs and 714 XVs -> 42 XUVs
C:0 T:8 1548 XUs and 1081 XVs -> 106 XUVs
C:0 T:9 1474 XUs and 1620 XVs -> 81 XUVs
C:0 T:10 2510 XUs and 2005 XVs -> 122 XUVs
C:0 T:11 524 XUs and 515 XVs -> 26 XUVs
C:0 T:12 732 XUs and 1157 XVs -> 72 XUVs
C:0 T:13 38 XUs and 58 XVs -> 3 XUVs
C:0 T:14 168 XUs and 265 XVs -> 14 XUVs
C:0 T:15 1292 XUs and 1756 XVs -> 51 XUVs
853 XUVs total
695 collection wire objects
853 potential space points
Neighbour search...
5131 tests to find 3026 neighbours
Iterating with no regularization...
Begin: 4.18126e+08
0 4.04934e+08
1 4.0473e+08
Now with regularization...
Begin: 3.9871e+08
0 3.98683e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
03-Nov-2025 13:13:20 CET  Closed output file "np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121320_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        120.399       207.516       527.956       202.263       75.4547        23     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      7.0513e-05    8.92916e-05   0.000200036   8.4849e-05    2.41176e-05      23     
produce:tpcrawdecoder:PDVDTPCReader               43.5058       79.1448       128.067       81.916        18.7362        23     
produce:triggerrawdecoder:PDVDTriggerReader4     0.548399      0.676366       1.01555      0.635469      0.105583        23     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000300023   0.00049986    0.000929976   0.000506782   0.000109741      23     
produce:ophit:OpHitFinder                       5.1035e-05    9.64455e-05   0.000676621   7.0913e-05    0.000123917      23     
produce:opflash:OpFlashFinderVerticalDrift      4.0917e-05    7.23524e-05   0.000403738   5.9121e-05    7.0964e-05       23     
produce:wclsdatavd:WireCellToolkit                45.9416       70.073        112.161       65.3394       15.1641        23     
produce:gaushit:GausHitFinder                    0.749636       1.10551       2.22103       1.0549       0.324196        23     
produce:nhitsfilter:NumberOfHitsFilter          0.00018141    0.000290634   0.000520617   0.000278213   7.33365e-05      23     
produce:reco3d:SpacePointSolver                   6.94075       12.2546       31.5304       11.6134       4.93302        23     
produce:hitpdune:DisambigFromSpacePoints         0.0819554     0.170872      0.496805      0.160401      0.0820479       23     
produce:pandora:StandardPandora                   11.9869       34.5038       269.084       23.1956       50.5398        23     
produce:pandoraTrack:LArPandoraTrackCreation     0.315179      0.830879       2.19521      0.826995      0.379818        23     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0199341     0.0325067     0.0572865     0.0309226    0.00921041       23     
[art]:TriggerResults:TriggerResultInserter      1.3716e-05    2.07275e-05   5.0725e-05    1.6521e-05    8.64993e-06      23     
end_path:out1:RootOutput                         3.246e-06    4.7467e-06    2.2562e-05     3.938e-06    3.82134e-06      23     
end_path:out1:RootOutput(write)                   6.09094       8.6768        11.1823       8.88145       1.42708        23     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5831.54 MB
  Peak resident set size usage (VmHWM): 3779.17 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121320_keepup.root
\tHists: np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121321_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121320_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121320_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762172001.0,
    "core.end_time": 1762172001.0,
    "core.events": [
      304666,
      304670,
      304674,
      304678,
      304682,
      304686,
      304690,
      304694,
      304698,
      304702,
      304706,
      304710,
      304714,
      304718,
      304722,
      304726,
      304730,
      304734,
      304738,
      304742,
      304746,
      304750,
      304754
    ],
    "core.event_count": 23,
    "core.first_event_number": 304666,
    "core.last_event_number": 304754,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723_reco_stage1_20251103T121321_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762172001.0,
    "core.end_time": 1762172001.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_3300_df-s04-d2_dw_0_20251103T101723.hdf5"
    }
  ]
}