Jobsub ID 40876.137@dunegpschedd02.fnal.gov

Jobsub ID	40876.137@dunegpschedd02.fnal.gov
Workflow ID	2745
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-17 08:57:06
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_klomp_multicore
Last heartbeat	2025-09-17 10:49:27
From worker node	Hostname	wn-lot-011.farm.nikhef.nl
	cpuinfo	AMD EPYC 7702P 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-17 09:47:26
Input files	vd-protodune:np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907.hdf5
Jobscript	Exit code	0
	Real time	1h (3655s)
	CPU time	57m (3428s = 93%)
	Max RSS bytes	3346817024 (3191 MiB)
Outputting started	2025-09-17 10:48:23
Output files	vd-protodune-det-reco:np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup.root
Finished	2025-09-17 10:49:27
Saved logs	justin-logs:40876.137-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

s within desired window for channel 11214
wclsFrameSaver: no samples within desired window for channel 11214
wclsFrameSaver: no samples within desired window for channel 11214
wclsFrameSaver: no samples within desired window for channel 11408
wclsFrameSaver: no samples within desired window for channel 11435
wclsFrameSaver: no samples within desired window for channel 11436
wclsFrameSaver: no samples within desired window for channel 11437
wclsFrameSaver: no samples within desired window for channel 11438
wclsFrameSaver: no samples within desired window for channel 11439
wclsFrameSaver: no samples within desired window for channel 11439
wclsFrameSaver: no samples within desired window for channel 11440
wclsFrameSaver: no samples within desired window for channel 11440
wclsFrameSaver: no samples within desired window for channel 11704
wclsFrameSaver: no samples within desired window for channel 11964
wclsFrameSaver: no samples within desired window for channel 11965
wclsFrameSaver: no samples within desired window for channel 11966
wclsFrameSaver: no samples within desired window for channel 11967
wclsFrameSaver: no samples within desired window for channel 11968
wclsFrameSaver: no samples within desired window for channel 11968
wclsFrameSaver: no samples within desired window for channel 11969
wclsFrameSaver: no samples within desired window for channel 11969
wclsFrameSaver: no samples within desired window for channel 11969
wclsFrameSaver: no samples within desired window for channel 11970
wclsFrameSaver: no samples within desired window for channel 11971
wclsFrameSaver: no samples within desired window for channel 11972
wclsFrameSaver: no samples within desired window for channel 11972
wclsFrameSaver: no samples within desired window for channel 11973
wclsFrameSaver: no samples within desired window for channel 11974
wclsFrameSaver: no samples within desired window for channel 11974
wclsFrameSaver: no samples within desired window for channel 11974
wclsFrameSaver: no samples within desired window for channel 11975
wclsFrameSaver: no samples within desired window for channel 11975
wclsFrameSaver: no samples within desired window for channel 11976
wclsFrameSaver: no samples within desired window for channel 11976
wclsFrameSaver: no samples within desired window for channel 11977
wclsFrameSaver: no samples within desired window for channel 11977
wclsFrameSaver: no samples within desired window for channel 11978
wclsFrameSaver: no samples within desired window for channel 11978
wclsFrameSaver: no samples within desired window for channel 12255
FrameSaver: q=8.52511e+06 n=970517 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 548 XUs and 597 XVs -> 21 XUVs
C:0 T:1 41 XUs and 52 XVs -> 5 XUVs
C:0 T:2 237 XUs and 220 XVs -> 12 XUVs
C:0 T:3 183 XUs and 252 XVs -> 5 XUVs
C:0 T:4 634 XUs and 563 XVs -> 21 XUVs
C:0 T:5 1104 XUs and 1016 XVs -> 63 XUVs
C:0 T:6 994 XUs and 610 XVs -> 31 XUVs
C:0 T:7 517 XUs and 571 XVs -> 40 XUVs
C:0 T:8 640 XUs and 780 XVs -> 58 XUVs
C:0 T:9 726 XUs and 1040 XVs -> 78 XUVs
C:0 T:10 1381 XUs and 1642 XVs -> 120 XUVs
C:0 T:11 3035 XUs and 3721 XVs -> 106 XUVs
C:0 T:12 3743 XUs and 4951 XVs -> 229 XUVs
C:0 T:13 2271 XUs and 3864 XVs -> 425 XUVs
C:0 T:14 4954 XUs and 9367 XVs -> 765 XUVs
C:0 T:15 10972 XUs and 13262 XVs -> 1017 XUVs
2996 XUVs total
1474 collection wire objects
2996 potential space points
Neighbour search...
107746 tests to find 54086 neighbours
Iterating with no regularization...
Begin: 8.8325e+08
0 8.56918e+08
1 8.55012e+08
2 8.54757e+08
Now with regularization...
Begin: 8.45462e+08
0 8.45369e+08
17-Sep-2025 12:48:14 CEST  Closed output file "np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        141.542       200.484       289.617       196.053       40.3874        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      4.8621e-05    7.17789e-05   0.000179998   6.8999e-05    2.70465e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               17.0402       18.3756       21.4494       17.7416       1.31813        18     
produce:triggerrawdecoder:PDVDTriggerReader4     0.0343272     0.0354759     0.0486907     0.0346478     0.0032199       18     
produce:pdvddaphne:DAPHNEReaderPDVD               4.54559       5.62796       6.53117       5.52287      0.676148        18     
produce:ophit:OpHitFinder                        0.0379266     0.0570042     0.0884407     0.0523833     0.0133929       18     
produce:opflash:OpFlashFinderVerticalDrift       0.0101339     0.0158647     0.026003      0.0138506     0.0050685       18     
produce:wclsdatavd:WireCellToolkit                60.9251       72.0095       89.7827       70.4605       7.18396        18     
produce:gaushit:GausHitFinder                    0.933054       1.31402       1.81394       1.30408      0.216332        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000305473   0.000680391   0.00107805    0.000694297   0.00028558       18     
produce:reco3d:SpacePointSolver                   12.0194       19.5576       31.6069       19.7146       4.64696        18     
produce:hitpdune:DisambigFromSpacePoints         0.186574      0.292466      0.521079       0.29201      0.0799207       18     
produce:pandora:StandardPandora                   30.3866       76.8076       133.909       76.4752       31.0532        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.766706       1.33126       2.42713       1.26274      0.441201        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0282624     0.0356143     0.0466115     0.0362541    0.00557732       18     
[art]:TriggerResults:TriggerResultInserter      1.4237e-05    1.98639e-05   5.4132e-05    1.8495e-05    8.58166e-06      18     
end_path:out1:RootOutput                         3.016e-06    5.06117e-06   2.1561e-05    4.1275e-06    4.03048e-06      18     
end_path:out1:RootOutput(write)                   4.47624       4.96862       5.58652       4.91472      0.261179        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5235.2 MB
  Peak resident set size usage (VmHWM): 3346.82 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup.root
\tHists: np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758106095.0,
    "core.end_time": 1758106095.0,
    "core.events": [
      2531,
      2551,
      2571,
      2591,
      2611,
      2631,
      2651,
      2671,
      2691,
      2711,
      2731,
      2751,
      2771,
      2791,
      2811,
      2831,
      2851,
      2871
    ],
    "core.event_count": 18,
    "core.first_event_number": 2531,
    "core.last_event_number": 2871,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39277
    ],
    "core.runs_subruns": [
      3927700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907_reco_stage1_20250917T104814_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758106095.0,
    "core.end_time": 1758106095.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39277
    ],
    "core.runs_subruns": [
      3927700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039277_0007_df-s04-d1_dw_0_20250902T141907.hdf5"
    }
  ]
}