Jobsub ID 47422.149@dunegpschedd01.fnal.gov

Jobsub ID	47422.149@dunegpschedd01.fnal.gov
Workflow ID	2744
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-17 09:05:01
Site	NL_NIKHEF
Entry	VIRGO_NL_NIKHEF_klomp_multicore
Last heartbeat	2025-09-17 12:35:19
From worker node	Hostname	wn-snel-012.farm.nikhef.nl
	cpuinfo	AMD EPYC 7H12 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-17 10:22:47
Input files	vd-protodune:np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555.hdf5
Jobscript	Exit code	0
	Real time	2h (7879s)
	CPU time	1h (3876s = 49%)
	Max RSS bytes	3371913216 (3215 MiB)
Outputting started	2025-09-17 12:34:07
Output files	vd-protodune-det-reco:np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup.root
Finished	2025-09-17 12:35:19
Saved logs	justin-logs:47422.149-dunegpschedd01.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

9
wclsFrameSaver: no samples within desired window for channel 10219
wclsFrameSaver: no samples within desired window for channel 10220
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10435
wclsFrameSaver: no samples within desired window for channel 10635
wclsFrameSaver: no samples within desired window for channel 10636
wclsFrameSaver: no samples within desired window for channel 10637
wclsFrameSaver: no samples within desired window for channel 10638
wclsFrameSaver: no samples within desired window for channel 10673
wclsFrameSaver: no samples within desired window for channel 10988
wclsFrameSaver: no samples within desired window for channel 10990
wclsFrameSaver: no samples within desired window for channel 10991
wclsFrameSaver: no samples within desired window for channel 10992
wclsFrameSaver: no samples within desired window for channel 10992
wclsFrameSaver: no samples within desired window for channel 10993
wclsFrameSaver: no samples within desired window for channel 10993
wclsFrameSaver: no samples within desired window for channel 11010
wclsFrameSaver: no samples within desired window for channel 11339
wclsFrameSaver: no samples within desired window for channel 11339
wclsFrameSaver: no samples within desired window for channel 11340
wclsFrameSaver: no samples within desired window for channel 11341
wclsFrameSaver: no samples within desired window for channel 11341
wclsFrameSaver: no samples within desired window for channel 11413
wclsFrameSaver: no samples within desired window for channel 11414
wclsFrameSaver: no samples within desired window for channel 11416
wclsFrameSaver: no samples within desired window for channel 11416
wclsFrameSaver: no samples within desired window for channel 11416
wclsFrameSaver: no samples within desired window for channel 11477
wclsFrameSaver: no samples within desired window for channel 12047
wclsFrameSaver: no samples within desired window for channel 12047
wclsFrameSaver: no samples within desired window for channel 12048
wclsFrameSaver: no samples within desired window for channel 12048
wclsFrameSaver: no samples within desired window for channel 12049
wclsFrameSaver: no samples within desired window for channel 12049
wclsFrameSaver: no samples within desired window for channel 12049
wclsFrameSaver: no samples within desired window for channel 12050
FrameSaver: q=9.0969e+06 n=1073173 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1106 XUs and 1156 XVs -> 40 XUVs
C:0 T:1 554 XUs and 573 XVs -> 17 XUVs
C:0 T:2 1901 XUs and 2091 XVs -> 101 XUVs
C:0 T:3 680 XUs and 878 XVs -> 151 XUVs
C:0 T:4 324 XUs and 416 XVs -> 7 XUVs
C:0 T:5 706 XUs and 778 XVs -> 29 XUVs
C:0 T:6 1156 XUs and 1287 XVs -> 176 XUVs
C:0 T:7 959 XUs and 1399 XVs -> 206 XUVs
C:0 T:8 1089 XUs and 923 XVs -> 79 XUVs
C:0 T:9 1380 XUs and 1574 XVs -> 149 XUVs
C:0 T:10 1037 XUs and 2570 XVs -> 90 XUVs
C:0 T:11 15837 XUs and 33346 XVs -> 6355 XUVs
C:0 T:12 6544 XUs and 13971 XVs -> 1453 XUVs
C:0 T:13 5212 XUs and 6399 XVs -> 527 XUVs
C:0 T:14 4757 XUs and 6497 XVs -> 424 XUVs
C:0 T:15 516 XUs and 889 XVs -> 39 XUVs
9843 XUVs total
1428 collection wire objects
9843 potential space points
Neighbour search...
1591429 tests to find 638480 neighbours
Iterating with no regularization...
Begin: 5.00834e+08
0 4.66159e+08
1 4.64515e+08
2 4.64173e+08
Now with regularization...
Begin: 4.5643e+08
0 4.56282e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 14:33:58 CEST  Closed output file "np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        296.047       434.992       627.054       434.534       99.5816        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.4992e-05    7.98409e-05   0.000173956   7.39385e-05   2.35064e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               136.48        210.55        319.789       191.882       61.123         18     
produce:triggerrawdecoder:PDVDTriggerReader4     0.034606      0.046012       0.0773       0.0444318    0.00882537       18     
produce:pdvddaphne:DAPHNEReaderPDVD               17.4369       25.3557       35.0027       23.2765       5.30044        18     
produce:ophit:OpHitFinder                        0.0665305     0.0854928     0.0983995     0.0840762    0.00955996       18     
produce:opflash:OpFlashFinderVerticalDrift       0.0100113     0.0220081     0.036911      0.0214401    0.00566636       18     
produce:wclsdatavd:WireCellToolkit                59.0834       68.0975       76.2106       68.0504       4.44285        18     
produce:gaushit:GausHitFinder                     1.03324       1.53662       2.07861       1.43075      0.287678        18     
produce:nhitsfilter:NumberOfHitsFilter          0.00029335    0.00090702    0.00136203    0.000940901   0.000298346      18     
produce:reco3d:SpacePointSolver                   11.5656       22.0054       38.3848       20.4906       6.70604        18     
produce:hitpdune:DisambigFromSpacePoints         0.211133      0.345413      0.511113      0.315127      0.0950306       18     
produce:pandora:StandardPandora                   33.2222       100.637       242.942       92.6386       54.5521        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.613702       1.50047       2.82639       1.24284      0.666031        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0235071     0.0359745     0.0488425     0.0353723    0.00795314       18     
[art]:TriggerResults:TriggerResultInserter      1.3416e-05    1.77638e-05   3.8693e-05    1.65055e-05   5.36929e-06      18     
end_path:out1:RootOutput                         3.025e-06    4.70167e-06   1.5349e-05     4.283e-06    2.63497e-06      18     
end_path:out1:RootOutput(write)                   4.43403       4.72118       5.00441       4.64666      0.188386        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5253.29 MB
  Peak resident set size usage (VmHWM): 3371.91 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup.root
\tHists: np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758112438.0,
    "core.end_time": 1758112438.0,
    "core.events": [
      2893,
      2913,
      2933,
      2953,
      2973,
      2993,
      3013,
      3033,
      3053,
      3073,
      3093,
      3113,
      3133,
      3153,
      3173,
      3193,
      3213,
      3233
    ],
    "core.event_count": 18,
    "core.first_event_number": 2893,
    "core.last_event_number": 3233,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555_reco_stage1_20250917T123358_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758112438.0,
    "core.end_time": 1758112438.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0008_df-s04-d3_dw_0_20250902T093555.hdf5"
    }
  ]
}