Jobsub ID 40372.144@dunegpschedd02.fnal.gov

Jobsub ID	40372.144@dunegpschedd02.fnal.gov
Workflow ID	2641
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-16 08:50:46
Site	CERN
Entry	CMSHTPC_T2_CH_CERN_ce512
Last heartbeat	2025-09-16 09:41:17
From worker node	Hostname	b9p30p1158.cern.ch
	cpuinfo	AMD EPYC 7302 16-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	343800 (95 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-16 08:51:46
Input files	vd-protodune:np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640.hdf5
Jobscript	Exit code	0
	Real time	48m (2898s)
	CPU time	46m (2797s = 96%)
	Max RSS bytes	2897608704 (2763 MiB)
Outputting started	2025-09-16 09:40:05
Output files	vd-protodune-det-reco:np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup.root
Finished	2025-09-16 09:41:17
Saved logs	justin-logs:40372.144-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

esired window for channel 10527
wclsFrameSaver: no samples within desired window for channel 10564
wclsFrameSaver: no samples within desired window for channel 10566
wclsFrameSaver: no samples within desired window for channel 10712
wclsFrameSaver: no samples within desired window for channel 10715
wclsFrameSaver: no samples within desired window for channel 10715
wclsFrameSaver: no samples within desired window for channel 10715
wclsFrameSaver: no samples within desired window for channel 10725
wclsFrameSaver: no samples within desired window for channel 10727
wclsFrameSaver: no samples within desired window for channel 10727
wclsFrameSaver: no samples within desired window for channel 10736
wclsFrameSaver: no samples within desired window for channel 10903
wclsFrameSaver: no samples within desired window for channel 11230
wclsFrameSaver: no samples within desired window for channel 11235
wclsFrameSaver: no samples within desired window for channel 11237
wclsFrameSaver: no samples within desired window for channel 11238
wclsFrameSaver: no samples within desired window for channel 11239
wclsFrameSaver: no samples within desired window for channel 11239
wclsFrameSaver: no samples within desired window for channel 11239
wclsFrameSaver: no samples within desired window for channel 11240
wclsFrameSaver: no samples within desired window for channel 11240
wclsFrameSaver: no samples within desired window for channel 11453
wclsFrameSaver: no samples within desired window for channel 11453
wclsFrameSaver: no samples within desired window for channel 11454
wclsFrameSaver: no samples within desired window for channel 11481
wclsFrameSaver: no samples within desired window for channel 11483
wclsFrameSaver: no samples within desired window for channel 11484
wclsFrameSaver: no samples within desired window for channel 11485
wclsFrameSaver: no samples within desired window for channel 11485
wclsFrameSaver: no samples within desired window for channel 11486
wclsFrameSaver: no samples within desired window for channel 11486
wclsFrameSaver: no samples within desired window for channel 11951
wclsFrameSaver: no samples within desired window for channel 11956
wclsFrameSaver: no samples within desired window for channel 11971
wclsFrameSaver: no samples within desired window for channel 11971
wclsFrameSaver: no samples within desired window for channel 11972
wclsFrameSaver: no samples within desired window for channel 11972
wclsFrameSaver: no samples within desired window for channel 11974
wclsFrameSaver: no samples within desired window for channel 11975
FrameSaver: q=6.74239e+06 n=853283 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 773 XUs and 839 XVs -> 41 XUVs
C:0 T:1 591 XUs and 632 XVs -> 40 XUVs
C:0 T:2 96 XUs and 98 XVs -> 8 XUVs
C:0 T:3 607 XUs and 546 XVs -> 21 XUVs
C:0 T:4 804 XUs and 1224 XVs -> 47 XUVs
C:0 T:5 1690 XUs and 1912 XVs -> 143 XUVs
C:0 T:6 1154 XUs and 911 XVs -> 30 XUVs
C:0 T:7 1009 XUs and 1198 XVs -> 59 XUVs
C:0 T:8 343 XUs and 419 XVs -> 29 XUVs
C:0 T:9 1164 XUs and 1512 XVs -> 69 XUVs
C:0 T:10 1344 XUs and 1041 XVs -> 73 XUVs
C:0 T:11 1754 XUs and 2100 XVs -> 98 XUVs
C:0 T:12 828 XUs and 813 XVs -> 75 XUVs
C:0 T:13 1151 XUs and 1300 XVs -> 101 XUVs
C:0 T:14 908 XUs and 907 XVs -> 46 XUVs
C:0 T:15 2527 XUs and 2688 XVs -> 169 XUVs
1049 XUVs total
922 collection wire objects
1049 potential space points
Neighbour search...
6351 tests to find 3392 neighbours
Iterating with no regularization...
Begin: 1.98653e+08
0 1.931e+08
1 1.93019e+08
Now with regularization...
Begin: 1.9013e+08
0 1.90125e+08
16-Sep-2025 11:39:55 CEST  Closed output file "np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        101.894       150.382       372.067       137.618       56.2357        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       5.404e-05    8.59026e-05   0.000140972   8.2401e-05    2.70506e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               6.74569       7.34311       7.92316       7.37228      0.300776        19     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00593164     0.0180925     0.0666757    0.00744254     0.0205105       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000215573   0.000333645   0.000590998   0.000322714   7.83725e-05      19     
produce:ophit:OpHitFinder                       0.000125632   0.000257134   0.000750589   0.000224623   0.000126723      19     
produce:opflash:OpFlashFinderVerticalDrift       4.154e-05    7.44657e-05   0.000327044   5.9231e-05    6.08629e-05      19     
produce:wclsdatavd:WireCellToolkit                58.6244       69.221        78.8803       66.9375       5.99567        19     
produce:gaushit:GausHitFinder                    0.680212       1.06053       1.69872      0.978579      0.270001        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000201613   0.000344092   0.000584837   0.000318394   9.44527e-05      19     
produce:reco3d:SpacePointSolver                   6.72601       12.3843       25.0525       12.142        3.67967        19     
produce:hitpdune:DisambigFromSpacePoints         0.100068      0.193357      0.446432      0.185452      0.074582        19     
produce:pandora:StandardPandora                   19.3372       54.6199       257.456       41.7389       50.5143        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.423108      0.864337       2.19044      0.773875      0.385373        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0177886     0.0272913     0.0393704     0.0268995     0.0058541       19     
[art]:TriggerResults:TriggerResultInserter       1.642e-05    2.34929e-05   5.5551e-05    1.9731e-05    9.21959e-06      19     
end_path:out1:RootOutput                         4.52e-06     8.36326e-06    2.308e-05     7.86e-06     3.7449e-06       19     
end_path:out1:RootOutput(write)                   4.30733       4.60874       5.69157       4.48743      0.332885        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4848.58 MB
  Peak resident set size usage (VmHWM): 2897.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup.root
\tHists: np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758015596.0,
    "core.end_time": 1758015596.0,
    "core.events": [
      62020,
      62024,
      62028,
      62032,
      62036,
      62040,
      62044,
      62048,
      62052,
      62056,
      62060,
      62064,
      62068,
      62072,
      62076,
      62080,
      62084,
      62088,
      62092
    ],
    "core.event_count": 19,
    "core.first_event_number": 62020,
    "core.last_event_number": 62092,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640_reco_stage1_20250916T093955_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758015596.0,
    "core.end_time": 1758015596.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0805_df-s05-d0_dw_0_20250916T075640.hdf5"
    }
  ]
}