Jobsub ID 40551.48@dunegpschedd02.fnal.gov

Jobsub ID	40551.48@dunegpschedd02.fnal.gov
Workflow ID	2657
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-09-16 17:44:13
Site	UK_Lancaster
Entry	UBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat	2025-09-16 19:28:11
From worker node	Hostname	comp05-26
	cpuinfo	Intel(R) Xeon(R) Platinum 8352Y CPU @ 2.20GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-09-16 17:46:18
Input files	vd-protodune:np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858.hdf5
Jobscript	Exit code	0
	Real time	1h (5815s)
	CPU time	52m (3132s = 53%)
	Max RSS bytes	2741055488 (2614 MiB)
Outputting started	2025-09-16 19:23:14
Output files	vd-protodune-det-reco:np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup.root
Finished	2025-09-16 19:28:11
Saved logs	justin-logs:40551.48-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

10190
wclsFrameSaver: no samples within desired window for channel 10229
wclsFrameSaver: no samples within desired window for channel 10243
wclsFrameSaver: no samples within desired window for channel 10244
wclsFrameSaver: no samples within desired window for channel 10246
wclsFrameSaver: no samples within desired window for channel 10247
wclsFrameSaver: no samples within desired window for channel 10301
wclsFrameSaver: no samples within desired window for channel 10303
wclsFrameSaver: no samples within desired window for channel 10440
wclsFrameSaver: no samples within desired window for channel 10468
wclsFrameSaver: no samples within desired window for channel 10617
wclsFrameSaver: no samples within desired window for channel 10716
wclsFrameSaver: no samples within desired window for channel 10958
wclsFrameSaver: no samples within desired window for channel 11033
wclsFrameSaver: no samples within desired window for channel 11197
wclsFrameSaver: no samples within desired window for channel 11198
wclsFrameSaver: no samples within desired window for channel 11199
wclsFrameSaver: no samples within desired window for channel 11199
wclsFrameSaver: no samples within desired window for channel 11200
wclsFrameSaver: no samples within desired window for channel 11200
wclsFrameSaver: no samples within desired window for channel 11200
wclsFrameSaver: no samples within desired window for channel 11201
wclsFrameSaver: no samples within desired window for channel 11201
wclsFrameSaver: no samples within desired window for channel 11202
wclsFrameSaver: no samples within desired window for channel 11202
wclsFrameSaver: no samples within desired window for channel 11291
wclsFrameSaver: no samples within desired window for channel 11292
wclsFrameSaver: no samples within desired window for channel 11292
wclsFrameSaver: no samples within desired window for channel 11293
wclsFrameSaver: no samples within desired window for channel 11294
wclsFrameSaver: no samples within desired window for channel 11294
wclsFrameSaver: no samples within desired window for channel 11321
wclsFrameSaver: no samples within desired window for channel 11321
wclsFrameSaver: no samples within desired window for channel 11321
wclsFrameSaver: no samples within desired window for channel 11407
wclsFrameSaver: no samples within desired window for channel 11408
wclsFrameSaver: no samples within desired window for channel 11408
wclsFrameSaver: no samples within desired window for channel 11409
wclsFrameSaver: no samples within desired window for channel 11543
FrameSaver: q=1.03188e+07 n=1133800 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 369 XUs and 474 XVs -> 18 XUVs
C:0 T:1 13181 XUs and 14428 XVs -> 1048 XUVs
C:0 T:2 782 XUs and 814 XVs -> 46 XUVs
C:0 T:3 137 XUs and 207 XVs -> 16 XUVs
C:0 T:4 682 XUs and 762 XVs -> 41 XUVs
C:0 T:5 395 XUs and 370 XVs -> 17 XUVs
C:0 T:6 676 XUs and 1199 XVs -> 41 XUVs
C:0 T:7 507 XUs and 547 XVs -> 20 XUVs
C:0 T:8 779 XUs and 1283 XVs -> 74 XUVs
C:0 T:9 2409 XUs and 2509 XVs -> 68 XUVs
C:0 T:10 2794 XUs and 4742 XVs -> 186 XUVs
C:0 T:11 2077 XUs and 3290 XVs -> 133 XUVs
C:0 T:12 3724 XUs and 4144 XVs -> 222 XUVs
C:0 T:13 1174 XUs and 1209 XVs -> 63 XUVs
C:0 T:14 1693 XUs and 1310 XVs -> 59 XUVs
C:0 T:15 830 XUs and 730 XVs -> 53 XUVs
2105 XUVs total
1513 collection wire objects
2105 potential space points
Neighbour search...
38479 tests to find 9094 neighbours
Iterating with no regularization...
Begin: 3.17571e+09
0 3.04991e+09
1 3.03544e+09
2 3.03542e+09
Now with regularization...
Begin: 2.96311e+09
0 2.96305e+09
16-Sep-2025 20:23:06 BST  Closed output file "np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        247.706       303.006       389.64        305.215       36.6221        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.4804e-05    7.84642e-05   0.00018889    6.8793e-05    2.84814e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               112.845       144.498       199.749       143.705       22.8632        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.416644      0.548705      0.798589      0.514626      0.116582        19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000369741   0.000418669   0.000672404   0.000398579   6.68754e-05      19     
produce:ophit:OpHitFinder                       0.000129864   0.000269908   0.00133102    0.00018464    0.000278741      19     
produce:opflash:OpFlashFinderVerticalDrift      4.4214e-05    6.55187e-05   0.000263483   5.1993e-05    4.78643e-05      19     
produce:wclsdatavd:WireCellToolkit                68.9405       77.8726       89.9395       79.4356       5.13666        19     
produce:gaushit:GausHitFinder                     1.32861       1.69232       2.30572       1.68859      0.244331        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000336083   0.000466891   0.000643795   0.000456883   8.63244e-05      19     
produce:reco3d:SpacePointSolver                   12.4294       18.2463       25.2334       18.2752       3.52034        19     
produce:hitpdune:DisambigFromSpacePoints         0.156657      0.230011      0.351128      0.226654      0.0446599       19     
produce:pandora:StandardPandora                   24.0897       53.1342       98.6484       52.6425       18.1801        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.664387       1.62592       3.31663       1.26803      0.780832        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0206077     0.0325247     0.0426504     0.0320116    0.00598504       19     
[art]:TriggerResults:TriggerResultInserter      2.3367e-05    3.54611e-05   6.7093e-05    3.5195e-05    1.05071e-05      19     
end_path:out1:RootOutput                         8.978e-06    1.29173e-05   2.4005e-05    1.1614e-05    4.36414e-06      19     
end_path:out1:RootOutput(write)                   4.82377       5.08422       5.48457       5.07815      0.183883        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4644.37 MB
  Peak resident set size usage (VmHWM): 2741.06 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup.root
\tHists: np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758050587.0,
    "core.end_time": 1758050587.0,
    "core.events": [
      15754,
      15758,
      15762,
      15766,
      15770,
      15774,
      15778,
      15782,
      15786,
      15790,
      15794,
      15798,
      15802,
      15806,
      15810,
      15814,
      15818,
      15822,
      15826
    ],
    "core.event_count": 19,
    "core.first_event_number": 15754,
    "core.last_event_number": 15826,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858_reco_stage1_20250916T192306_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758050587.0,
    "core.end_time": 1758050587.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0204_df-s05-d2_dw_0_20250916T172858.hdf5"
    }
  ]
}