Jobsub ID 237405.0@dunegpschedd02.fnal.gov

Jobsub ID	237405.0@dunegpschedd02.fnal.gov
Workflow ID	9583
Stage ID	1
User name	ykermaid@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	4193255424 (3999 MiB)
	Wall seconds limit	18000 (5 hours)
Submitted time	2025-11-04 17:48:21
Site	UK_RAL-Tier1
Entry	LIGO_UK_RAL_arc_ce02
Last heartbeat	2025-11-04 19:38:58
From worker node	Hostname	dune002-164241.0-lcg2708.gridpp.rl.ac.uk
	cpuinfo	AMD EPYC 9654 96-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	216000 (60 hours)
	GPU
	Inner Apptainer?	True
Job state	finished
Started	2025-11-04 17:48:51
Input files	vd-protodune:np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019.hdf5
Jobscript	Exit code	0
	Real time	1h (6505s)
	CPU time	1h (6013s = 92%)
	Max RSS bytes	4810612736 (4587 MiB)
Outputting started	2025-11-04 19:37:17
Output files	vd-protodune-det-reco:np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup.root
Finished	2025-11-04 19:38:55
Saved logs	justin-logs:237405.0-dunegpschedd02.fnal.gov.logs.tgz
List job events Cached HTCondor job logs

Jobscript log (last 10,000 characters)

indow for channel 11709
wclsFrameSaver: no samples within desired window for channel 11709
wclsFrameSaver: no samples within desired window for channel 11710
wclsFrameSaver: no samples within desired window for channel 11710
wclsFrameSaver: no samples within desired window for channel 11711
wclsFrameSaver: no samples within desired window for channel 11711
wclsFrameSaver: no samples within desired window for channel 11711
wclsFrameSaver: no samples within desired window for channel 11712
wclsFrameSaver: no samples within desired window for channel 11712
wclsFrameSaver: no samples within desired window for channel 11713
wclsFrameSaver: no samples within desired window for channel 11713
wclsFrameSaver: no samples within desired window for channel 11713
wclsFrameSaver: no samples within desired window for channel 11714
wclsFrameSaver: no samples within desired window for channel 11714
wclsFrameSaver: no samples within desired window for channel 11715
wclsFrameSaver: no samples within desired window for channel 11715
wclsFrameSaver: no samples within desired window for channel 11715
wclsFrameSaver: no samples within desired window for channel 11716
wclsFrameSaver: no samples within desired window for channel 11717
wclsFrameSaver: no samples within desired window for channel 11718
wclsFrameSaver: no samples within desired window for channel 11719
wclsFrameSaver: no samples within desired window for channel 11719
wclsFrameSaver: no samples within desired window for channel 11721
wclsFrameSaver: no samples within desired window for channel 11722
wclsFrameSaver: no samples within desired window for channel 11722
wclsFrameSaver: no samples within desired window for channel 11724
wclsFrameSaver: no samples within desired window for channel 11725
wclsFrameSaver: no samples within desired window for channel 11726
wclsFrameSaver: no samples within desired window for channel 12051
wclsFrameSaver: no samples within desired window for channel 12084
wclsFrameSaver: no samples within desired window for channel 12095
wclsFrameSaver: no samples within desired window for channel 12116
wclsFrameSaver: no samples within desired window for channel 12117
wclsFrameSaver: no samples within desired window for channel 12117
wclsFrameSaver: no samples within desired window for channel 12118
wclsFrameSaver: no samples within desired window for channel 12118
wclsFrameSaver: no samples within desired window for channel 12119
wclsFrameSaver: no samples within desired window for channel 12119
FrameSaver: q=1.04731e+08 n=2531374 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 35002 XUs and 45963 XVs -> 1863 XUVs
C:0 T:1 2259 XUs and 2733 XVs -> 417 XUVs
C:0 T:2 95556 XUs and 113184 XVs -> 7297 XUVs
C:0 T:3 2801 XUs and 2937 XVs -> 68 XUVs
C:0 T:4 1754 XUs and 2125 XVs -> 140 XUVs
C:0 T:5 1143 XUs and 1004 XVs -> 36 XUVs
C:0 T:6 1023 XUs and 1272 XVs -> 34 XUVs
C:0 T:7 370 XUs and 366 XVs -> 6 XUVs
C:0 T:8 3476 XUs and 3437 XVs -> 191 XUVs
C:0 T:9 3329 XUs and 4606 XVs -> 186 XUVs
C:0 T:10 2061 XUs and 1781 XVs -> 128 XUVs
C:0 T:11 4455 XUs and 4430 XVs -> 220 XUVs
C:0 T:12 1101 XUs and 1525 XVs -> 76 XUVs
C:0 T:13 220 XUs and 460 XVs -> 23 XUVs
C:0 T:14 2430 XUs and 2444 XVs -> 120 XUVs
C:0 T:15 2691 XUs and 3627 XVs -> 258 XUVs
11063 XUVs total
5429 collection wire objects
11063 potential space points
Neighbour search...
405021 tests to find 135594 neighbours
Iterating with no regularization...
Begin: 1.17363e+14
0 1.17354e+14
Now with regularization...
Begin: 1.1735e+14
0 1.17349e+14
04-Nov-2025 19:37:04 UTC  Closed output file "np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        92.2383       279.991       3364.84       128.109       659.036        23     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      8.0481e-05    0.000144076   0.000274883   0.000118919   5.42177e-05      23     
produce:tpcrawdecoder:PDVDTPCReader               15.6421       18.3747       24.0684       17.644        2.52626        23     
produce:triggerrawdecoder:PDVDTriggerReader4     0.689129       0.71371      0.780839      0.708526      0.0242693       23     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000298089   0.000448099   0.000937531   0.000420103   0.000126973      23     
produce:ophit:OpHitFinder                       9.7396e-05    0.000179626   0.000887315   0.000144808   0.000156666      23     
produce:opflash:OpFlashFinderVerticalDrift      5.7016e-05    0.000110096   0.000526132   8.8583e-05    9.18342e-05      23     
produce:wclsdatavd:WireCellToolkit                50.6849       73.5252       145.342       62.3562       25.6681        23     
produce:gaushit:GausHitFinder                     0.84687       1.47299       3.82886       1.35478      0.625343        23     
produce:nhitsfilter:NumberOfHitsFilter          0.000202295   0.00034803    0.000741105   0.000308775    0.0001186       23     
produce:reco3d:SpacePointSolver                   7.02638       14.2028       62.0849       12.6848       10.6114        23     
produce:hitpdune:DisambigFromSpacePoints         0.101777      0.269055       1.53946      0.205855      0.280067        23     
produce:pandora:StandardPandora                   11.4963       164.511       3105.05       23.1067       627.232        23     
produce:pandoraTrack:LArPandoraTrackCreation      0.39315       1.77661       15.3358       1.00139       2.95429        23     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0194384     0.0400293     0.102599      0.0386706     0.0158047       23     
[art]:TriggerResults:TriggerResultInserter      2.3545e-05    5.70986e-05   0.000104006   5.8958e-05    1.81428e-05      23     
end_path:out1:RootOutput                         5.328e-06    1.33697e-05   2.4287e-05    1.1607e-05    4.98412e-06      23     
end_path:out1:RootOutput(write)                   3.4205        5.00623       7.72887       4.91915      0.829701        23     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7067.06 MB
  Peak resident set size usage (VmHWM): 4810.61 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup.root
\tHists: np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762285025.0,
    "core.end_time": 1762285025.0,
    "core.events": [
      15828,
      15832,
      15836,
      15840,
      15844,
      15848,
      15852,
      15856,
      15860,
      15864,
      15868,
      15872,
      15876,
      15880,
      15884,
      15888,
      15892,
      15896,
      15900,
      15904,
      15908,
      15912,
      15916
    ],
    "core.event_count": 23,
    "core.first_event_number": 15828,
    "core.last_event_number": 15916,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40348
    ],
    "core.runs_subruns": [
      4034800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019_reco_stage1_20251104T193704_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762285025.0,
    "core.end_time": 1762285025.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40348
    ],
    "core.runs_subruns": [
      4034800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040348_0171_df-s04-d0_dw_0_20251103T213019.hdf5"
    }
  ]
}