justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47410.92@dunegpschedd01.fnal.gov

Jobsub ID47410.92@dunegpschedd01.fnal.gov
Workflow ID2740
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 08:49:00
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce05
Last heartbeat2025-09-17 10:05:25
From worker nodeHostnamedune001-7807047.0-lcg2720.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 09:13:18
Input filesvd-protodune:np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138.hdf5
JobscriptExit code0
Real time46m (2812s)
CPU time40m (2438s = 86%)
Max RSS bytes2654560256 (2531 MiB)
Outputting started2025-09-17 10:00:12
Output filesvd-protodune-det-reco:np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup.root
Finished2025-09-17 10:05:25
Saved logsjustin-logs:47410.92-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

window for channel 9273
wclsFrameSaver: no samples within desired window for channel 9273
wclsFrameSaver: no samples within desired window for channel 9706
wclsFrameSaver: no samples within desired window for channel 9768
wclsFrameSaver: no samples within desired window for channel 9809
wclsFrameSaver: no samples within desired window for channel 9859
wclsFrameSaver: no samples within desired window for channel 9885
wclsFrameSaver: no samples within desired window for channel 9886
wclsFrameSaver: no samples within desired window for channel 9887
wclsFrameSaver: no samples within desired window for channel 10145
wclsFrameSaver: no samples within desired window for channel 10215
wclsFrameSaver: no samples within desired window for channel 10230
wclsFrameSaver: no samples within desired window for channel 10276
wclsFrameSaver: no samples within desired window for channel 10286
wclsFrameSaver: no samples within desired window for channel 10286
wclsFrameSaver: no samples within desired window for channel 10287
wclsFrameSaver: no samples within desired window for channel 10287
wclsFrameSaver: no samples within desired window for channel 10288
wclsFrameSaver: no samples within desired window for channel 10550
wclsFrameSaver: no samples within desired window for channel 10573
wclsFrameSaver: no samples within desired window for channel 10717
wclsFrameSaver: no samples within desired window for channel 10782
wclsFrameSaver: no samples within desired window for channel 10783
wclsFrameSaver: no samples within desired window for channel 10785
wclsFrameSaver: no samples within desired window for channel 10834
wclsFrameSaver: no samples within desired window for channel 11019
wclsFrameSaver: no samples within desired window for channel 11019
wclsFrameSaver: no samples within desired window for channel 11067
wclsFrameSaver: no samples within desired window for channel 11166
wclsFrameSaver: no samples within desired window for channel 11167
wclsFrameSaver: no samples within desired window for channel 11168
wclsFrameSaver: no samples within desired window for channel 11169
wclsFrameSaver: no samples within desired window for channel 11169
wclsFrameSaver: no samples within desired window for channel 11169
wclsFrameSaver: no samples within desired window for channel 11170
wclsFrameSaver: no samples within desired window for channel 11170
wclsFrameSaver: no samples within desired window for channel 11932
wclsFrameSaver: no samples within desired window for channel 11932
wclsFrameSaver: no samples within desired window for channel 11932
FrameSaver: q=9.14415e+06 n=999210 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1870 XUs and 2332 XVs -> 122 XUVs
C:0 T:1 2616 XUs and 2866 XVs -> 95 XUVs
C:0 T:2 640 XUs and 355 XVs -> 24 XUVs
C:0 T:3 309 XUs and 324 XVs -> 32 XUVs
C:0 T:4 1425 XUs and 1586 XVs -> 81 XUVs
C:0 T:5 500 XUs and 673 XVs -> 30 XUVs
C:0 T:6 1441 XUs and 1743 XVs -> 68 XUVs
C:0 T:7 960 XUs and 1331 XVs -> 70 XUVs
C:0 T:8 4122 XUs and 3621 XVs -> 276 XUVs
C:0 T:9 4629 XUs and 5245 XVs -> 341 XUVs
C:0 T:10 603 XUs and 537 XVs -> 28 XUVs
C:0 T:11 2431 XUs and 2514 XVs -> 175 XUVs
C:0 T:12 1208 XUs and 1573 XVs -> 103 XUVs
C:0 T:13 874 XUs and 1101 XVs -> 77 XUVs
C:0 T:14 1509 XUs and 2219 XVs -> 108 XUVs
C:0 T:15 2122 XUs and 2675 XVs -> 147 XUVs
1777 XUVs total
1479 collection wire objects
1777 potential space points
Neighbour search...
15873 tests to find 7164 neighbours
Iterating with no regularization...
Begin: 8.59446e+08
0 8.41022e+08
1 8.40658e+08
Now with regularization...
Begin: 8.24937e+08
0 8.24911e+08
17-Sep-2025 10:00:02 UTC  Closed output file "np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        117.67        145.241       189.429       145.857       20.218         19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.4778e-05    0.000109624   0.000226472   8.8984e-05    4.51896e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               19.0013       20.6329       21.7966       20.6219      0.606693        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.389252      0.407695      0.605632      0.394095      0.0471196       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000211559   0.000356049   0.000561367   0.000335787   7.86839e-05      19     
produce:ophit:OpHitFinder                       0.000178339   0.000425711   0.00134041    0.00027859    0.00033698       19     
produce:opflash:OpFlashFinderVerticalDrift      4.0251e-05    8.32509e-05   0.000287925   6.6701e-05     5.383e-05       19     
produce:wclsdatavd:WireCellToolkit                51.9496       60.3602       70.5373       61.6068       5.50916        19     
produce:gaushit:GausHitFinder                    0.828735       1.33679       1.79616       1.44558      0.295633        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000198479   0.000318914   0.000586625   0.000306402   8.8482e-05       19     
produce:reco3d:SpacePointSolver                   8.78882       12.9954       19.639        13.2046       2.76564        19     
produce:hitpdune:DisambigFromSpacePoints          0.10297      0.197527      0.362119      0.196134      0.063306        19     
produce:pandora:StandardPandora                   25.9174       43.4126       72.5001       41.7068       13.0939        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.421689      0.997083       1.69855      0.993581      0.292122        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.023495      0.0324068     0.0437582     0.0322883    0.00563535       19     
[art]:TriggerResults:TriggerResultInserter      2.1853e-05    4.11084e-05   0.000101182   3.5693e-05    1.84099e-05      19     
end_path:out1:RootOutput                         7.571e-06    1.28513e-05   3.4812e-05    1.1117e-05    5.60868e-06      19     
end_path:out1:RootOutput(write)                   3.8099        4.81967       5.25233       5.04869      0.489724        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4877.5 MB
  Peak resident set size usage (VmHWM): 2654.56 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup.root
\tHists: np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758103202.0,
    "core.end_time": 1758103202.0,
    "core.events": [
      37812,
      37816,
      37820,
      37824,
      37828,
      37832,
      37836,
      37840,
      37844,
      37848,
      37852,
      37856,
      37860,
      37864,
      37868,
      37872,
      37876,
      37880,
      37884
    ],
    "core.event_count": 19,
    "core.first_event_number": 37812,
    "core.last_event_number": 37884,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138_reco_stage1_20250917T100002_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758103202.0,
    "core.end_time": 1758103202.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39388
    ],
    "core.runs_subruns": [
      3938800001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039388_0491_df-s05-d0_dw_0_20250916T233138.hdf5"
    }
  ]
}
justIN time: 2025-09-19 09:05:57 UTC       justIN version: 01.05.00