justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40372.125@dunegpschedd02.fnal.gov

Jobsub ID40372.125@dunegpschedd02.fnal.gov
Workflow ID2641
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-16 08:50:46
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2025-09-16 09:34:42
From worker nodeHostnameb9p30p1158.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 08:51:50
Input filesvd-protodune:np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841.hdf5
JobscriptExit code0
Real time41m (2501s)
CPU time40m (2416s = 96%)
Max RSS bytes2729578496 (2603 MiB)
Outputting started2025-09-16 09:33:32
Output filesvd-protodune-det-reco:np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup.root
Finished2025-09-16 09:34:42
Saved logsjustin-logs:40372.125-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

rameSaver: no samples within desired window for channel 7281
wclsFrameSaver: no samples within desired window for channel 7281
wclsFrameSaver: no samples within desired window for channel 7281
wclsFrameSaver: no samples within desired window for channel 7282
wclsFrameSaver: no samples within desired window for channel 7283
wclsFrameSaver: no samples within desired window for channel 7283
wclsFrameSaver: no samples within desired window for channel 7355
wclsFrameSaver: no samples within desired window for channel 7367
wclsFrameSaver: no samples within desired window for channel 7617
wclsFrameSaver: no samples within desired window for channel 7619
wclsFrameSaver: no samples within desired window for channel 7754
wclsFrameSaver: no samples within desired window for channel 7771
wclsFrameSaver: no samples within desired window for channel 7894
wclsFrameSaver: no samples within desired window for channel 7936
wclsFrameSaver: no samples within desired window for channel 8003
wclsFrameSaver: no samples within desired window for channel 8065
wclsFrameSaver: no samples within desired window for channel 8066
wclsFrameSaver: no samples within desired window for channel 8067
wclsFrameSaver: no samples within desired window for channel 8068
wclsFrameSaver: no samples within desired window for channel 8068
wclsFrameSaver: no samples within desired window for channel 8876
wclsFrameSaver: no samples within desired window for channel 8877
wclsFrameSaver: no samples within desired window for channel 8877
wclsFrameSaver: no samples within desired window for channel 8878
wclsFrameSaver: no samples within desired window for channel 8879
wclsFrameSaver: no samples within desired window for channel 9292
wclsFrameSaver: no samples within desired window for channel 9443
wclsFrameSaver: no samples within desired window for channel 9489
wclsFrameSaver: no samples within desired window for channel 9558
wclsFrameSaver: no samples within desired window for channel 9878
wclsFrameSaver: no samples within desired window for channel 10214
wclsFrameSaver: no samples within desired window for channel 10277
wclsFrameSaver: no samples within desired window for channel 10294
wclsFrameSaver: no samples within desired window for channel 10415
wclsFrameSaver: no samples within desired window for channel 10473
wclsFrameSaver: no samples within desired window for channel 10514
wclsFrameSaver: no samples within desired window for channel 10628
wclsFrameSaver: no samples within desired window for channel 10912
wclsFrameSaver: no samples within desired window for channel 11058
FrameSaver: q=6.07174e+06 n=741197 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 546 XUs and 1021 XVs -> 13 XUVs
C:0 T:1 358 XUs and 353 XVs -> 16 XUVs
C:0 T:2 191 XUs and 229 XVs -> 13 XUVs
C:0 T:3 331 XUs and 297 XVs -> 20 XUVs
C:0 T:4 808 XUs and 999 XVs -> 51 XUVs
C:0 T:5 962 XUs and 893 XVs -> 62 XUVs
C:0 T:6 324 XUs and 440 XVs -> 18 XUVs
C:0 T:7 208 XUs and 282 XVs -> 15 XUVs
C:0 T:8 1688 XUs and 1584 XVs -> 82 XUVs
C:0 T:9 1211 XUs and 1050 XVs -> 89 XUVs
C:0 T:10 738 XUs and 671 XVs -> 82 XUVs
C:0 T:11 820 XUs and 1152 XVs -> 93 XUVs
C:0 T:12 2074 XUs and 1900 XVs -> 131 XUVs
C:0 T:13 2245 XUs and 1737 XVs -> 136 XUVs
C:0 T:14 1080 XUs and 1029 XVs -> 75 XUVs
C:0 T:15 1942 XUs and 1192 XVs -> 72 XUVs
968 XUVs total
795 collection wire objects
968 potential space points
Neighbour search...
5364 tests to find 2652 neighbours
Iterating with no regularization...
Begin: 2.09374e+08
0 2.05273e+08
1 2.05238e+08
Now with regularization...
Begin: 2.0058e+08
0 2.00579e+08
16-Sep-2025 11:33:20 CEST  Closed output file "np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        95.9459       129.271       188.33        123.329       23.6994        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      5.2661e-05    8.23842e-05   0.000172942   6.7881e-05    3.0557e-05       19     
produce:tpcrawdecoder:PDVDTPCReader               6.25518       6.71166       7.15182       6.73097       0.25547        19     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00618831    0.00953908     0.0240398    0.00773337    0.00482599       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000223963   0.000346942   0.000942732   0.000318124   0.000148325      19     
produce:ophit:OpHitFinder                       0.000142152   0.000269729   0.00115842    0.000215303   0.000220788      19     
produce:opflash:OpFlashFinderVerticalDrift       4.33e-05     7.7889e-05    0.000428206   6.1511e-05    8.32042e-05      19     
produce:wclsdatavd:WireCellToolkit                53.5733       59.2965       71.143        57.8082       4.34685        19     
produce:gaushit:GausHitFinder                    0.740466       1.16164       1.87047       1.07446      0.298568        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000244043   0.000342647   0.000655629   0.000307284   9.45808e-05      19     
produce:reco3d:SpacePointSolver                   7.8461        12.491        21.3987       11.1163       3.59568        19     
produce:hitpdune:DisambigFromSpacePoints         0.0990539      0.17357      0.288117      0.162509      0.0552941       19     
produce:pandora:StandardPandora                   21.6562       43.9364       88.7082       37.023        18.2519        19     
produce:pandoraTrack:LArPandoraTrackCreation     0.385312      0.838997       2.03097      0.687067      0.411807        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0177973     0.0286736     0.0447158     0.0290705    0.00700485       19     
[art]:TriggerResults:TriggerResultInserter       1.465e-05    2.52104e-05   7.9601e-05     1.832e-05    1.71308e-05      19     
end_path:out1:RootOutput                         3.93e-06     1.09069e-05   3.0801e-05      8.5e-06     8.29079e-06      19     
end_path:out1:RootOutput(write)                   4.2611        4.58532       5.52735       4.51419      0.302623        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4673.81 MB
  Peak resident set size usage (VmHWM): 2729.58 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup.root
\tHists: np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758015201.0,
    "core.end_time": 1758015201.0,
    "core.events": [
      62143,
      62147,
      62151,
      62155,
      62159,
      62163,
      62167,
      62171,
      62175,
      62179,
      62183,
      62187,
      62191,
      62195,
      62199,
      62203,
      62207,
      62211,
      62215
    ],
    "core.event_count": 19,
    "core.first_event_number": 62143,
    "core.last_event_number": 62215,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841_reco_stage1_20250916T093320_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758015201.0,
    "core.end_time": 1758015201.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0807_df-s05-d3_dw_0_20250916T075841.hdf5"
    }
  ]
}
justIN time: 2025-09-19 13:31:11 UTC       justIN version: 01.05.00