justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40881.152@dunegpschedd02.fnal.gov

Jobsub ID40881.152@dunegpschedd02.fnal.gov
Workflow ID2744
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 09:03:01
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2025-09-17 12:10:28
From worker nodeHostnameb9p20p3034.cern.ch
cpuinfoIntel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 10:23:29
Input filesvd-protodune:np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937.hdf5
JobscriptExit code0
Real time1h (6346s)
CPU time1h (6187s = 97%)
Max RSS bytes3369365504 (3213 MiB)
Outputting started2025-09-17 12:09:15
Output filesvd-protodune-det-reco:np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup.root
Finished2025-09-17 12:10:28
Saved logsjustin-logs:40881.152-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

l 9412
wclsFrameSaver: no samples within desired window for channel 9412
wclsFrameSaver: no samples within desired window for channel 9413
wclsFrameSaver: no samples within desired window for channel 9797
wclsFrameSaver: no samples within desired window for channel 9797
wclsFrameSaver: no samples within desired window for channel 9799
wclsFrameSaver: no samples within desired window for channel 9801
wclsFrameSaver: no samples within desired window for channel 9802
wclsFrameSaver: no samples within desired window for channel 9810
wclsFrameSaver: no samples within desired window for channel 9858
wclsFrameSaver: no samples within desired window for channel 10228
wclsFrameSaver: no samples within desired window for channel 10316
wclsFrameSaver: no samples within desired window for channel 10370
wclsFrameSaver: no samples within desired window for channel 10371
wclsFrameSaver: no samples within desired window for channel 10371
wclsFrameSaver: no samples within desired window for channel 10372
wclsFrameSaver: no samples within desired window for channel 10372
wclsFrameSaver: no samples within desired window for channel 10419
wclsFrameSaver: no samples within desired window for channel 10433
wclsFrameSaver: no samples within desired window for channel 10433
wclsFrameSaver: no samples within desired window for channel 10433
wclsFrameSaver: no samples within desired window for channel 10823
wclsFrameSaver: no samples within desired window for channel 10824
wclsFrameSaver: no samples within desired window for channel 10828
wclsFrameSaver: no samples within desired window for channel 10831
wclsFrameSaver: no samples within desired window for channel 10831
wclsFrameSaver: no samples within desired window for channel 10832
wclsFrameSaver: no samples within desired window for channel 10832
wclsFrameSaver: no samples within desired window for channel 10916
wclsFrameSaver: no samples within desired window for channel 11163
wclsFrameSaver: no samples within desired window for channel 11164
wclsFrameSaver: no samples within desired window for channel 11164
wclsFrameSaver: no samples within desired window for channel 11166
wclsFrameSaver: no samples within desired window for channel 11724
wclsFrameSaver: no samples within desired window for channel 11725
wclsFrameSaver: no samples within desired window for channel 11725
wclsFrameSaver: no samples within desired window for channel 11726
wclsFrameSaver: no samples within desired window for channel 11729
FrameSaver: q=1.14243e+07 n=1233623 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 16 XUs and 30 XVs -> 1 XUVs
C:0 T:1 115 XUs and 114 XVs -> 2 XUVs
C:0 T:2 317 XUs and 321 XVs -> 15 XUVs
C:0 T:3 2107 XUs and 2471 XVs -> 70 XUVs
C:0 T:4 914 XUs and 1391 XVs -> 43 XUVs
C:0 T:5 110 XUs and 101 XVs -> 1 XUVs
C:0 T:6 2353 XUs and 2043 XVs -> 85 XUVs
C:0 T:7 1398 XUs and 1261 XVs -> 131 XUVs
C:0 T:8 21886 XUs and 55163 XVs -> 6735 XUVs
C:0 T:9 5717 XUs and 8250 XVs -> 928 XUVs
C:0 T:10 4292 XUs and 4477 XVs -> 682 XUVs
C:0 T:11 1549 XUs and 2441 XVs -> 110 XUVs
C:0 T:12 4257 XUs and 4869 XVs -> 356 XUVs
C:0 T:13 3049 XUs and 3097 XVs -> 297 XUVs
C:0 T:14 6015 XUs and 15052 XVs -> 1364 XUVs
C:0 T:15 6169 XUs and 8542 XVs -> 853 XUVs
11673 XUVs total
2249 collection wire objects
11673 potential space points
Neighbour search...
1124211 tests to find 489044 neighbours
Iterating with no regularization...
Begin: 6.21216e+08
0 5.44411e+08
1 5.39685e+08
2 5.3897e+08
3 5.38688e+08
Now with regularization...
Begin: 5.25979e+08
0 5.25696e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 14:09:03 CEST  Closed output file "np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        220.24        349.171       644.322       307.68        100.986        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.4193e-05    0.000115425   0.000274192   0.000103527   4.93159e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               7.96628       8.88058       9.59005       8.81679      0.418849        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.000969488   0.00318482     0.0151318    0.00123217    0.00420095       18     
produce:pdvddaphne:DAPHNEReaderPDVD               9.88897       10.9304       12.1084       10.7994      0.628092        18     
produce:ophit:OpHitFinder                        0.0532862     0.0900461     0.119067      0.0841379     0.0204144       18     
produce:opflash:OpFlashFinderVerticalDrift      0.00738834     0.0258481     0.0420819     0.0251326    0.00885128       18     
produce:wclsdatavd:WireCellToolkit                99.0526       130.946       152.312       129.936       14.0298        18     
produce:gaushit:GausHitFinder                     1.78504       2.63549       3.61661       2.54299      0.568298        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000503957   0.000707842   0.000999335   0.000667758   0.00015272       18     
produce:reco3d:SpacePointSolver                   18.1452       26.838         45.89        24.1273       7.9502         18     
produce:hitpdune:DisambigFromSpacePoints          0.29513       0.69947       1.4625        0.58561      0.311497        18     
produce:pandora:StandardPandora                   68.2605       155.421       427.93        125.275       93.0476        18     
produce:pandoraTrack:LArPandoraTrackCreation      1.60764       4.29203       9.37522       3.4504        2.08489        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0395489     0.0724988      0.11458      0.071585      0.0199821       18     
[art]:TriggerResults:TriggerResultInserter      3.6612e-05    4.96787e-05   8.2771e-05    4.6421e-05    1.07968e-05      18     
end_path:out1:RootOutput                         8.75e-06     1.31825e-05   3.3107e-05    1.1011e-05    6.43892e-06      18     
end_path:out1:RootOutput(write)                   6.40845       8.25696       10.0694       8.35021      0.973949        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5305.53 MB
  Peak resident set size usage (VmHWM): 3369.37 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup.root
\tHists: np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758110944.0,
    "core.end_time": 1758110944.0,
    "core.events": [
      2170,
      2190,
      2210,
      2230,
      2250,
      2270,
      2290,
      2310,
      2330,
      2350,
      2370,
      2390,
      2410,
      2430,
      2450,
      2470,
      2490,
      2510
    ],
    "core.event_count": 18,
    "core.first_event_number": 2170,
    "core.last_event_number": 2510,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937_reco_stage1_20250917T120903_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758110944.0,
    "core.end_time": 1758110944.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0006_df-s04-d0_dw_0_20250902T092937.hdf5"
    }
  ]
}
justIN time: 2025-09-18 19:02:37 UTC       justIN version: 01.05.00