justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40222.182@dunegpschedd02.fnal.gov

Jobsub ID40222.182@dunegpschedd02.fnal.gov
Workflow ID2608
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-15 20:56:08
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce04
Last heartbeat2025-09-15 21:48:20
From worker nodeHostnameccwcondor0385
cpuinfoAMD EPYC 9334 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-15 20:57:21
Input filesvd-protodune:np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843.hdf5
JobscriptExit code0
Real time49m (2946s)
CPU time46m (2763s = 93%)
Max RSS bytes2725486592 (2599 MiB)
Outputting started2025-09-15 21:46:28
Output filesvd-protodune-det-reco:np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup.root
Finished2025-09-15 21:48:20
Saved logsjustin-logs:40222.182-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

for channel 10404
wclsFrameSaver: no samples within desired window for channel 10442
wclsFrameSaver: no samples within desired window for channel 10512
wclsFrameSaver: no samples within desired window for channel 10514
wclsFrameSaver: no samples within desired window for channel 10736
wclsFrameSaver: no samples within desired window for channel 10768
wclsFrameSaver: no samples within desired window for channel 10969
wclsFrameSaver: no samples within desired window for channel 10969
wclsFrameSaver: no samples within desired window for channel 10970
wclsFrameSaver: no samples within desired window for channel 11147
wclsFrameSaver: no samples within desired window for channel 11191
wclsFrameSaver: no samples within desired window for channel 11191
wclsFrameSaver: no samples within desired window for channel 11191
wclsFrameSaver: no samples within desired window for channel 11192
wclsFrameSaver: no samples within desired window for channel 11192
wclsFrameSaver: no samples within desired window for channel 11193
wclsFrameSaver: no samples within desired window for channel 11194
wclsFrameSaver: no samples within desired window for channel 11194
wclsFrameSaver: no samples within desired window for channel 11195
wclsFrameSaver: no samples within desired window for channel 11196
wclsFrameSaver: no samples within desired window for channel 11644
wclsFrameSaver: no samples within desired window for channel 11645
wclsFrameSaver: no samples within desired window for channel 11646
wclsFrameSaver: no samples within desired window for channel 11646
wclsFrameSaver: no samples within desired window for channel 12015
wclsFrameSaver: no samples within desired window for channel 12016
wclsFrameSaver: no samples within desired window for channel 12016
wclsFrameSaver: no samples within desired window for channel 12017
wclsFrameSaver: no samples within desired window for channel 12018
wclsFrameSaver: no samples within desired window for channel 12018
wclsFrameSaver: no samples within desired window for channel 12019
wclsFrameSaver: no samples within desired window for channel 12019
wclsFrameSaver: no samples within desired window for channel 12019
wclsFrameSaver: no samples within desired window for channel 12020
wclsFrameSaver: no samples within desired window for channel 12020
wclsFrameSaver: no samples within desired window for channel 12021
wclsFrameSaver: no samples within desired window for channel 12022
wclsFrameSaver: no samples within desired window for channel 12024
wclsFrameSaver: no samples within desired window for channel 12027
FrameSaver: q=9.72979e+06 n=1199397 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1936 XUs and 1762 XVs -> 78 XUVs
C:0 T:1 2815 XUs and 2989 XVs -> 183 XUVs
C:0 T:2 2276 XUs and 2197 XVs -> 71 XUVs
C:0 T:3 1538 XUs and 979 XVs -> 77 XUVs
C:0 T:4 1701 XUs and 1957 XVs -> 65 XUVs
C:0 T:5 175 XUs and 225 XVs -> 8 XUVs
C:0 T:6 1842 XUs and 2520 XVs -> 91 XUVs
C:0 T:7 907 XUs and 1381 XVs -> 46 XUVs
C:0 T:8 1147 XUs and 2101 XVs -> 124 XUVs
C:0 T:9 2384 XUs and 2889 XVs -> 158 XUVs
C:0 T:10 611 XUs and 965 XVs -> 50 XUVs
C:0 T:11 1272 XUs and 1297 XVs -> 79 XUVs
C:0 T:12 6719 XUs and 8139 XVs -> 235 XUVs
C:0 T:13 855 XUs and 972 XVs -> 70 XUVs
C:0 T:14 510 XUs and 782 XVs -> 27 XUVs
C:0 T:15 2842 XUs and 2179 XVs -> 128 XUVs
1490 XUVs total
1282 collection wire objects
1490 potential space points
Neighbour search...
11134 tests to find 5714 neighbours
Iterating with no regularization...
Begin: 3.2598e+08
0 3.1861e+08
1 3.18475e+08
Now with regularization...
Begin: 3.1397e+08
0 3.13963e+08
15-Sep-2025 23:46:17 CEST  Closed output file "np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        109.677       152.492       235.466       144.201       33.1662        19     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      7.2249e-05    0.00010806    0.000207595   0.000101023   3.02151e-05      19     
produce:tpcrawdecoder:PDVDTPCReader               8.14734       8.95771        10.49        8.66303       0.62872        19     
produce:triggerrawdecoder:PDVDTriggerReader4     0.0738734     0.0824109     0.101475      0.0784278    0.00833149       19     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000288968   0.000372674   0.000959225   0.000343509   0.000141796      19     
produce:ophit:OpHitFinder                       0.000156387   0.000309111   0.00113431    0.000261577   0.000207942      19     
produce:opflash:OpFlashFinderVerticalDrift      4.6841e-05    9.00361e-05   0.000461781   7.1409e-05    8.85501e-05      19     
produce:wclsdatavd:WireCellToolkit                57.6648       64.9205       77.3184       63.542        5.46114        19     
produce:gaushit:GausHitFinder                     1.03306       1.48565       2.01517       1.5138       0.285184        19     
produce:nhitsfilter:NumberOfHitsFilter          0.000232893   0.000344383   0.000748996   0.000304662   0.000115798      19     
produce:reco3d:SpacePointSolver                   8.50872       15.1707       21.8161       16.0521       4.09561        19     
produce:hitpdune:DisambigFromSpacePoints         0.129368      0.246978      0.380481      0.241052      0.0713132       19     
produce:pandora:StandardPandora                   21.4746       54.4753       126.731       46.6789       26.7131        19     
produce:pandoraTrack:LArPandoraTrackCreation      0.52174       1.14416       1.71048       1.13177      0.370855        19     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0244737     0.0369517     0.0557852     0.036918      0.0077158       19     
[art]:TriggerResults:TriggerResultInserter      2.7902e-05    4.73296e-05   0.00012509    4.0872e-05    2.07642e-05      19     
end_path:out1:RootOutput                         6.089e-06    1.33112e-05   4.4567e-05    1.0496e-05    9.39532e-06      19     
end_path:out1:RootOutput(write)                   5.39471       5.90435       6.73972       5.9218       0.330395        19     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4646.45 MB
  Peak resident set size usage (VmHWM): 2725.49 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup.root
\tHists: np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1757972778.0,
    "core.end_time": 1757972778.0,
    "core.events": [
      21378,
      21382,
      21386,
      21390,
      21394,
      21398,
      21402,
      21406,
      21410,
      21414,
      21418,
      21422,
      21426,
      21430,
      21434,
      21438,
      21442,
      21446,
      21450
    ],
    "core.event_count": 19,
    "core.first_event_number": 21378,
    "core.last_event_number": 21450,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843_reco_stage1_20250915T214617_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1757972778.0,
    "core.end_time": 1757972778.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39353
    ],
    "core.runs_subruns": [
      3935300001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039353_0277_df-s05-d2_dw_0_20250915T204843.hdf5"
    }
  ]
}
justIN time: 2025-09-19 07:45:25 UTC       justIN version: 01.05.00