justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47427.181@dunegpschedd01.fnal.gov

Jobsub ID47427.181@dunegpschedd01.fnal.gov
Workflow ID2744
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 09:15:01
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2025-09-17 12:13:14
From worker nodeHostnamewn-sate-023.farm.nikhef.nl
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit129600 (36 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 10:44:33
Input filesvd-protodune:np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836.hdf5
JobscriptExit code0
Real time1h (5246s)
CPU time1h (5027s = 95%)
Max RSS bytes3224248320 (3074 MiB)
Outputting started2025-09-17 12:12:00
Output filesvd-protodune-det-reco:np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup.root
Finished2025-09-17 12:13:14
Saved logsjustin-logs:47427.181-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ameSaver: no samples within desired window for channel 7616
wclsFrameSaver: no samples within desired window for channel 7825
wclsFrameSaver: no samples within desired window for channel 7920
wclsFrameSaver: no samples within desired window for channel 7938
wclsFrameSaver: no samples within desired window for channel 8005
wclsFrameSaver: no samples within desired window for channel 8347
wclsFrameSaver: no samples within desired window for channel 8347
wclsFrameSaver: no samples within desired window for channel 8348
wclsFrameSaver: no samples within desired window for channel 8348
wclsFrameSaver: no samples within desired window for channel 8349
wclsFrameSaver: no samples within desired window for channel 8349
wclsFrameSaver: no samples within desired window for channel 8349
wclsFrameSaver: no samples within desired window for channel 8350
wclsFrameSaver: no samples within desired window for channel 8351
wclsFrameSaver: no samples within desired window for channel 9082
wclsFrameSaver: no samples within desired window for channel 9084
wclsFrameSaver: no samples within desired window for channel 9084
wclsFrameSaver: no samples within desired window for channel 9085
wclsFrameSaver: no samples within desired window for channel 9085
wclsFrameSaver: no samples within desired window for channel 9417
wclsFrameSaver: no samples within desired window for channel 9736
wclsFrameSaver: no samples within desired window for channel 9737
wclsFrameSaver: no samples within desired window for channel 9739
wclsFrameSaver: no samples within desired window for channel 9944
wclsFrameSaver: no samples within desired window for channel 10315
wclsFrameSaver: no samples within desired window for channel 10712
wclsFrameSaver: no samples within desired window for channel 10713
wclsFrameSaver: no samples within desired window for channel 10713
wclsFrameSaver: no samples within desired window for channel 10713
wclsFrameSaver: no samples within desired window for channel 10898
wclsFrameSaver: no samples within desired window for channel 11348
wclsFrameSaver: no samples within desired window for channel 11812
wclsFrameSaver: no samples within desired window for channel 11812
wclsFrameSaver: no samples within desired window for channel 11813
wclsFrameSaver: no samples within desired window for channel 11813
wclsFrameSaver: no samples within desired window for channel 11814
wclsFrameSaver: no samples within desired window for channel 11816
wclsFrameSaver: no samples within desired window for channel 11986
FrameSaver: q=1.40276e+07 n=1460902 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 1235 XUs and 1803 XVs -> 44 XUVs
C:0 T:1 1153 XUs and 1587 XVs -> 58 XUVs
C:0 T:2 740 XUs and 591 XVs -> 64 XUVs
C:0 T:3 1533 XUs and 1968 XVs -> 52 XUVs
C:0 T:4 1636 XUs and 1474 XVs -> 61 XUVs
C:0 T:5 1163 XUs and 1118 XVs -> 80 XUVs
C:0 T:6 1752 XUs and 1733 XVs -> 66 XUVs
C:0 T:7 659 XUs and 718 XVs -> 43 XUVs
C:0 T:8 17406 XUs and 40868 XVs -> 6093 XUVs
C:0 T:9 8308 XUs and 8844 XVs -> 1048 XUVs
C:0 T:10 5042 XUs and 6849 XVs -> 1228 XUVs
C:0 T:11 17602 XUs and 31551 XVs -> 3592 XUVs
C:0 T:12 11553 XUs and 26625 XVs -> 2862 XUVs
C:0 T:13 11997 XUs and 13148 XVs -> 1553 XUVs
C:0 T:14 15471 XUs and 19599 XVs -> 2074 XUVs
C:0 T:15 3408 XUs and 3129 XVs -> 161 XUVs
19079 XUVs total
3142 collection wire objects
19079 potential space points
Neighbour search...
2074107 tests to find 876510 neighbours
Iterating with no regularization...
Begin: 1.12959e+09
0 1.02989e+09
1 1.0228e+09
2 1.02157e+09
3 1.02115e+09
Now with regularization...
Begin: 9.97508e+08
0 9.97156e+08
17-Sep-2025 14:11:50 CEST  Closed output file "np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        190.856       287.853       548.285       256.103       83.6629        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      6.6355e-05    8.17233e-05   0.000194807   7.2256e-05    2.90767e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               14.3861       14.9942       18.9691       14.8206      0.975133        18     
produce:triggerrawdecoder:PDVDTriggerReader4     0.034667      0.035032      0.0382026     0.0347597    0.000816009      18     
produce:pdvddaphne:DAPHNEReaderPDVD               5.6229        6.14923       6.5604        6.14244      0.237049        18     
produce:ophit:OpHitFinder                        0.0705278     0.0767264     0.0861878     0.0760704     0.0036727       18     
produce:opflash:OpFlashFinderVerticalDrift       0.0144969     0.0197668     0.0267076     0.0195466    0.00307858       18     
produce:wclsdatavd:WireCellToolkit                84.4287       98.4995       114.193       96.4661       9.66881        18     
produce:gaushit:GausHitFinder                     1.57413       2.29801       3.15448       2.20191      0.440685        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000328539   0.000463128   0.000815515   0.000440424   0.000100597      18     
produce:reco3d:SpacePointSolver                   11.0495       24.4862       40.7264       22.9648       7.26398        18     
produce:hitpdune:DisambigFromSpacePoints         0.166551      0.430289      0.709351       0.42927      0.143048        18     
produce:pandora:StandardPandora                   58.4771       131.103       364.956       106.844       70.3487        18     
produce:pandoraTrack:LArPandoraTrackCreation      1.28675       2.36794       4.33401       1.88995       1.08824        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0312053     0.0531813     0.074516      0.0503086     0.0122448       18     
[art]:TriggerResults:TriggerResultInserter      2.0408e-05    2.63768e-05   6.5423e-05    2.36445e-05   9.77234e-06      18     
end_path:out1:RootOutput                         8.145e-06    9.83306e-06   2.7242e-05    8.7665e-06    4.25659e-06      18     
end_path:out1:RootOutput(write)                   6.71554       7.29309       7.73787       7.27601      0.278359        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5110.3 MB
  Peak resident set size usage (VmHWM): 3224.25 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup.root
\tHists: np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758111110.0,
    "core.end_time": 1758111110.0,
    "core.events": [
      21971,
      21991,
      22011,
      22031,
      22051,
      22071,
      22091,
      22111,
      22131,
      22151,
      22171,
      22191,
      22211,
      22231,
      22251,
      22271,
      22291,
      22311
    ],
    "core.event_count": 18,
    "core.first_event_number": 21971,
    "core.last_event_number": 22311,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836_reco_stage1_20250917T121150_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758111110.0,
    "core.end_time": 1758111110.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39276
    ],
    "core.runs_subruns": [
      3927600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039276_0061_df-s04-d1_dw_0_20250902T130836.hdf5"
    }
  ]
}
justIN time: 2025-09-18 19:59:18 UTC       justIN version: 01.05.00