justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 47430.190@dunegpschedd01.fnal.gov

Jobsub ID47430.190@dunegpschedd01.fnal.gov
Workflow ID2744
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-17 09:21:02
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce503
Last heartbeat2025-09-17 12:19:58
From worker nodeHostnameb9p09p9337.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-17 11:03:13
Input filesvd-protodune:np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749.hdf5
JobscriptExit code0
Real time1h (4493s)
CPU time1h (4309s = 95%)
Max RSS bytes3193286656 (3045 MiB)
Outputting started2025-09-17 12:18:07
Output filesvd-protodune-det-reco:np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup.root
Finished2025-09-17 12:19:58
Saved logsjustin-logs:47430.190-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

lsFrameSaver: no samples within desired window for channel 11125
wclsFrameSaver: no samples within desired window for channel 11126
wclsFrameSaver: no samples within desired window for channel 11126
wclsFrameSaver: no samples within desired window for channel 11127
wclsFrameSaver: no samples within desired window for channel 11127
wclsFrameSaver: no samples within desired window for channel 11127
wclsFrameSaver: no samples within desired window for channel 11204
wclsFrameSaver: no samples within desired window for channel 11205
wclsFrameSaver: no samples within desired window for channel 11205
wclsFrameSaver: no samples within desired window for channel 11206
wclsFrameSaver: no samples within desired window for channel 11206
wclsFrameSaver: no samples within desired window for channel 11207
wclsFrameSaver: no samples within desired window for channel 11207
wclsFrameSaver: no samples within desired window for channel 11208
wclsFrameSaver: no samples within desired window for channel 11208
wclsFrameSaver: no samples within desired window for channel 11209
wclsFrameSaver: no samples within desired window for channel 11209
wclsFrameSaver: no samples within desired window for channel 11210
wclsFrameSaver: no samples within desired window for channel 11211
wclsFrameSaver: no samples within desired window for channel 11211
wclsFrameSaver: no samples within desired window for channel 11214
wclsFrameSaver: no samples within desired window for channel 11802
wclsFrameSaver: no samples within desired window for channel 11803
wclsFrameSaver: no samples within desired window for channel 11803
wclsFrameSaver: no samples within desired window for channel 11803
wclsFrameSaver: no samples within desired window for channel 11804
wclsFrameSaver: no samples within desired window for channel 11804
wclsFrameSaver: no samples within desired window for channel 11804
wclsFrameSaver: no samples within desired window for channel 11805
wclsFrameSaver: no samples within desired window for channel 11805
wclsFrameSaver: no samples within desired window for channel 11806
wclsFrameSaver: no samples within desired window for channel 11808
wclsFrameSaver: no samples within desired window for channel 12103
wclsFrameSaver: no samples within desired window for channel 12104
wclsFrameSaver: no samples within desired window for channel 12118
wclsFrameSaver: no samples within desired window for channel 12119
wclsFrameSaver: no samples within desired window for channel 12119
FrameSaver: q=9.43794e+06 n=1133965 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 923 XUs and 1314 XVs -> 33 XUVs
C:0 T:1 294 XUs and 212 XVs -> 6 XUVs
C:0 T:2 606 XUs and 453 XVs -> 30 XUVs
C:0 T:3 1370 XUs and 1562 XVs -> 51 XUVs
C:0 T:4 804 XUs and 929 XVs -> 42 XUVs
C:0 T:5 1134 XUs and 1103 XVs -> 77 XUVs
C:0 T:6 1069 XUs and 1217 XVs -> 34 XUVs
C:0 T:7 2780 XUs and 2453 XVs -> 75 XUVs
C:0 T:8 3338 XUs and 3604 XVs -> 151 XUVs
C:0 T:9 2112 XUs and 2781 XVs -> 125 XUVs
C:0 T:10 3632 XUs and 3735 XVs -> 188 XUVs
C:0 T:11 993 XUs and 1678 XVs -> 50 XUVs
C:0 T:12 3979 XUs and 4045 XVs -> 230 XUVs
C:0 T:13 165 XUs and 145 XVs -> 6 XUVs
C:0 T:14 2771 XUs and 2188 XVs -> 116 XUVs
C:0 T:15 3298 XUs and 2743 XVs -> 102 XUVs
1316 XUVs total
1122 collection wire objects
1316 potential space points
Neighbour search...
7048 tests to find 3474 neighbours
Iterating with no regularization...
Begin: 4.11319e+08
0 3.99698e+08
1 3.99513e+08
Now with regularization...
Begin: 3.92809e+08
0 3.92784e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
17-Sep-2025 14:17:46 CEST  Closed output file "np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        139.161       246.393       719.178       216.412       124.804        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      7.0211e-05    0.000123693   0.000237544   0.000116982   4.74494e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               6.62469       8.71953       23.7896       7.82795       3.74197        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00108274    0.00190945     0.0035338    0.00168183    0.000784681      18     
produce:pdvddaphne:DAPHNEReaderPDVD               3.71781       4.79938       7.50038       4.65505        0.921         18     
produce:ophit:OpHitFinder                        0.0453658     0.0751013     0.123927      0.0683521     0.0217001       18     
produce:opflash:OpFlashFinderVerticalDrift      0.00932572     0.0188036     0.0320978     0.0177487    0.00719513       18     
produce:wclsdatavd:WireCellToolkit                70.5225       94.2763       123.295       89.1713       17.2846        18     
produce:gaushit:GausHitFinder                    0.926012       1.80799       2.92185       1.88004      0.572917        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000206234   0.00136947    0.00436688    0.000399042   0.00140554       18     
produce:reco3d:SpacePointSolver                   10.2655       19.5514       30.102        18.4713       6.11349        18     
produce:hitpdune:DisambigFromSpacePoints         0.120606      0.376647      0.719274      0.389487      0.184261        18     
produce:pandora:StandardPandora                   32.1103       108.512       578.239       69.5885       120.259        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.629556       2.10244       5.87059       1.57097       1.48077        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0178076     0.0487162     0.0861944     0.0443121     0.0224686       18     
[art]:TriggerResults:TriggerResultInserter      1.7801e-05    6.36718e-05   0.000182334   4.4941e-05    5.0146e-05       18     
end_path:out1:RootOutput                         7.34e-06     1.78564e-05   4.6031e-05    1.3935e-05    1.13052e-05      18     
end_path:out1:RootOutput(write)                   4.54743       6.01806       7.8723        6.07273      0.888786        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5171.63 MB
  Peak resident set size usage (VmHWM): 3193.29 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup.root
\tHists: np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758111467.0,
    "core.end_time": 1758111467.0,
    "core.events": [
      183245,
      183265,
      183285,
      183305,
      183325,
      183345,
      183365,
      183385,
      183405,
      183425,
      183445,
      183465,
      183485,
      183505,
      183525,
      183545,
      183565,
      183585
    ],
    "core.event_count": 18,
    "core.first_event_number": 183245,
    "core.last_event_number": 183585,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39275
    ],
    "core.runs_subruns": [
      3927500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749_reco_stage1_20250917T121746_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758111467.0,
    "core.end_time": 1758111467.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39275
    ],
    "core.runs_subruns": [
      3927500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039275_0509_df-s02-d3_dw_0_20250902T074749.hdf5"
    }
  ]
}
justIN time: 2025-09-19 11:40:33 UTC       justIN version: 01.05.00