justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 40383.161@dunegpschedd02.fnal.gov

Jobsub ID40383.161@dunegpschedd02.fnal.gov
Workflow ID2650
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-09-16 11:40:54
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce512
Last heartbeat2025-09-16 12:45:01
From worker nodeHostnameb9p30p1158.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-09-16 11:45:58
Input filesvd-protodune:np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008.hdf5
JobscriptExit code0
Real time57m (3472s)
CPU time55m (3359s = 96%)
Max RSS bytes3286900736 (3134 MiB)
Outputting started2025-09-16 12:43:52
Output filesvd-protodune-det-reco:np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup.root
Finished2025-09-16 12:45:01
Saved logsjustin-logs:40383.161-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

el 9816
wclsFrameSaver: no samples within desired window for channel 9818
wclsFrameSaver: no samples within desired window for channel 9819
wclsFrameSaver: no samples within desired window for channel 9819
wclsFrameSaver: no samples within desired window for channel 10002
wclsFrameSaver: no samples within desired window for channel 10603
wclsFrameSaver: no samples within desired window for channel 10707
wclsFrameSaver: no samples within desired window for channel 10710
wclsFrameSaver: no samples within desired window for channel 10711
wclsFrameSaver: no samples within desired window for channel 10712
wclsFrameSaver: no samples within desired window for channel 10715
wclsFrameSaver: no samples within desired window for channel 10717
wclsFrameSaver: no samples within desired window for channel 10780
wclsFrameSaver: no samples within desired window for channel 10804
wclsFrameSaver: no samples within desired window for channel 10813
wclsFrameSaver: no samples within desired window for channel 10998
wclsFrameSaver: no samples within desired window for channel 11012
wclsFrameSaver: no samples within desired window for channel 11012
wclsFrameSaver: no samples within desired window for channel 11294
wclsFrameSaver: no samples within desired window for channel 11294
wclsFrameSaver: no samples within desired window for channel 11295
wclsFrameSaver: no samples within desired window for channel 11296
wclsFrameSaver: no samples within desired window for channel 11297
wclsFrameSaver: no samples within desired window for channel 11297
wclsFrameSaver: no samples within desired window for channel 11299
wclsFrameSaver: no samples within desired window for channel 11782
wclsFrameSaver: no samples within desired window for channel 11783
wclsFrameSaver: no samples within desired window for channel 11784
wclsFrameSaver: no samples within desired window for channel 11785
wclsFrameSaver: no samples within desired window for channel 11822
wclsFrameSaver: no samples within desired window for channel 11823
wclsFrameSaver: no samples within desired window for channel 11825
wclsFrameSaver: no samples within desired window for channel 11826
wclsFrameSaver: no samples within desired window for channel 11826
wclsFrameSaver: no samples within desired window for channel 11826
wclsFrameSaver: no samples within desired window for channel 11827
wclsFrameSaver: no samples within desired window for channel 11827
wclsFrameSaver: no samples within desired window for channel 11828
wclsFrameSaver: no samples within desired window for channel 12220
FrameSaver: q=8.78186e+06 n=964454 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 136 XUs and 102 XVs -> 7 XUVs
C:0 T:1 306 XUs and 258 XVs -> 9 XUVs
C:0 T:2 2559 XUs and 2295 XVs -> 72 XUVs
C:0 T:3 490 XUs and 472 XVs -> 18 XUVs
C:0 T:4 677 XUs and 643 XVs -> 33 XUVs
C:0 T:5 319 XUs and 226 XVs -> 17 XUVs
C:0 T:6 1376 XUs and 1070 XVs -> 65 XUVs
C:0 T:7 631 XUs and 620 XVs -> 23 XUVs
C:0 T:8 3477 XUs and 4015 XVs -> 235 XUVs
C:0 T:9 4899 XUs and 5891 XVs -> 299 XUVs
C:0 T:10 1414 XUs and 1374 XVs -> 91 XUVs
C:0 T:11 437 XUs and 539 XVs -> 72 XUVs
C:0 T:12 4619 XUs and 5919 XVs -> 255 XUVs
C:0 T:13 1919 XUs and 4082 XVs -> 371 XUVs
C:0 T:14 3542 XUs and 4646 XVs -> 393 XUVs
C:0 T:15 496 XUs and 859 XVs -> 42 XUVs
2002 XUVs total
1568 collection wire objects
2002 potential space points
Neighbour search...
23446 tests to find 12178 neighbours
Iterating with no regularization...
Begin: 3.57248e+08
0 3.44208e+08
1 3.438e+08
2 3.43768e+08
Now with regularization...
Begin: 3.33922e+08
0 3.33915e+08
16-Sep-2025 14:43:40 CEST  Closed output file "np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        127.679       190.184       334.515       177.926       54.6755        18     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       5.72e-05     8.15978e-05   0.000122201   7.97365e-05   1.99815e-05      18     
produce:tpcrawdecoder:PDVDTPCReader               6.40218       7.11081       7.66313       7.08463      0.355181        18     
produce:triggerrawdecoder:PDVDTriggerReader4    0.00106048    0.00141122     0.003435     0.00125759    0.000530421      18     
produce:pdvddaphne:DAPHNEReaderPDVD               3.94291       4.3611        4.80053       4.31593      0.248116        18     
produce:ophit:OpHitFinder                        0.0475373     0.0580326     0.0873064     0.0543863     0.0106085       18     
produce:opflash:OpFlashFinderVerticalDrift       0.0110302     0.0158117     0.0245604     0.0152643    0.00321604       18     
produce:wclsdatavd:WireCellToolkit                63.3371       74.0815       88.233        73.313        7.15707        18     
produce:gaushit:GausHitFinder                    0.845146       1.3336        2.04383       1.33389      0.265751        18     
produce:nhitsfilter:NumberOfHitsFilter          0.000316774   0.000442434   0.000630769   0.000433666   9.34962e-05      18     
produce:reco3d:SpacePointSolver                   11.8913       17.9536       28.4338       16.6321       4.84657        18     
produce:hitpdune:DisambigFromSpacePoints         0.186836      0.285386      0.474607      0.255375      0.0873666       18     
produce:pandora:StandardPandora                   29.2447       78.2743       216.382       65.0201       46.7294        18     
produce:pandoraTrack:LArPandoraTrackCreation     0.744085       1.30178       2.33582       1.25364      0.418149        18     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0230162     0.0328919     0.0428809     0.032962     0.00484969       18     
[art]:TriggerResults:TriggerResultInserter      2.0331e-05    2.7731e-05     5.752e-05    2.38755e-05   9.11978e-06      18     
end_path:out1:RootOutput                         3.43e-06     7.76678e-06    2.458e-05     7.56e-06     4.39225e-06      18     
end_path:out1:RootOutput(write)                   4.84357       5.33461       5.79003       5.3908       0.268224        18     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5223.97 MB
  Peak resident set size usage (VmHWM): 3286.9 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup.root
\tHists: np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758026620.0,
    "core.end_time": 1758026620.0,
    "core.events": [
      128533,
      128553,
      128573,
      128593,
      128613,
      128633,
      128653,
      128673,
      128693,
      128713,
      128733,
      128753,
      128773,
      128793,
      128813,
      128833,
      128853,
      128873
    ],
    "core.event_count": 18,
    "core.first_event_number": 128533,
    "core.last_event_number": 128873,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39275
    ],
    "core.runs_subruns": [
      3927500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008_reco_stage1_20250916T124340_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_10_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1758026620.0,
    "core.end_time": 1758026620.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      39275
    ],
    "core.runs_subruns": [
      3927500001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run039275_0357_df-s04-d3_dw_0_20250902T025008.hdf5"
    }
  ]
}
justIN time: 2025-09-19 13:31:21 UTC       justIN version: 01.05.00