justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 236711.6@dunegpschedd02.fnal.gov

Jobsub ID236711.6@dunegpschedd02.fnal.gov
Workflow ID9538
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors2
GPUNo
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2025-11-03 13:46:54
SiteUK_Oxford
EntryDUNE_UK_SGrid_Oxford_arc01
Last heartbeat2025-11-03 16:27:46
From worker nodeHostnamet2wn065.physics.ox.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors2
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2025-11-03 13:48:28
Input filesvd-protodune:np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900.hdf5
JobscriptExit code0
Real time2h (9327s)
CPU time2h (7276s = 78%)
Max RSS bytes5517971456 (5262 MiB)
Outputting started2025-11-03 16:23:56
Output filesvd-protodune-det-reco:np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162334_keepup.root
Finished2025-11-03 16:27:46
Saved logsjustin-logs:236711.6-dunegpschedd02.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

3
wclsFrameSaver: no samples within desired window for channel 10895
wclsFrameSaver: no samples within desired window for channel 10986
FrameSaver: q=9.78515e+06 n=913294 tag=gauss
wclsFrameSaver: saving 55069 traces tagged "wiener"
wclsFrameSaver: no samples within desired window for channel 6431
wclsFrameSaver: no samples within desired window for channel 6431
wclsFrameSaver: no samples within desired window for channel 7294
wclsFrameSaver: no samples within desired window for channel 7296
wclsFrameSaver: no samples within desired window for channel 7296
wclsFrameSaver: no samples within desired window for channel 7297
wclsFrameSaver: no samples within desired window for channel 7297
wclsFrameSaver: no samples within desired window for channel 7298
wclsFrameSaver: no samples within desired window for channel 7299
wclsFrameSaver: no samples within desired window for channel 7299
wclsFrameSaver: no samples within desired window for channel 7300
wclsFrameSaver: no samples within desired window for channel 7300
wclsFrameSaver: no samples within desired window for channel 7611
wclsFrameSaver: no samples within desired window for channel 7914
wclsFrameSaver: no samples within desired window for channel 7944
wclsFrameSaver: no samples within desired window for channel 8614
wclsFrameSaver: no samples within desired window for channel 8614
wclsFrameSaver: no samples within desired window for channel 8615
wclsFrameSaver: no samples within desired window for channel 8615
wclsFrameSaver: no samples within desired window for channel 8616
wclsFrameSaver: no samples within desired window for channel 8616
wclsFrameSaver: no samples within desired window for channel 8617
wclsFrameSaver: no samples within desired window for channel 8617
wclsFrameSaver: no samples within desired window for channel 8617
wclsFrameSaver: no samples within desired window for channel 8618
wclsFrameSaver: no samples within desired window for channel 8618
wclsFrameSaver: no samples within desired window for channel 8619
wclsFrameSaver: no samples within desired window for channel 10450
wclsFrameSaver: no samples within desired window for channel 10584
wclsFrameSaver: no samples within desired window for channel 10584
wclsFrameSaver: no samples within desired window for channel 10652
wclsFrameSaver: no samples within desired window for channel 10733
wclsFrameSaver: no samples within desired window for channel 10895
wclsFrameSaver: no samples within desired window for channel 10986
FrameSaver: q=1.03348e+07 n=865724 tag=wiener
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 203 XUs and 327 XVs -> 7 XUVs
C:0 T:1 696 XUs and 659 XVs -> 23 XUVs
C:0 T:2 788 XUs and 848 XVs -> 43 XUVs
C:0 T:3 953 XUs and 1304 XVs -> 53 XUVs
C:0 T:4 324 XUs and 371 XVs -> 18 XUVs
C:0 T:5 1304 XUs and 1574 XVs -> 39 XUVs
C:0 T:6 182 XUs and 186 XVs -> 8 XUVs
C:0 T:7 156 XUs and 246 XVs -> 10 XUVs
C:0 T:8 2801 XUs and 1209 XVs -> 171 XUVs
C:0 T:9 940 XUs and 1249 XVs -> 42 XUVs
C:0 T:10 1490 XUs and 1674 XVs -> 93 XUVs
C:0 T:11 1019 XUs and 1217 XVs -> 45 XUVs
C:0 T:12 2747 XUs and 3137 XVs -> 277 XUVs
C:0 T:13 2090 XUs and 1177 XVs -> 113 XUVs
C:0 T:14 1289 XUs and 1328 XVs -> 80 XUVs
C:0 T:15 440 XUs and 665 XVs -> 51 XUVs
1073 XUVs total
835 collection wire objects
1073 potential space points
Neighbour search...
13631 tests to find 7350 neighbours
Iterating with no regularization...
Begin: 4.5608e+08
0 4.40911e+08
1 4.40164e+08
2 4.39945e+08
Now with regularization...
Begin: 4.34128e+08
0 4.34026e+08
03-Nov-2025 16:23:34 GMT  Closed output file "np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162334_keepup.root"

==================================================================================================================================
TimeTracker printout (sec)                          Min           Avg           Max         Median          RMS         nEvts   
==================================================================================================================================
Full event                                        195.009       400.497       2889.87       250.95        539.588        23     
----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                      0.000123731   0.000271706   0.00050326    0.000253113   9.69051e-05      23     
produce:tpcrawdecoder:PDVDTPCReader               55.018        85.7301       148.351       79.8862       23.812         23     
produce:triggerrawdecoder:PDVDTriggerReader4     0.573028      0.734896       1.01192      0.704708      0.107608        23     
produce:pdvddaphne:DAPHNEReaderPDVD             0.000541562   0.000929607   0.00326905    0.000800085   0.00053319       23     
produce:ophit:OpHitFinder                       0.000114925   0.000429767   0.00247176    0.000311252   0.000454356      23     
produce:opflash:OpFlashFinderVerticalDrift      7.5461e-05    0.000313314   0.00178762    0.000248585   0.000335195      23     
produce:wclsdatavd:WireCellToolkit                67.5915       119.427       305.795       97.1422       52.3711        23     
produce:gaushit:GausHitFinder                     1.07234       2.07513       4.24161       1.9267       0.818509        23     
produce:nhitsfilter:NumberOfHitsFilter          0.000754169   0.00173367    0.00348261    0.00167042    0.000708129      23     
produce:reco3d:SpacePointSolver                   10.9793       19.0749       43.6626       17.0591       7.42024        23     
produce:hitpdune:DisambigFromSpacePoints         0.153094      0.337479      0.925765      0.317268      0.161014        23     
produce:pandora:StandardPandora                   19.4895       162.333       2443.35       40.2508       489.284        23     
produce:pandoraTrack:LArPandoraTrackCreation      0.83018       4.36859       12.4869       2.6918        3.48809        23     
produce:pandoraGnocalo:GnocchiCalorimetry        0.0421872     0.0692528     0.154116      0.0638828     0.0227813       23     
[art]:TriggerResults:TriggerResultInserter      5.5353e-05    0.000128748   0.000216705   0.000123501   5.01078e-05      23     
end_path:out1:RootOutput                         1.069e-05    2.49947e-05   4.6998e-05    2.3163e-05    1.00343e-05      23     
end_path:out1:RootOutput(write)                   4.7302        6.14486       7.98342       5.91659      0.820812        23     
==================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 7662.76 MB
  Peak resident set size usage (VmHWM): 5517.97 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162334_keepup.root
\tHists: np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162335_keepup_hists.root
Forming reco metadata
Successfully opened file np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162334_keepup.root
Ran successfully
{
  "name": "np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162334_keepup.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762187017.0,
    "core.end_time": 1762187017.0,
    "core.events": [
      320784,
      320788,
      320792,
      320796,
      320800,
      320804,
      320808,
      320812,
      320816,
      320820,
      320824,
      320828,
      320832,
      320836,
      320840,
      320844,
      320848,
      320852,
      320856,
      320860,
      320864,
      320868,
      320872
    ],
    "core.event_count": 23,
    "core.first_event_number": 320784,
    "core.last_event_number": 320872,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900_reco_stage1_20251103T162335_keepup_hists.root",
  "namespace": "vd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_11_00d00",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage1_protodunevd_keepup_all.fcl",
    "dune.campaign": "vd-protodune-reco-keepup-v0",
    "core.start_time": 1762187017.0,
    "core.end_time": 1762187017.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      40346
    ],
    "core.runs_subruns": [
      4034600001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics"
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run040346_3475_df-s04-d0_dw_0_20251103T124900.hdf5"
    }
  ]
}
justIN time: 2025-11-04 07:42:29 UTC       justIN version: 01.05.01