justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 303656.48@dunegpschedd01.fnal.gov

Jobsub ID303656.48@dunegpschedd01.fnal.gov
Workflow ID12717
Stage ID1
User nameykermaid@fnal.gov
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
Submitted time2026-02-03 22:56:25
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep206
Last heartbeat2026-02-04 01:29:31
From worker nodeHostnameheplnc133.pp.rl.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 6130 CPU @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Started2026-02-04 00:12:10
Input filesvd-protodune:np02vd_raw_run042421_0117_df-s02-d0_dw_0_20260203T143417.hdf5
JobscriptExit code0
Real time1h (4500s)
CPU time1h (3913s = 86%)
Max RSS bytes2555645952 (2437 MiB)
Outputting started2026-02-04 01:27:11
Output files
Finished2026-02-04 01:29:31
Saved logsjustin-logs:303656.48-dunegpschedd01.fnal.gov.logs.tgz
List job events     Cached HTCondor job logs

Jobscript log (last 10,000 characters)

ex!!! Skipping to next node... *********
--------------------------------------------------------------------------------------------
node 4 has leaf: 0x4338fe40, face: 0x8d8eb80, pos: 0/-0.166389
--------------------------------------------------------------------------------------------
node 5 has break: -0.0158424, beachPos: 0 (last: -0.0766373), leftArcVal: 1.79769e+308, rightArcVal: 1.79769e+308
     left arc x/y: 0/-0.166389, right arc x/y: 0/0.134705
     halfEdge: 0x1264ed90, target vtx: 0, face: 0x8d8eb80, twin: 0x1264edd0, twin tgt: 0, twin face: 0x8d8ec80, next: 0, last: 0
****** null vertex!!! Skipping to next node... *********
--------------------------------------------------------------------------------------------
node 6 has leaf: 0x431a77f0, face: 0x8d8ec80, pos: 0/0.134705
--------------------------------------------------------------------------------------------
node 7 has break: -0.0158424, beachPos: 0 (last: -0.0158424), leftArcVal: 1.79769e+308, rightArcVal: 1.79769e+308
     left arc x/y: 0/0.134705, right arc x/y: 0/-0.166389
     halfEdge: 0x1264edd0, target vtx: 0, face: 0x8d8ec80, twin: 0x1264ed90, twin tgt: 0, twin face: 0x8d8eb80, next: 0, last: 0
****** null vertex!!! Skipping to next node... *********
--------------------------------------------------------------------------------------------
node 8 has leaf: 0x5a2f8690, face: 0x8d8eb80, pos: 0/-0.166389
>>>>> nToKeep: 0, last non infinite entry: 0
>>>>> there are no non infinite faces
Loop over beachline done, saved 5 arcs, encountered 0 bad break points
-- started with 0 vertices, found 0 inside convex hull
==> Found 3 open faces from total of 3
    -> all edges,  # edges: 1, count: 3
    -> open edges, # edges: 1, count: 3
******************************************************************************************************************
******************************************************************************************************************
******************************************************************************************************************
****> vertexList containted 0 vertices
Caught exception in looking up space point ptr... 0x2584aea0, 0x578b3310
Caught exception in looking up space point ptr... 0x578b3310, 0x22c4ae20
Caught exception in looking up space point ptr... 0x22c4ae20, 0x2ecd5d40
Caught exception in looking up space point ptr... 0x2ecd5d40, 0x38267b50
Caught exception in looking up space point ptr... 0x38267b50, 0x5c2e0f70
Caught exception in looking up space point ptr... 0x5c2e0f70, 0x556add40
Caught exception in looking up space point ptr... 0x40e24b60, 0x40e247f0
Caught exception in looking up space point ptr... 0x40e234d0, 0x40e24b60
Caught exception in looking up space point ptr... 0x3ee994a0, 0x573c6100
Caught exception in looking up space point ptr... 0x573c6100, 0x5bc15670
Caught exception in looking up space point ptr... 0x207ea820, 0x3ee994a0
Caught exception in looking up space point ptr... 0x7b8e650, 0x7b8e330
Caught exception in looking up space point ptr... 0x7b8e330, 0x7b8e4c0
Caught exception in looking up space point ptr... 0x42583250, 0x10e00c40
Caught exception in looking up space point ptr... 0x10e00c40, 0x10e00e90
Caught exception in looking up space point ptr... 0x10e00e90, 0xc6a4040
Caught exception in looking up space point ptr... 0x3b9aaab0, 0x3b9aac40
Caught exception in looking up space point ptr... 0x3b9aac40, 0x395529b0
Caught exception in looking up space point ptr... 0x3434eb10, 0x133971e0
Caught exception in looking up space point ptr... 0x5fea5300, 0x3434eb10
Caught exception in looking up space point ptr... 0x25d76980, 0x25d78e80
Caught exception in looking up space point ptr... 0x25d78e80, 0x25d76980
Caught exception in looking up space point ptr... 0xa1a3770, 0x4dce9e30
Caught exception in looking up space point ptr... 0x4dce9e30, 0xa1a3770
Caught exception in looking up space point ptr... 0x27b33c20, 0x4eaa9980
Caught exception in looking up space point ptr... 0x4eaa9980, 0x27b33c20
Caught exception in looking up space point ptr... 0x4b36cac0, 0x385ae950
Caught exception in looking up space point ptr... 0x385ae950, 0x4a98ffb0
Caught exception in looking up space point ptr... 0x28510f80, 0x22b30150
Caught exception in looking up space point ptr... 0x22b30150, 0x22b30050
Caught exception in looking up space point ptr... 0x33fe74f0, 0x3ecbb9b0
Caught exception in looking up space point ptr... 0x3ecbb9b0, 0x33fe74f0
Caught exception in looking up space point ptr... 0x324aff00, 0x324b00a0
Caught exception in looking up space point ptr... 0x324b00a0, 0x324aff00
Caught exception in looking up space point ptr... 0x9e18bf0, 0x9e18740
Caught exception in looking up space point ptr... 0x9e18740, 0x9e18bf0
++++>>>> total num hits: 33797, num free: 32857
04-Feb-2026 01:26:20 GMT  Closed output file "np02vd_raw_run042421_0117_df-s02-d0_dw_0_20260203T143417_reco_stage0_20260204T012620_offline.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                         127.559       155.621       187.649       155.266       17.0018        27     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        7.521e-05    0.000129717   0.000304754   0.000120137   4.67104e-05      27     
produce:tpcrawdecoder:PDVDTPCReader                11.7108       12.8468       13.4368       12.9006      0.415258        27     
produce:triggerrawdecoder:PDVDTriggerReader4      0.512292      0.540088      0.565868      0.544017      0.0123802       27     
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0176827     0.0178419     0.0183011     0.0178275    0.000112647      27     
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.0876399     0.0946435     0.107538      0.0881155    0.00848818       27     
produce:beamevent:BeamEvent                      0.00010723    0.00020587    0.00151584    0.000152941   0.000257987      27     
produce:pdvddaphne:DAPHNEReaderPDVD                6.22694       7.63165       9.68459       7.58291      0.783004        27     
produce:ophit:OpHitFinder                         0.036969      0.0640325     0.102729      0.0695164     0.0171201       27     
produce:wclsdatavd:WireCellToolkit                 87.5782       109.715       139.724       105.576       15.5732        27     
produce:gaushit:GausHitFinder                      0.85065       1.52849       3.00849       1.41834       0.41448        27     
produce:nhitsfilter:NumberOfHitsFilter           0.000322346   0.000467507   0.000857626   0.000470398   9.83546e-05      27     
produce:reco3d:SpacePointSolver                    7.82266       12.3461       17.9012       12.1768       2.89101        27     
produce:hitpdune:DisambigFromSpacePoints          0.0853171     0.163696      0.438173      0.142069      0.0722298       27     
produce:cluster3d:Cluster3D                        1.02451       2.60888       7.31301       2.04345       1.54776        27     
[art]:TriggerResults:TriggerResultInserter       2.8235e-05    4.23702e-05   8.8568e-05    3.9195e-05    1.33948e-05      27     
end_path:out1:RootOutput                          4.265e-06    9.75511e-06   2.6443e-05     9.363e-06    4.78798e-06      27     
end_path:out1:RootOutput(write)                    4.29702       8.02606       18.7662       7.55413       2.86421        27     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4525.54 MB
  Peak resident set size usage (VmHWM): 2555.65 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0117_df-s02-d0_dw_0_20260203T143417_reco_stage0_20260204T012620_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0117_df-s02-d0_dw_0_20260203T143417_reco_stage0_20260204T012620_offline.root
Ran successfully
{
  "name": "np02vd_raw_run042421_0117_df-s02-d0_dw_0_20260203T143417_reco_stage0_20260204T012620_offline.root",
  "namespace": "usertests",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v10_17_00d00",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
    "dune.campaign": "vd-protodune-det-reco-test",
    "core.start_time": 1770163944.0,
    "core.end_time": 1770168420.0,
    "core.events": [
      19020,
      19026,
      19032,
      19038,
      19044,
      19050,
      19056,
      19062,
      19068,
      19074,
      19080,
      19086,
      19092,
      19098,
      19104,
      19110,
      19116,
      19122,
      19128,
      19134,
      19140,
      19146,
      19152,
      19158,
      19164,
      19170,
      19176
    ],
    "core.event_count": 27,
    "core.first_event_number": 19020,
    "core.last_event_number": 19176,
    "core.data_stream": "cosmics",
    "core.file_type": "detector",
    "core.run_type": "vd-protodune",
    "core.runs": [
      42421
    ],
    "core.runs_subruns": [
      4242100001
    ]
  },
  "parents": [
    {
      "did": "vd-protodune:np02vd_raw_run042421_0117_df-s02-d0_dw_0_20260203T143417.hdf5"
    }
  ]
}
justIN time: 2026-02-04 04:31:52 UTC       justIN version: 01.06.00