Jobsub ID 297923.38@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.38@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 00:52:56 |
| From worker node | Hostname | dune001-1527531.0-lcg2699.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:58:39 |
| Input files | vd-protodune:np02vd_raw_run042433_0602_df-s03-d1_dw_0_20260203T223057.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3161s) |
| CPU time | 46m (2818s = 89%) |
| Max RSS bytes | 3384586240 (3227 MiB) |
| Outputting started | 2026-02-04 00:51:21 |
| Output files | |
| Finished | 2026-02-04 00:52:56 |
| Saved logs | justin-logs:297923.38-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x6cf02dc0, 0x5fe48100
Caught exception in looking up space point ptr... 0x46d8abc0, 0x573c8090
Caught exception in looking up space point ptr... 0x573c8090, 0x46d8abc0
Caught exception in looking up space point ptr... 0x4719cb40, 0x4c8eaf50
Caught exception in looking up space point ptr... 0x4c8eaf50, 0x67f5d530
Caught exception in looking up space point ptr... 0x61d5e0e0, 0x5057bd00
Caught exception in looking up space point ptr... 0x5057bd00, 0x6d2daf30
Caught exception in looking up space point ptr... 0x56ee5e40, 0x61d5e0e0
Caught exception in looking up space point ptr... 0x46d26020, 0x4d8a5750
Caught exception in looking up space point ptr... 0x27600e60, 0x46d26020
Caught exception in looking up space point ptr... 0x57632630, 0x59377580
Caught exception in looking up space point ptr... 0x59377580, 0x781c9860
Caught exception in looking up space point ptr... 0x574cff90, 0x4f6b0b80
Caught exception in looking up space point ptr... 0x4f6b0b80, 0x5a8962b0
Caught exception in looking up space point ptr... 0x46cb41a0, 0x46cb4010
Caught exception in looking up space point ptr... 0x46cb4010, 0x46cb41a0
Caught exception in looking up space point ptr... 0x6d305ba0, 0x6d305880
Caught exception in looking up space point ptr... 0x6d305880, 0x6d3056f0
Caught exception in looking up space point ptr... 0x475e0c00, 0x4c7cd7e0
Caught exception in looking up space point ptr... 0x4c7cd7e0, 0x4f5a4550
Caught exception in looking up space point ptr... 0x4f5a4550, 0x4da7e710
Caught exception in looking up space point ptr... 0x4da7e710, 0x4c7cd940
Caught exception in looking up space point ptr... 0x4c7cd940, 0x37a6c530
Caught exception in looking up space point ptr... 0x6700c360, 0x38a5a410
Caught exception in looking up space point ptr... 0x38a5a410, 0x6700c360
Caught exception in looking up space point ptr... 0x61cabd80, 0x61cad4f0
Caught exception in looking up space point ptr... 0x61cad4f0, 0x61cad690
Caught exception in looking up space point ptr... 0x4af61170, 0x59146e20
Caught exception in looking up space point ptr... 0x59146c60, 0x4af61170
Caught exception in looking up space point ptr... 0x70ccc990, 0x657a7250
Caught exception in looking up space point ptr... 0x657a7250, 0x70cccb30
Caught exception in looking up space point ptr... 0x70cccb30, 0x657a77d0
Caught exception in looking up space point ptr... 0x57049660, 0x57049950
Caught exception in looking up space point ptr... 0x45bc5300, 0x57049660
Caught exception in looking up space point ptr... 0x50429ae0, 0x50426270
Caught exception in looking up space point ptr... 0x50426270, 0x50429ae0
Caught exception in looking up space point ptr... 0x7fdc6090, 0x746bc3e0
Caught exception in looking up space point ptr... 0x746bc3e0, 0x763df260
Caught exception in looking up space point ptr... 0x7fdc5b40, 0x7fdc6090
Caught exception in looking up space point ptr... 0x261ebd40, 0x46604650
Caught exception in looking up space point ptr... 0x46604650, 0x261ebd40
Caught exception in looking up space point ptr... 0x287921a0, 0x48efe920
Caught exception in looking up space point ptr... 0x48efe920, 0x287921a0
Caught exception in looking up space point ptr... 0x48ee3d70, 0x3dccc930
Caught exception in looking up space point ptr... 0x3dccc930, 0x48ee3d70
Caught exception in looking up space point ptr... 0x921697b0, 0x92169660
Caught exception in looking up space point ptr... 0x92169660, 0x921697b0
Caught exception in looking up space point ptr... 0x1acd5de0, 0x6c99d0b0
Caught exception in looking up space point ptr... 0x6c99d0b0, 0x1acd5de0
Caught exception in looking up space point ptr... 0x742dd3d0, 0x70e97f80
Caught exception in looking up space point ptr... 0x70e97f80, 0x742dd3d0
Caught exception in looking up space point ptr... 0x242d17b0, 0x4c20be90
Caught exception in looking up space point ptr... 0x4c20be90, 0x242d17b0
Caught exception in looking up space point ptr... 0x9a4da160, 0x1c6922c0
Caught exception in looking up space point ptr... 0x1c6922c0, 0x4f6ad750
Caught exception in looking up space point ptr... 0x3fea2600, 0x37d5fc10
Caught exception in looking up space point ptr... 0x37d5fc10, 0x8a81c2b0
Caught exception in looking up space point ptr... 0x208cb220, 0x208cb120
Caught exception in looking up space point ptr... 0x208cb120, 0x208cb220
Caught exception in looking up space point ptr... 0x8a8183b0, 0x4f6ab830
Caught exception in looking up space point ptr... 0x4f6ab830, 0x8a8183b0
Caught exception in looking up space point ptr... 0x8a8183b0, 0x4f6accf0
Caught exception in looking up space point ptr... 0x4f6accf0, 0x8a8183b0
Caught exception in looking up space point ptr... 0x20dd9950, 0x25be66d0
Caught exception in looking up space point ptr... 0x25be66d0, 0x8a263470
Caught exception in looking up space point ptr... 0x59434160, 0x5a57cb70
Caught exception in looking up space point ptr... 0x55bb2c10, 0x59434160
++++>>>> total num hits: 50784, num free: 48633
04-Feb-2026 00:51:12 UTC Closed output file "np02vd_raw_run042433_0602_df-s03-d1_dw_0_20260203T223057_reco_stage0_20260204T005112_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 146.892 162.325 194.924 160.646 11.3277 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.6199e-05 0.000132252 0.000299391 0.000102193 5.76495e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.3645 18.0175 20.0422 17.5511 1.20046 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.690821 0.749871 0.945356 0.725469 0.0683215 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229749 0.028598 0.0445268 0.0251623 0.00696809 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229031 0.0232218 0.0243023 0.0231485 0.000276484 19
produce:beamevent:BeamEvent 0.000118328 0.000245254 0.00156734 0.000174543 0.000313286 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.01729 3.37431 3.80626 3.33024 0.20806 19
produce:ophit:OpHitFinder 0.0306283 0.0403461 0.0453784 0.0408063 0.00364559 19
produce:wclsdatavd:WireCellToolkit 98.877 109.67 117.92 109.78 5.4597 19
produce:gaushit:GausHitFinder 0.811772 1.48436 2.51274 1.38541 0.365222 19
produce:nhitsfilter:NumberOfHitsFilter 0.00025912 0.000398162 0.000947648 0.00035165 0.000163389 19
produce:reco3d:SpacePointSolver 9.20975 20.108 38.2783 18.8916 6.56723 19
produce:hitpdune:DisambigFromSpacePoints 0.103928 0.231633 0.370366 0.21415 0.0732358 19
produce:cluster3d:Cluster3D 1.57363 3.13911 6.33448 2.46477 1.35258 19
[art]:TriggerResults:TriggerResultInserter 2.9063e-05 4.52091e-05 0.000125149 3.8869e-05 2.11323e-05 19
end_path:out1:RootOutput 4.317e-06 1.05602e-05 3.3511e-05 9.405e-06 5.72927e-06 19
end_path:out1:RootOutput(write) 3.89267 5.40392 7.00376 5.45949 0.729689 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5560.93 MB
Peak resident set size usage (VmHWM): 3384.59 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0602_df-s03-d1_dw_0_20260203T223057_reco_stage0_20260204T005112_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0602_df-s03-d1_dw_0_20260203T223057_reco_stage0_20260204T005112_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0602_df-s03-d1_dw_0_20260203T223057_reco_stage0_20260204T005112_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163128.0,
"core.end_time": 1770166274.0,
"core.events": [
68637,
68643,
68649,
68655,
68661,
68667,
68673,
68679,
68685,
68691,
68697,
68703,
68709,
68715,
68721,
68727,
68733,
68739,
68745
],
"core.event_count": 19,
"core.first_event_number": 68637,
"core.last_event_number": 68745,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0602_df-s03-d1_dw_0_20260203T223057.hdf5"
}
]
} 