Jobsub ID 297921.127@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.127@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 01:06:26 |
| From worker node | Hostname | dune001-1535461.0-lcg2708.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:20 |
| Input files | vd-protodune:np02vd_raw_run042433_0220_df-s03-d1_dw_0_20260203T200544.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4053s) |
| CPU time | 1h (3722s = 91%) |
| Max RSS bytes | 3595059200 (3428 MiB) |
| Outputting started | 2026-02-04 01:03:56 |
| Output files | |
| Finished | 2026-02-04 01:06:11 |
| Saved logs | justin-logs:297921.127-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x72e7da10, 0x72e7a4c0
Caught exception in looking up space point ptr... 0x72e7a4c0, 0x72e7d770
Caught exception in looking up space point ptr... 0x72e7d770, 0x72e7a4c0
Caught exception in looking up space point ptr... 0x3730f590, 0x3835dba0
Caught exception in looking up space point ptr... 0x37321830, 0x3730f590
Caught exception in looking up space point ptr... 0x3953a480, 0x395a0f60
Caught exception in looking up space point ptr... 0x3953cd50, 0x3953a480
Caught exception in looking up space point ptr... 0x42530b10, 0x42530800
Caught exception in looking up space point ptr... 0x42530800, 0x42538cf0
Caught exception in looking up space point ptr... 0x3ff07270, 0x3ff07020
Caught exception in looking up space point ptr... 0x3ff07020, 0x3ff10320
Caught exception in looking up space point ptr... 0x8547fdd0, 0x8547ff20
Caught exception in looking up space point ptr... 0x8547ff20, 0x8547fdd0
Caught exception in looking up space point ptr... 0x95fb5480, 0x95fa7e70
Caught exception in looking up space point ptr... 0x95fb5610, 0x95fb5480
Caught exception in looking up space point ptr... 0x6840b320, 0x6840b4b0
Caught exception in looking up space point ptr... 0x6840b4b0, 0x6840b320
Caught exception in looking up space point ptr... 0x335d09c0, 0x83e70c60
Caught exception in looking up space point ptr... 0x83e70c60, 0x8f6c59a0
Caught exception in looking up space point ptr... 0x41b450b0, 0x41b31530
Caught exception in looking up space point ptr... 0x41b44f20, 0x41b450b0
Caught exception in looking up space point ptr... 0x83e45f50, 0x83e45dc0
Caught exception in looking up space point ptr... 0x83e45c30, 0x83e45f50
Caught exception in looking up space point ptr... 0x8e2ff990, 0x984cc580
Caught exception in looking up space point ptr... 0x984cc580, 0x8e2ff990
Caught exception in looking up space point ptr... 0x56f00260, 0x56f00ba0
Caught exception in looking up space point ptr... 0x56f00ba0, 0x56f00260
Caught exception in looking up space point ptr... 0x33d94ad0, 0x33d8e6c0
Caught exception in looking up space point ptr... 0x33d8e950, 0x33d94ad0
Caught exception in looking up space point ptr... 0x72e7f7d0, 0x72e7fc80
Caught exception in looking up space point ptr... 0x72e7fc80, 0x72e7f7d0
Caught exception in looking up space point ptr... 0x588be450, 0x588be7e0
Caught exception in looking up space point ptr... 0x588be7e0, 0x588be450
Caught exception in looking up space point ptr... 0x42b4d150, 0x42b5ab50
Caught exception in looking up space point ptr... 0x42b5ab50, 0x42b40fd0
Caught exception in looking up space point ptr... 0x6cae9300, 0x90e1a380
Caught exception in looking up space point ptr... 0x90e1a380, 0x6f0bcfe0
Caught exception in looking up space point ptr... 0x5a520390, 0x5a52f660
Caught exception in looking up space point ptr... 0x5a52f660, 0x5a52f7f0
Caught exception in looking up space point ptr... 0x5a53e9c0, 0x3b152ea0
Caught exception in looking up space point ptr... 0x3b152ea0, 0x3b153030
Caught exception in looking up space point ptr... 0xae834510, 0xacb4b500
Caught exception in looking up space point ptr... 0xacb4b690, 0xae834510
Caught exception in looking up space point ptr... 0x3f671cc0, 0x3f671e50
Caught exception in looking up space point ptr... 0x3f671e50, 0x3f671cc0
Caught exception in looking up space point ptr... 0x70b88190, 0x70b88320
Caught exception in looking up space point ptr... 0x70b88320, 0x87e750e0
Caught exception in looking up space point ptr... 0x36289130, 0x60792810
Caught exception in looking up space point ptr... 0x60792810, 0x36289130
Caught exception in looking up space point ptr... 0x6bc83a60, 0x5b979ab0
Caught exception in looking up space point ptr... 0x5b979ab0, 0x7fcad1d0
Caught exception in looking up space point ptr... 0x9bb7f8d0, 0x6db03290
Caught exception in looking up space point ptr... 0x6db03290, 0x9bb7f8d0
Caught exception in looking up space point ptr... 0x72e7e7c0, 0x72e7ec70
Caught exception in looking up space point ptr... 0x72e7ec70, 0x72e7e7c0
Caught exception in looking up space point ptr... 0xaf023d10, 0x882f9ee0
Caught exception in looking up space point ptr... 0x882f9ee0, 0xaf023d10
Caught exception in looking up space point ptr... 0x7c4d3d00, 0x72eb4360
Caught exception in looking up space point ptr... 0x72eb4360, 0x915e2860
Caught exception in looking up space point ptr... 0x68bb91c0, 0x68bb8ea0
Caught exception in looking up space point ptr... 0x68bb8ea0, 0x68bb91c0
Caught exception in looking up space point ptr... 0x792aa570, 0x792aa890
Caught exception in looking up space point ptr... 0x792aa890, 0x792aabb0
Caught exception in looking up space point ptr... 0xaedd65d0, 0xa345bb80
Caught exception in looking up space point ptr... 0xa345bb80, 0xaedd65d0
Caught exception in looking up space point ptr... 0x93fa00c0, 0x3ab97090
Caught exception in looking up space point ptr... 0x3ab97090, 0x93fa00c0
++++>>>> total num hits: 492652, num free: 484620
04-Feb-2026 01:03:45 UTC Closed output file "np02vd_raw_run042433_0220_df-s03-d1_dw_0_20260203T200544_reco_stage0_20260204T010345_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 157.618 209.072 240.35 213.725 19.289 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.0792e-05 0.000138342 0.000354593 0.000108383 6.88126e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.9584 16.8623 20.66 16.609 0.961522 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.66576 0.696762 0.733536 0.690756 0.0167002 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0227598 0.0244462 0.0418029 0.0231221 0.00438827 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.022805 0.0231065 0.0239771 0.0230702 0.00027494 19
produce:beamevent:BeamEvent 0.000114342 0.000219326 0.00128277 0.000156195 0.000252755 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.07361 3.46506 3.73795 3.47836 0.14325 19
produce:ophit:OpHitFinder 0.0354616 0.0414464 0.0462131 0.0420123 0.00308638 19
produce:wclsdatavd:WireCellToolkit 97.3294 114.291 128.618 115.082 7.28339 19
produce:gaushit:GausHitFinder 1.42304 2.36244 3.06796 2.66174 0.538395 19
produce:nhitsfilter:NumberOfHitsFilter 0.000214383 0.000365917 0.000730439 0.000354533 0.000122341 19
produce:reco3d:SpacePointSolver 7.20218 13.79 20.0393 12.9522 3.27818 19
produce:hitpdune:DisambigFromSpacePoints 0.13564 0.30888 0.461752 0.311689 0.0866068 19
produce:cluster3d:Cluster3D 1.51124 50.693 65.0968 55.5311 17.2623 19
[art]:TriggerResults:TriggerResultInserter 3.2058e-05 4.21971e-05 7.6285e-05 3.9369e-05 1.01387e-05 19
end_path:out1:RootOutput 5.418e-06 9.72058e-06 2.3735e-05 7.702e-06 4.85443e-06 19
end_path:out1:RootOutput(write) 4.30233 6.47054 7.54161 6.56618 0.889657 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5771.17 MB
Peak resident set size usage (VmHWM): 3595.06 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0220_df-s03-d1_dw_0_20260203T200544_reco_stage0_20260204T010345_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0220_df-s03-d1_dw_0_20260203T200544_reco_stage0_20260204T010345_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0220_df-s03-d1_dw_0_20260203T200544_reco_stage0_20260204T010345_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162991.0,
"core.end_time": 1770167027.0,
"core.events": [
25089,
25095,
25101,
25107,
25113,
25119,
25125,
25131,
25137,
25143,
25149,
25155,
25161,
25167,
25173,
25179,
25185,
25191,
25197
],
"core.event_count": 19,
"core.first_event_number": 25089,
"core.last_event_number": 25197,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0220_df-s03-d1_dw_0_20260203T200544.hdf5"
}
]
} 