Jobsub ID 303654.99@dunegpschedd01.fnal.gov
| Jobsub ID | 303654.99@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:47:46 |
| From worker node | Hostname | dune002-1602311.0-lcg2494.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:08:41 |
| Input files | vd-protodune:np02vd_raw_run042433_0262_df-s03-d0_dw_0_20260203T202142.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5805s) |
| CPU time | 1h (5436s = 93%) |
| Max RSS bytes | 3583631360 (3417 MiB) |
| Outputting started | 2026-02-04 01:45:29 |
| Output files | |
| Finished | 2026-02-04 01:47:46 |
| Saved logs | justin-logs:303654.99-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x2db784b0, 0x2db77230
Caught exception in looking up space point ptr... 0x26f5bdb0, 0x26f49980
Caught exception in looking up space point ptr... 0x26f6da10, 0x26f5bdb0
Caught exception in looking up space point ptr... 0x7951e790, 0x9aea4520
Caught exception in looking up space point ptr... 0x7952d510, 0x7951e790
Caught exception in looking up space point ptr... 0x48bbeab0, 0x6769cb80
Caught exception in looking up space point ptr... 0x48bacfe0, 0x48bbeab0
Caught exception in looking up space point ptr... 0x35f52100, 0x31b55220
Caught exception in looking up space point ptr... 0x35f52420, 0x35f52100
Caught exception in looking up space point ptr... 0x6d49dbb0, 0x7222f830
Caught exception in looking up space point ptr... 0x6d49dd40, 0x6d49dbb0
Caught exception in looking up space point ptr... 0x99e29ca0, 0x378c65f0
Caught exception in looking up space point ptr... 0x378c65f0, 0x378c6780
Caught exception in looking up space point ptr... 0x4a133bc0, 0x2ba9bce0
Caught exception in looking up space point ptr... 0x2ba9bce0, 0x2ba9be70
Caught exception in looking up space point ptr... 0x92b1fb70, 0x802c3c40
Caught exception in looking up space point ptr... 0x92b1fd00, 0x92b1fb70
Caught exception in looking up space point ptr... 0x2fea2430, 0x92b4efd0
Caught exception in looking up space point ptr... 0x2fea25c0, 0x2fea2430
Caught exception in looking up space point ptr... 0xacf57530, 0x4e43ccc0
Caught exception in looking up space point ptr... 0x4e43ccc0, 0xae429ce0
Caught exception in looking up space point ptr... 0xae429ce0, 0x26d78f00
Caught exception in looking up space point ptr... 0x26d78f00, 0x4ef2c8c0
Caught exception in looking up space point ptr... 0x749474a0, 0x38996cb0
Caught exception in looking up space point ptr... 0x38996cb0, 0x38985500
Caught exception in looking up space point ptr... 0x79518e80, 0x9ae9e440
Caught exception in looking up space point ptr... 0x9ae9e440, 0x9ae8f3a0
Caught exception in looking up space point ptr... 0x565365b0, 0x56545e20
Caught exception in looking up space point ptr... 0x56545e20, 0x56555ff0
Caught exception in looking up space point ptr... 0x37bec760, 0x37bdafb0
Caught exception in looking up space point ptr... 0x37bdafb0, 0x37bc8b80
Caught exception in looking up space point ptr... 0x534f0310, 0x585ee510
Caught exception in looking up space point ptr... 0x585ee510, 0x534f0310
Caught exception in looking up space point ptr... 0x53837b30, 0x53837e50
Caught exception in looking up space point ptr... 0x53837e50, 0x53837b30
Caught exception in looking up space point ptr... 0x5b7480b0, 0x5b7481b0
Caught exception in looking up space point ptr... 0x5b7481b0, 0x5b7480b0
Caught exception in looking up space point ptr... 0x5b7480b0, 0x55c293c0
Caught exception in looking up space point ptr... 0x55c293c0, 0x5b7480b0
Caught exception in looking up space point ptr... 0x5b7480b0, 0x4e307d40
Caught exception in looking up space point ptr... 0x4e307d40, 0x5b7480b0
Caught exception in looking up space point ptr... 0x5e7b7630, 0x26d75e20
Caught exception in looking up space point ptr... 0x26d75e20, 0x5e7b7630
Caught exception in looking up space point ptr... 0x637ee430, 0x4eca0f60
Caught exception in looking up space point ptr... 0x4eca0f60, 0x637ee430
Caught exception in looking up space point ptr... 0x325f2070, 0x86fe1600
Caught exception in looking up space point ptr... 0x86fe1600, 0x325f2070
Caught exception in looking up space point ptr... 0x6b3b0ff0, 0x69c78dc0
Caught exception in looking up space point ptr... 0x69c78dc0, 0x6b3b0ff0
Caught exception in looking up space point ptr... 0x2cf1abb0, 0x537f9fa0
Caught exception in looking up space point ptr... 0x537f9fa0, 0x6176db80
Caught exception in looking up space point ptr... 0x5ac4f4c0, 0x5ac4f5c0
Caught exception in looking up space point ptr... 0x5ac4f5c0, 0x535d2ed0
Caught exception in looking up space point ptr... 0x6d4e7170, 0x71b8e0d0
Caught exception in looking up space point ptr... 0x71b8e0d0, 0x72225ec0
Caught exception in looking up space point ptr... 0x378b73f0, 0x31b64b30
Caught exception in looking up space point ptr... 0x4e392fb0, 0x378b73f0
Caught exception in looking up space point ptr... 0x31b63fb0, 0x31b64270
Caught exception in looking up space point ptr... 0x31b64960, 0x31b63fb0
Caught exception in looking up space point ptr... 0x31b661d0, 0x31b62550
Caught exception in looking up space point ptr... 0x35f4e470, 0x31b661d0
Caught exception in looking up space point ptr... 0x31b6ccf0, 0x31b60480
Caught exception in looking up space point ptr... 0x33327160, 0x31b6ccf0
Caught exception in looking up space point ptr... 0x35e9ffb0, 0x34c844b0
Caught exception in looking up space point ptr... 0x34c844b0, 0x35e9ffb0
Caught exception in looking up space point ptr... 0x60cebe30, 0x870ba080
Caught exception in looking up space point ptr... 0x870ba080, 0x2f270ff0
++++>>>> total num hits: 541359, num free: 532921
04-Feb-2026 01:45:15 UTC Closed output file "np02vd_raw_run042433_0262_df-s03-d0_dw_0_20260203T202142_reco_stage0_20260204T014515_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 231.494 298.737 354.38 316.866 40.8479 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000118071 0.00021946 0.000510446 0.000147281 0.000111878 19
produce:tpcrawdecoder:PDVDTPCReader 18.9105 21.1299 25.6264 20.1842 2.12926 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.708551 0.743805 0.850743 0.733868 0.0327054 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0233976 0.0321412 0.085828 0.023688 0.0186302 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0234128 0.023693 0.0251322 0.0235783 0.000411722 19
produce:beamevent:BeamEvent 0.000199862 0.000380305 0.00236036 0.000260343 0.000470672 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.11396 4.68344 5.68168 4.58765 0.410916 19
produce:ophit:OpHitFinder 0.0419435 0.0532779 0.064156 0.0537994 0.00512004 19
produce:wclsdatavd:WireCellToolkit 148.147 170.792 188.871 170.186 11.9948 19
produce:gaushit:GausHitFinder 2.03023 3.23012 4.42762 3.12004 0.655 19
produce:nhitsfilter:NumberOfHitsFilter 0.000494895 0.000668024 0.00117006 0.000623848 0.00014769 19
produce:reco3d:SpacePointSolver 19.9127 28.5294 40.7492 28.0988 5.70862 19
produce:hitpdune:DisambigFromSpacePoints 0.254594 0.458322 0.710905 0.46567 0.124277 19
produce:cluster3d:Cluster3D 2.78914 59.3349 94.3084 79.4035 37.9832 19
[art]:TriggerResults:TriggerResultInserter 3.8141e-05 6.89557e-05 0.000183642 5.9931e-05 3.22519e-05 19
end_path:out1:RootOutput 9.5e-06 1.78839e-05 4.9301e-05 1.2389e-05 1.06259e-05 19
end_path:out1:RootOutput(write) 6.6257 9.63389 11.224 10.2479 1.32282 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5747.13 MB
Peak resident set size usage (VmHWM): 3583.63 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0262_df-s03-d0_dw_0_20260203T202142_reco_stage0_20260204T014515_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0262_df-s03-d0_dw_0_20260203T202142_reco_stage0_20260204T014515_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0262_df-s03-d0_dw_0_20260203T202142_reco_stage0_20260204T014515_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163738.0,
"core.end_time": 1770169518.0,
"core.events": [
29876,
29882,
29888,
29894,
29900,
29906,
29912,
29918,
29924,
29930,
29936,
29942,
29948,
29954,
29960,
29966,
29972,
29978,
29984
],
"core.event_count": 19,
"core.first_event_number": 29876,
"core.last_event_number": 29984,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0262_df-s03-d0_dw_0_20260203T202142.hdf5"
}
]
} 