Jobsub ID 297921.137@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.137@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 02:19:57 |
| From worker node | Hostname | dune001-1842530.0-lcg2566.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:32 |
| Input files | vd-protodune:np02vd_raw_run042433_0037_df-s03-d1_dw_0_20260203T185611.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8414s) |
| CPU time | 2h (8054s = 95%) |
| Max RSS bytes | 11735535616 (11191 MiB) |
| Outputting started | 2026-02-04 02:16:52 |
| Output files | |
| Finished | 2026-02-04 02:19:57 |
| Saved logs | justin-logs:297921.137-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce point ptr... 0xac00e900, 0x3b0b4750
Caught exception in looking up space point ptr... 0x7c10c780, 0x90013730
Caught exception in looking up space point ptr... 0xc1414da0, 0x7c10c780
Caught exception in looking up space point ptr... 0x625c8830, 0x76d44fa0
Caught exception in looking up space point ptr... 0x76d44fa0, 0x739cab40
Caught exception in looking up space point ptr... 0x2e050560, 0x5b2f1140
Caught exception in looking up space point ptr... 0x5b2f1140, 0x2e1fc950
Caught exception in looking up space point ptr... 0x31029700, 0x85a761f0
Caught exception in looking up space point ptr... 0x85a761f0, 0x85a762f0
Caught exception in looking up space point ptr... 0xf22afe60, 0xf22af9b0
Caught exception in looking up space point ptr... 0xf22af9b0, 0xf22afe60
Caught exception in looking up space point ptr... 0x85835510, 0x6a4cd830
Caught exception in looking up space point ptr... 0x6a4cd830, 0x6a4ccf50
Caught exception in looking up space point ptr... 0x85a32640, 0x5709ed70
Caught exception in looking up space point ptr... 0x5709ed70, 0x85a32640
Caught exception in looking up space point ptr... 0x119925f00, 0x18c1882b0
Caught exception in looking up space point ptr... 0x18c1882b0, 0x119925f00
Caught exception in looking up space point ptr... 0x628c2920, 0x628c2640
Caught exception in looking up space point ptr... 0x628c2640, 0x628c2920
Caught exception in looking up space point ptr... 0xf832a5f0, 0x76847840
Caught exception in looking up space point ptr... 0x76847840, 0x76847a10
Caught exception in looking up space point ptr... 0x5b2cfc40, 0x5b2cf920
Caught exception in looking up space point ptr... 0x5b2cf920, 0x5b2cfdd0
Caught exception in looking up space point ptr... 0x3e0eae20, 0x3e0eb110
Caught exception in looking up space point ptr... 0x3e0eb110, 0x3e0eae20
Caught exception in looking up space point ptr... 0x608d52b0, 0x36c1eec0
Caught exception in looking up space point ptr... 0x36c1eec0, 0x608d52b0
Caught exception in looking up space point ptr... 0x7f104f20, 0x7f104e30
Caught exception in looking up space point ptr... 0x7f104e30, 0x7f104cf0
Caught exception in looking up space point ptr... 0x894f7ef0, 0x5c2c68b0
Caught exception in looking up space point ptr... 0x5c2c68b0, 0x5b7826b0
Caught exception in looking up space point ptr... 0x56373220, 0x3cfa3440
Caught exception in looking up space point ptr... 0x3cfa3440, 0x56373220
Caught exception in looking up space point ptr... 0x5c271040, 0x5c6bfc80
Caught exception in looking up space point ptr... 0x5c6bfc80, 0x5c6bfb80
Caught exception in looking up space point ptr... 0x857e4360, 0x6bf55cc0
Caught exception in looking up space point ptr... 0x6bf55cc0, 0x857e4360
Caught exception in looking up space point ptr... 0x563084d0, 0x9f94ce80
Caught exception in looking up space point ptr... 0x9f94ce80, 0x1504be2a0
Caught exception in looking up space point ptr... 0x53e3ae40, 0x75c47b60
Caught exception in looking up space point ptr... 0x75c47b60, 0x326325b0
Caught exception in looking up space point ptr... 0x30130970, 0x30130a40
Caught exception in looking up space point ptr... 0x30130a40, 0x30130970
Caught exception in looking up space point ptr... 0x76ae5480, 0x76ae51e0
Caught exception in looking up space point ptr... 0x76ae51e0, 0x76ae5480
Caught exception in looking up space point ptr... 0x3de40200, 0x30ca7760
Caught exception in looking up space point ptr... 0x30ca7760, 0x3de40200
Caught exception in looking up space point ptr... 0x3de40200, 0x5c2d5d80
Caught exception in looking up space point ptr... 0x5c2d5d80, 0x3de40200
Caught exception in looking up space point ptr... 0x85942b50, 0x859419c0
Caught exception in looking up space point ptr... 0x859419c0, 0x85942b50
Caught exception in looking up space point ptr... 0x681be700, 0x35b732f0
Caught exception in looking up space point ptr... 0x35b732f0, 0x681be700
Caught exception in looking up space point ptr... 0x39f8b880, 0x5aef58c0
Caught exception in looking up space point ptr... 0x5aef58c0, 0x39f8b880
Caught exception in looking up space point ptr... 0x7ab20830, 0x15d24aab0
Caught exception in looking up space point ptr... 0x15d24ad40, 0x7ab20830
Caught exception in looking up space point ptr... 0x89636950, 0x37847e60
Caught exception in looking up space point ptr... 0x37847e60, 0x89636950
Caught exception in looking up space point ptr... 0x3c206450, 0x53b35e10
Caught exception in looking up space point ptr... 0x53b35e10, 0x5ca51b10
Caught exception in looking up space point ptr... 0x36d2b520, 0x31336430
Caught exception in looking up space point ptr... 0x31336430, 0x7bfcc930
Caught exception in looking up space point ptr... 0xa98704d0, 0x3d083b40
Caught exception in looking up space point ptr... 0x3d083b40, 0xa98704d0
Caught exception in looking up space point ptr... 0x6a7b8430, 0x95b35bc0
Caught exception in looking up space point ptr... 0x95b35bc0, 0x6a7b8430
++++>>>> total num hits: 60617, num free: 57911
04-Feb-2026 02:16:34 UTC Closed output file "np02vd_raw_run042433_0037_df-s03-d1_dw_0_20260203T185611_reco_stage0_20260204T021634_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 190.955 436.608 1419.99 242.579 347.477 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000105371 0.000210059 0.000587156 0.000148642 0.000122396 19
produce:tpcrawdecoder:PDVDTPCReader 17.9991 18.863 20.1973 18.8081 0.484525 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.701274 0.746179 0.81235 0.749768 0.0241205 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0232427 0.0276801 0.0685463 0.023604 0.0104132 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0232199 0.0234819 0.0241604 0.0234668 0.000191609 19
produce:beamevent:BeamEvent 0.000127951 0.000319832 0.0017775 0.000237813 0.000349546 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.00239 4.76876 5.6745 4.77367 0.5047 19
produce:ophit:OpHitFinder 0.0465526 0.0565417 0.0681201 0.0561348 0.00470165 19
produce:wclsdatavd:WireCellToolkit 131.736 174.478 204.395 177.804 20.2464 19
produce:gaushit:GausHitFinder 1.4161 3.32583 8.05875 2.10559 2.03992 19
produce:nhitsfilter:NumberOfHitsFilter 0.000425705 0.000813206 0.00140465 0.000755028 0.000285632 19
produce:reco3d:SpacePointSolver 15.1581 44.2437 156.972 23.7904 36.2227 19
produce:hitpdune:DisambigFromSpacePoints 0.199707 1.61258 5.83908 0.357558 1.95155 19
produce:cluster3d:Cluster3D 2.04381 175.789 999.373 3.87633 296.76 19
[art]:TriggerResults:TriggerResultInserter 2.887e-05 7.95683e-05 0.000341604 5.8541e-05 6.77863e-05 19
end_path:out1:RootOutput 5.78e-06 2.30418e-05 0.000208262 9.74e-06 4.43159e-05 19
end_path:out1:RootOutput(write) 5.87412 12.5486 37.1123 8.41607 8.01548 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 14517.2 MB
Peak resident set size usage (VmHWM): 11735.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0037_df-s03-d1_dw_0_20260203T185611_reco_stage0_20260204T021634_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0037_df-s03-d1_dw_0_20260203T185611_reco_stage0_20260204T021634_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0037_df-s03-d1_dw_0_20260203T185611_reco_stage0_20260204T021634_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163006.0,
"core.end_time": 1770171398.0,
"core.events": [
4227,
4233,
4239,
4245,
4251,
4257,
4263,
4269,
4275,
4281,
4287,
4293,
4299,
4305,
4311,
4317,
4323,
4329,
4335
],
"core.event_count": 19,
"core.first_event_number": 4227,
"core.last_event_number": 4335,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0037_df-s03-d1_dw_0_20260203T185611.hdf5"
}
]
} 