Jobsub ID 297921.72@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.72@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 01:13:58 |
| From worker node | Hostname | dune001-1845214.0-lcg2570.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:51:49 |
| Input files | vd-protodune:np02vd_raw_run042433_0602_df-s02-d1_dw_0_20260203T223055.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4785s) |
| CPU time | 1h (4388s = 91%) |
| Max RSS bytes | 3387817984 (3230 MiB) |
| Outputting started | 2026-02-04 01:11:36 |
| Output files | |
| Finished | 2026-02-04 01:13:58 |
| Saved logs | justin-logs:297921.72-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
.. 0xa51005a0, 0x756c3a80
Caught exception in looking up space point ptr... 0x756c3a80, 0xa51005a0
Caught exception in looking up space point ptr... 0x9e8c8eb0, 0x9e8c91d0
Caught exception in looking up space point ptr... 0x6e31e270, 0x9e8c8eb0
Caught exception in looking up space point ptr... 0xa25086c0, 0xa2508c00
Caught exception in looking up space point ptr... 0xa2508c00, 0xa25086c0
Caught exception in looking up space point ptr... 0x46159a00, 0x461590d0
Caught exception in looking up space point ptr... 0x46158580, 0x46159a00
Caught exception in looking up space point ptr... 0xb9c89ec0, 0x85c2d140
Caught exception in looking up space point ptr... 0x85c2d140, 0xb9c89ec0
Caught exception in looking up space point ptr... 0x6791f270, 0x649e9be0
Caught exception in looking up space point ptr... 0x649e9be0, 0x6791f270
Caught exception in looking up space point ptr... 0x86cc64e0, 0x5e52bb00
Caught exception in looking up space point ptr... 0x5e52bb00, 0x86cc64e0
Caught exception in looking up space point ptr... 0x612aa7b0, 0x65db34e0
Caught exception in looking up space point ptr... 0x65db34e0, 0x685fbb90
Caught exception in looking up space point ptr... 0x868d9980, 0x3caee590
Caught exception in looking up space point ptr... 0x3caee590, 0x8ccaf630
Caught exception in looking up space point ptr... 0x611327c0, 0x61132690
Caught exception in looking up space point ptr... 0x61132690, 0x611322b0
Caught exception in looking up space point ptr... 0x677df040, 0x677c6f50
Caught exception in looking up space point ptr... 0x677cd550, 0x677cd2f0
Caught exception in looking up space point ptr... 0x677cd2f0, 0x677df360
Caught exception in looking up space point ptr... 0x677df360, 0x677df040
Caught exception in looking up space point ptr... 0x47ccff60, 0x97624d90
Caught exception in looking up space point ptr... 0x97624d90, 0x47ccff60
Caught exception in looking up space point ptr... 0x42d9d950, 0x82d20e20
Caught exception in looking up space point ptr... 0x82d20e20, 0x42d9d950
Caught exception in looking up space point ptr... 0xb7e9db70, 0xb7e9da70
Caught exception in looking up space point ptr... 0xb7e9da70, 0xb7e9db70
Caught exception in looking up space point ptr... 0x85789100, 0x89112160
Caught exception in looking up space point ptr... 0x89112160, 0x4204f190
Caught exception in looking up space point ptr... 0x8734fd20, 0x65cc10b0
Caught exception in looking up space point ptr... 0x65cc10b0, 0xa3aec120
Caught exception in looking up space point ptr... 0x82d2ee60, 0x7078e8a0
Caught exception in looking up space point ptr... 0x7078e8a0, 0x7851a9a0
Caught exception in looking up space point ptr... 0xba230070, 0x3e1d64b0
Caught exception in looking up space point ptr... 0x3e1d64b0, 0xba230070
Caught exception in looking up space point ptr... 0x42d79ca0, 0x88aea090
Caught exception in looking up space point ptr... 0x88aea090, 0x42d79ca0
Caught exception in looking up space point ptr... 0x86f92ab0, 0x86f92920
Caught exception in looking up space point ptr... 0x86f92920, 0x86f92600
Caught exception in looking up space point ptr... 0xb0a3dcb0, 0xb0a3db20
Caught exception in looking up space point ptr... 0xb0a3db20, 0xb0a3dcb0
Caught exception in looking up space point ptr... 0x6889a920, 0xa089eea0
Caught exception in looking up space point ptr... 0xa089eea0, 0x8f646b80
Caught exception in looking up space point ptr... 0x8f646b80, 0x762cfe60
Caught exception in looking up space point ptr... 0x92a14750, 0x8adde770
Caught exception in looking up space point ptr... 0x8adde770, 0x92a14570
Caught exception in looking up space point ptr... 0x90e7e6f0, 0x90e7eb90
Caught exception in looking up space point ptr... 0x90e7eb90, 0x90e7ede0
Caught exception in looking up space point ptr... 0x687c3f40, 0x67c2c590
Caught exception in looking up space point ptr... 0x67c2c590, 0x687c3f40
Caught exception in looking up space point ptr... 0x90e6b5a0, 0x90e67710
Caught exception in looking up space point ptr... 0x90e67710, 0x90e6b5a0
Caught exception in looking up space point ptr... 0x88ce2d80, 0x7bd63200
Caught exception in looking up space point ptr... 0x7bd63200, 0x88ce2d80
Caught exception in looking up space point ptr... 0x7d43a3e0, 0xa88addb0
Caught exception in looking up space point ptr... 0xa88addb0, 0x7d43a3e0
Caught exception in looking up space point ptr... 0x434d63f0, 0xafe61940
Caught exception in looking up space point ptr... 0xafe61940, 0x434d63f0
Caught exception in looking up space point ptr... 0x434d63f0, 0x652b5290
Caught exception in looking up space point ptr... 0x652b5290, 0x434d63f0
Caught exception in looking up space point ptr... 0x434d63f0, 0x49262f80
Caught exception in looking up space point ptr... 0x49262f80, 0x434d63f0
Caught exception in looking up space point ptr... 0x48d2e580, 0x49945820
Caught exception in looking up space point ptr... 0x49945820, 0x48d2e580
++++>>>> total num hits: 72119, num free: 68798
04-Feb-2026 01:11:24 UTC Closed output file "np02vd_raw_run042433_0602_df-s02-d1_dw_0_20260203T223055_reco_stage0_20260204T011124_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 203.091 245.508 273.804 250.888 20.8085 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000112092 0.000206862 0.000368608 0.000146303 9.84841e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.9527 23.2548 29.3028 22.6643 3.18051 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.692258 0.704343 0.731166 0.697488 0.0125135 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0233748 0.023573 0.0243623 0.023538 0.000215998 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0232788 0.0236824 0.0241774 0.0235727 0.000278206 19
produce:beamevent:BeamEvent 0.000203124 0.000381953 0.00159248 0.000340477 0.000293344 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.3407 4.96267 5.35233 4.98838 0.227005 19
produce:ophit:OpHitFinder 0.0283165 0.0513431 0.0656194 0.0520629 0.00780552 19
produce:wclsdatavd:WireCellToolkit 133.368 167.724 185.463 171.321 14.4364 19
produce:gaushit:GausHitFinder 1.57093 2.26264 3.76254 2.12913 0.522962 19
produce:nhitsfilter:NumberOfHitsFilter 0.00047421 0.000615297 0.000865187 0.000608622 0.000106932 19
produce:reco3d:SpacePointSolver 21.2469 33.4181 49.1388 31.657 8.92674 19
produce:hitpdune:DisambigFromSpacePoints 0.212345 0.345818 0.571078 0.328536 0.0979976 19
produce:cluster3d:Cluster3D 2.11294 4.28802 8.20039 4.25649 1.46315 19
[art]:TriggerResults:TriggerResultInserter 3.0011e-05 5.54501e-05 0.000212544 4.1101e-05 3.9326e-05 19
end_path:out1:RootOutput 5.641e-06 1.2517e-05 5.5651e-05 9.52e-06 1.07552e-05 19
end_path:out1:RootOutput(write) 6.16716 8.3683 9.75608 8.68227 1.00144 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5580.6 MB
Peak resident set size usage (VmHWM): 3387.82 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0602_df-s02-d1_dw_0_20260203T223055_reco_stage0_20260204T011124_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0602_df-s02-d1_dw_0_20260203T223055_reco_stage0_20260204T011124_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0602_df-s02-d1_dw_0_20260203T223055_reco_stage0_20260204T011124_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162726.0,
"core.end_time": 1770167487.0,
"core.events": [
68635,
68641,
68647,
68653,
68659,
68665,
68671,
68677,
68683,
68689,
68695,
68701,
68707,
68713,
68719,
68725,
68731,
68737,
68743
],
"core.event_count": 19,
"core.first_event_number": 68635,
"core.last_event_number": 68743,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0602_df-s02-d1_dw_0_20260203T223055.hdf5"
}
]
} 