Jobsub ID 303654.121@dunegpschedd01.fnal.gov
| Jobsub ID | 303654.121@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 02:02:58 |
| From worker node | Hostname | dune001-1846109.0-lcg2695.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:09:46 |
| Input files | vd-protodune:np02vd_raw_run042433_0563_df-s02-d1_dw_0_20260203T221606.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6660s) |
| CPU time | 1h (6272s = 94%) |
| Max RSS bytes | 12773482496 (12181 MiB) |
| Outputting started | 2026-02-04 02:00:49 |
| Output files | |
| Finished | 2026-02-04 02:02:58 |
| Saved logs | justin-logs:303654.121-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
2ee3a0
Caught exception in looking up space point ptr... 0xb62ee3a0, 0xb62ee090
Caught exception in looking up space point ptr... 0xb62f1c10, 0xb62f2810
Caught exception in looking up space point ptr... 0xb62f2810, 0xb62f1e50
Caught exception in looking up space point ptr... 0x4b1ab260, 0xea6879e0
Caught exception in looking up space point ptr... 0xea6879e0, 0x4b1ab260
Caught exception in looking up space point ptr... 0x43f01550, 0x89119890
Caught exception in looking up space point ptr... 0x89119890, 0x43f01460
Caught exception in looking up space point ptr... 0x46db1d20, 0x46db2090
Caught exception in looking up space point ptr... 0x46db2090, 0x46db2400
Caught exception in looking up space point ptr... 0xe9a14b40, 0x160737c20
Caught exception in looking up space point ptr... 0x160737c20, 0xe9a14b40
Caught exception in looking up space point ptr... 0xe9a14b40, 0xebf16ad0
Caught exception in looking up space point ptr... 0xebf16ad0, 0xe9a14b40
Caught exception in looking up space point ptr... 0xcb063b30, 0xcb067950
Caught exception in looking up space point ptr... 0xcb067950, 0xcb067be0
Caught exception in looking up space point ptr... 0xb7dc58d0, 0xb7dc5d80
Caught exception in looking up space point ptr... 0xb7dc5d80, 0xb7dc58d0
Caught exception in looking up space point ptr... 0x7459c5f0, 0x7459c910
Caught exception in looking up space point ptr... 0x7459c910, 0xbc1ee5b0
Caught exception in looking up space point ptr... 0x9b45bda0, 0x9b45c110
Caught exception in looking up space point ptr... 0x9b45c110, 0x9b45bf30
Caught exception in looking up space point ptr... 0x9b45bf30, 0x9b45c2a0
Caught exception in looking up space point ptr... 0x9b45c2a0, 0x9b45c430
Caught exception in looking up space point ptr... 0x71ca2b10, 0xff76dcf0
Caught exception in looking up space point ptr... 0xff76dcf0, 0x71ca2b10
Caught exception in looking up space point ptr... 0x4289da50, 0x97f6e530
Caught exception in looking up space point ptr... 0x97f6e530, 0x49667100
Caught exception in looking up space point ptr... 0x16073c2e0, 0x16073e8a0
Caught exception in looking up space point ptr... 0x16073e8a0, 0x16073c2e0
Caught exception in looking up space point ptr... 0xb64b7eb0, 0xb64b7d60
Caught exception in looking up space point ptr... 0xb64b7d60, 0xb64b7eb0
Caught exception in looking up space point ptr... 0x13dd0fc00, 0x13dd0fab0
Caught exception in looking up space point ptr... 0x13dd0fab0, 0x13dd0fc00
Caught exception in looking up space point ptr... 0xebe7d470, 0xebe7f4e0
Caught exception in looking up space point ptr... 0xebe7f4e0, 0xebe7d470
Caught exception in looking up space point ptr... 0x896ccc60, 0x896cd220
Caught exception in looking up space point ptr... 0x896cbde0, 0x896ccc60
Caught exception in looking up space point ptr... 0x9507da30, 0x9507dd50
Caught exception in looking up space point ptr... 0x9507dd50, 0x9507dbc0
Caught exception in looking up space point ptr... 0x9507dbc0, 0x9507dee0
Caught exception in looking up space point ptr... 0x8a49a560, 0x4b0a2f20
Caught exception in looking up space point ptr... 0x4b0a2f20, 0x8a49a560
Caught exception in looking up space point ptr... 0x48776ad0, 0x91bf7400
Caught exception in looking up space point ptr... 0x91bf7400, 0x48776ad0
Caught exception in looking up space point ptr... 0x48776ad0, 0x52189530
Caught exception in looking up space point ptr... 0x52189530, 0x48776ad0
Caught exception in looking up space point ptr... 0x1126d37a0, 0x1126d35c0
Caught exception in looking up space point ptr... 0x1126d35c0, 0x1126d1440
Caught exception in looking up space point ptr... 0x6c47c660, 0x4abd1c60
Caught exception in looking up space point ptr... 0x4abd1c60, 0x4abd2440
Caught exception in looking up space point ptr... 0x6db92f90, 0xc21f3370
Caught exception in looking up space point ptr... 0xc21f3370, 0x6db92f90
Caught exception in looking up space point ptr... 0xcafb0c90, 0xcafb09b0
Caught exception in looking up space point ptr... 0xcafb0fb0, 0xcafb0c90
Caught exception in looking up space point ptr... 0xe98c88e0, 0xe98c8530
Caught exception in looking up space point ptr... 0xe98c8530, 0xe98be390
Caught exception in looking up space point ptr... 0x160761250, 0x160760f30
Caught exception in looking up space point ptr... 0x160760f30, 0x160761250
Caught exception in looking up space point ptr... 0xebe8c5a0, 0xebe8c410
Caught exception in looking up space point ptr... 0xebe8c410, 0xebe8c5a0
Caught exception in looking up space point ptr... 0xea7006d0, 0xea700540
Caught exception in looking up space point ptr... 0xea700540, 0xea7009f0
Caught exception in looking up space point ptr... 0x7a9de400, 0x7a9de650
Caught exception in looking up space point ptr... 0x7a9de650, 0x7a9bf080
Caught exception in looking up space point ptr... 0xbcfa27e0, 0xbcfa2aa0
Caught exception in looking up space point ptr... 0xbcfa2aa0, 0xbcfa27e0
++++>>>> total num hits: 85823, num free: 82478
04-Feb-2026 02:00:38 UTC Closed output file "np02vd_raw_run042433_0563_df-s02-d1_dw_0_20260203T221606_reco_stage0_20260204T020038_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 143.294 346.171 1247.24 162.626 332.854 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.6325e-05 0.000113792 0.000259581 9.949e-05 4.2989e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.0389 18.4025 21.2489 18.7819 1.73329 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.688157 0.714564 0.758389 0.714853 0.019502 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229771 0.0239089 0.03142 0.0233005 0.00186802 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229817 0.023262 0.02383 0.023252 0.000198908 19
produce:beamevent:BeamEvent 0.000111748 0.000242932 0.00136609 0.000191128 0.000267201 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.12932 3.57586 3.90781 3.6485 0.229723 19
produce:ophit:OpHitFinder 0.0339096 0.042198 0.0493615 0.0420294 0.00355275 19
produce:wclsdatavd:WireCellToolkit 90.6243 109.44 132.861 108.879 10.8499 19
produce:gaushit:GausHitFinder 0.662292 2.53551 8.77846 1.48741 2.30188 19
produce:nhitsfilter:NumberOfHitsFilter 0.000226511 0.000460309 0.00116951 0.000382015 0.00021893 19
produce:reco3d:SpacePointSolver 11.3754 38.3708 111.766 19.8219 35.6717 19
produce:hitpdune:DisambigFromSpacePoints 0.0983966 1.44172 5.83731 0.207636 2.12726 19
produce:cluster3d:Cluster3D 1.13212 162.638 948.766 2.66968 282.449 19
[art]:TriggerResults:TriggerResultInserter 3.2309e-05 5.0717e-05 0.000100411 3.9369e-05 2.09062e-05 19
end_path:out1:RootOutput 5.168e-06 1.17526e-05 2.8793e-05 9.745e-06 5.74828e-06 19
end_path:out1:RootOutput(write) 4.28798 8.87717 26.261 5.79313 5.9847 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 15280.6 MB
Peak resident set size usage (VmHWM): 12773.5 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0563_df-s02-d1_dw_0_20260203T221606_reco_stage0_20260204T020038_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0563_df-s02-d1_dw_0_20260203T221606_reco_stage0_20260204T020038_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0563_df-s02-d1_dw_0_20260203T221606_reco_stage0_20260204T020038_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163797.0,
"core.end_time": 1770170440.0,
"core.events": [
64189,
64195,
64201,
64207,
64213,
64219,
64225,
64231,
64237,
64243,
64249,
64255,
64261,
64267,
64273,
64279,
64285,
64291,
64297
],
"core.event_count": 19,
"core.first_event_number": 64189,
"core.last_event_number": 64297,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0563_df-s02-d1_dw_0_20260203T221606.hdf5"
}
]
} 