Jobsub ID 297923.35@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.35@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 00:54:19 |
| From worker node | Hostname | dune001-1527530.0-lcg2699.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:59:17 |
| Input files | vd-protodune:np02vd_raw_run042433_0359_df-s03-d1_dw_0_20260203T205833.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 53m (3205s) |
| CPU time | 47m (2848s = 88%) |
| Max RSS bytes | 3405291520 (3247 MiB) |
| Outputting started | 2026-02-04 00:52:43 |
| Output files | |
| Finished | 2026-02-04 00:54:19 |
| Saved logs | justin-logs:297923.35-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x722e1990, 0x5442a970
Caught exception in looking up space point ptr... 0x32d39230, 0x306a3c50
Caught exception in looking up space point ptr... 0x306a3c50, 0x72de22e0
Caught exception in looking up space point ptr... 0x29395410, 0x29394dd0
Caught exception in looking up space point ptr... 0x29394c40, 0x29394ab0
Caught exception in looking up space point ptr... 0x29394ab0, 0x5a939a10
Caught exception in looking up space point ptr... 0x5a939a10, 0x77795910
Caught exception in looking up space point ptr... 0x77795910, 0x29395410
Caught exception in looking up space point ptr... 0x2d9f55f0, 0xa2de6930
Caught exception in looking up space point ptr... 0x524d7980, 0x2d9f55f0
Caught exception in looking up space point ptr... 0x7c85a9d0, 0x308b8530
Caught exception in looking up space point ptr... 0x2eeb3cc0, 0x7c85a9d0
Caught exception in looking up space point ptr... 0x7a3c8110, 0x7a3c7f80
Caught exception in looking up space point ptr... 0x7a3c7f80, 0x7a3c7c60
Caught exception in looking up space point ptr... 0x7a3c7c60, 0x7a3c82a0
Caught exception in looking up space point ptr... 0x7a3c82a0, 0x7a3c8750
Caught exception in looking up space point ptr... 0x7a3c8750, 0x7a3c8110
Caught exception in looking up space point ptr... 0x366160f0, 0x56338560
Caught exception in looking up space point ptr... 0x56338560, 0x7db09b50
Caught exception in looking up space point ptr... 0x7db09b50, 0x56338560
Caught exception in looking up space point ptr... 0x56338560, 0x5cc79a40
Caught exception in looking up space point ptr... 0x33c42ec0, 0x7798c8d0
Caught exception in looking up space point ptr... 0x7798c8d0, 0x26528fb0
Caught exception in looking up space point ptr... 0x26528fb0, 0x563c35a0
Caught exception in looking up space point ptr... 0x563c35a0, 0x298116b0
Caught exception in looking up space point ptr... 0x60144ee0, 0x60144b50
Caught exception in looking up space point ptr... 0x60144b50, 0x60145270
Caught exception in looking up space point ptr... 0x2f409c30, 0x2f409910
Caught exception in looking up space point ptr... 0x2f409910, 0x2f41a700
Caught exception in looking up space point ptr... 0x777929f0, 0x77792b80
Caught exception in looking up space point ptr... 0x77792b80, 0x777929f0
Caught exception in looking up space point ptr... 0x777929f0, 0x72de4360
Caught exception in looking up space point ptr... 0x72de4360, 0x777929f0
Caught exception in looking up space point ptr... 0x25992590, 0x25997350
Caught exception in looking up space point ptr... 0x25977ed0, 0x25992590
Caught exception in looking up space point ptr... 0x569e94a0, 0x5a93f0f0
Caught exception in looking up space point ptr... 0x5a93f0f0, 0xa2e48fb0
Caught exception in looking up space point ptr... 0x5440de10, 0x5440e100
Caught exception in looking up space point ptr... 0x5440e100, 0x5440db20
Caught exception in looking up space point ptr... 0x8a726bd0, 0x8a726a30
Caught exception in looking up space point ptr... 0x8a726a30, 0x8a726bd0
Caught exception in looking up space point ptr... 0x7a3cf970, 0x3096c220
Caught exception in looking up space point ptr... 0x7174e2e0, 0x7a3d8500
Caught exception in looking up space point ptr... 0x7a3d8500, 0x7a3ca710
Caught exception in looking up space point ptr... 0x7a3ca710, 0x7a3cf970
Caught exception in looking up space point ptr... 0x4e159390, 0x259963a0
Caught exception in looking up space point ptr... 0x259963a0, 0x4e159390
Caught exception in looking up space point ptr... 0x30795da0, 0x66d20c10
Caught exception in looking up space point ptr... 0x66d20c10, 0x30795da0
Caught exception in looking up space point ptr... 0x30795da0, 0x4f381870
Caught exception in looking up space point ptr... 0x4f381870, 0x30795da0
Caught exception in looking up space point ptr... 0x30795da0, 0x32a67110
Caught exception in looking up space point ptr... 0x32a67110, 0x30795da0
Caught exception in looking up space point ptr... 0x574ea950, 0x3119a290
Caught exception in looking up space point ptr... 0x3119a290, 0x574ea950
Caught exception in looking up space point ptr... 0x2985bdc0, 0x2985c050
Caught exception in looking up space point ptr... 0x5a39fdc0, 0x2985bdc0
Caught exception in looking up space point ptr... 0x2b1e0100, 0x7b262150
Caught exception in looking up space point ptr... 0x7b262150, 0x2b1e0100
Caught exception in looking up space point ptr... 0x54408470, 0x54407d10
Caught exception in looking up space point ptr... 0x54407d10, 0x54407980
Caught exception in looking up space point ptr... 0x4e6b7f20, 0x4e6b8300
Caught exception in looking up space point ptr... 0x4e6b8300, 0x4e6b7f20
Caught exception in looking up space point ptr... 0x456fc250, 0x2543a0d0
Caught exception in looking up space point ptr... 0x2543a0d0, 0x456fc250
Caught exception in looking up space point ptr... 0x5747e9f0, 0x74159e00
Caught exception in looking up space point ptr... 0x74159e00, 0x5747e9f0
++++>>>> total num hits: 75418, num free: 72391
04-Feb-2026 00:52:36 UTC Closed output file "np02vd_raw_run042433_0359_df-s03-d1_dw_0_20260203T205833_reco_stage0_20260204T005236_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 142.789 164.494 197.064 163.817 12.525 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9164e-05 0.000196826 0.00129934 0.000106541 0.000264985 19
produce:tpcrawdecoder:PDVDTPCReader 17.1802 19.3434 20.3048 19.7005 0.879091 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.684125 0.700434 0.737607 0.692419 0.0151838 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229621 0.0233247 0.0242912 0.0232489 0.000318655 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0228456 0.0232999 0.0245523 0.0231593 0.000389041 19
produce:beamevent:BeamEvent 9.8469e-05 0.000230438 0.0010696 0.000194713 0.000202426 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.25662 3.62016 3.83099 3.65626 0.17922 19
produce:ophit:OpHitFinder 0.0351932 0.0419379 0.0462509 0.0426133 0.00289514 19
produce:wclsdatavd:WireCellToolkit 93.0015 111.394 121.77 113.279 8.90622 19
produce:gaushit:GausHitFinder 0.826734 1.46741 2.27927 1.26455 0.385809 19
produce:nhitsfilter:NumberOfHitsFilter 0.000202174 0.000347323 0.000698803 0.000319401 0.000121367 19
produce:reco3d:SpacePointSolver 10.8313 19.2081 37.0535 17.2894 6.73331 19
produce:hitpdune:DisambigFromSpacePoints 0.139688 0.221095 0.366069 0.198644 0.0649668 19
produce:cluster3d:Cluster3D 1.71097 2.85993 5.76742 2.61752 1.06247 19
[art]:TriggerResults:TriggerResultInserter 2.8613e-05 4.14767e-05 0.000111728 3.6115e-05 1.7743e-05 19
end_path:out1:RootOutput 5.939e-06 1.01757e-05 2.689e-05 9.644e-06 4.24966e-06 19
end_path:out1:RootOutput(write) 4.11267 5.5314 6.62703 5.71407 0.742848 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5645.21 MB
Peak resident set size usage (VmHWM): 3405.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0359_df-s03-d1_dw_0_20260203T205833_reco_stage0_20260204T005236_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0359_df-s03-d1_dw_0_20260203T205833_reco_stage0_20260204T005236_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0359_df-s03-d1_dw_0_20260203T205833_reco_stage0_20260204T005236_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163168.0,
"core.end_time": 1770166357.0,
"core.events": [
40935,
40941,
40947,
40953,
40959,
40965,
40971,
40977,
40983,
40989,
40995,
41001,
41007,
41013,
41019,
41025,
41031,
41037,
41043
],
"core.event_count": 19,
"core.first_event_number": 40935,
"core.last_event_number": 41043,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0359_df-s03-d1_dw_0_20260203T205833.hdf5"
}
]
} 