Jobsub ID 297923.107@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.107@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:56:24 |
| From worker node | Hostname | dune002-1603823.0-lcg2717.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:02:46 |
| Input files | vd-protodune:np02vd_raw_run042433_0054_df-s03-d1_dw_0_20260203T190239.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3121s) |
| CPU time | 46m (2764s = 88%) |
| Max RSS bytes | 3434143744 (3275 MiB) |
| Outputting started | 2026-02-04 00:54:49 |
| Output files | |
| Finished | 2026-02-04 00:56:24 |
| Saved logs | justin-logs:297923.107-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ing up space point ptr... 0x86c75900, 0x86c75a00
Caught exception in looking up space point ptr... 0x12faf030, 0x12faeea0
Caught exception in looking up space point ptr... 0x12faeea0, 0x12faf030
Caught exception in looking up space point ptr... 0x5393a520, 0x5392f950
Caught exception in looking up space point ptr... 0x5392eff0, 0x5393a520
Caught exception in looking up space point ptr... 0x87b2d080, 0x363290f0
Caught exception in looking up space point ptr... 0x363290f0, 0x87b2d080
Caught exception in looking up space point ptr... 0x363be1c0, 0x363b70a0
Caught exception in looking up space point ptr... 0x363b70a0, 0x363be1c0
Caught exception in looking up space point ptr... 0x5d7f8ad0, 0x5d7f8e90
Caught exception in looking up space point ptr... 0x5d7f8e90, 0x5d7f8ad0
Caught exception in looking up space point ptr... 0x5d7f8ad0, 0x5d7f8cb0
Caught exception in looking up space point ptr... 0x5d7f8cb0, 0x5d7f8ad0
Caught exception in looking up space point ptr... 0x32ee7da0, 0x67795a10
Caught exception in looking up space point ptr... 0x67795a10, 0x32ee7da0
Caught exception in looking up space point ptr... 0x32ee7da0, 0x67795b10
Caught exception in looking up space point ptr... 0x67795b10, 0x32ee7da0
Caught exception in looking up space point ptr... 0x14040b30, 0x14040d10
Caught exception in looking up space point ptr... 0x14040d10, 0x14040ea0
Caught exception in looking up space point ptr... 0x67cd21f0, 0x16fda7d0
Caught exception in looking up space point ptr... 0x16fda7d0, 0x3f747550
Caught exception in looking up space point ptr... 0x3f747550, 0x56468270
Caught exception in looking up space point ptr... 0x40159d40, 0x40159f00
Caught exception in looking up space point ptr... 0x50e932a0, 0x40159d40
Caught exception in looking up space point ptr... 0x12b3bc20, 0x12b3b980
Caught exception in looking up space point ptr... 0x12b3b980, 0x12b3bc20
Caught exception in looking up space point ptr... 0x1b4ef270, 0x1b4ef0e0
Caught exception in looking up space point ptr... 0x1b4ef0e0, 0x1b4ef270
Caught exception in looking up space point ptr... 0x140962b0, 0x4b9eedc0
Caught exception in looking up space point ptr... 0x4b9eedc0, 0x140962b0
Caught exception in looking up space point ptr... 0x74276bb0, 0x7427b8c0
Caught exception in looking up space point ptr... 0x7427b8c0, 0x74276bb0
Caught exception in looking up space point ptr... 0x74276bb0, 0x7427bf80
Caught exception in looking up space point ptr... 0x7427bf80, 0x74276bb0
Caught exception in looking up space point ptr... 0x12e242d0, 0x12e24440
Caught exception in looking up space point ptr... 0x12e24440, 0x12e245d0
Caught exception in looking up space point ptr... 0x78633ec0, 0x78633d90
Caught exception in looking up space point ptr... 0x78633d90, 0x78633c60
Caught exception in looking up space point ptr... 0x63a4a200, 0x63a54260
Caught exception in looking up space point ptr... 0x63a54260, 0x63a573a0
Caught exception in looking up space point ptr... 0x38a3e9d0, 0x38a3eb80
Caught exception in looking up space point ptr... 0x38a3eb80, 0x38a3e9d0
Caught exception in looking up space point ptr... 0x63a3dba0, 0x63a3f4a0
Caught exception in looking up space point ptr... 0x63a3f4a0, 0x63a3c7a0
Caught exception in looking up space point ptr... 0x42b24350, 0x42b21830
Caught exception in looking up space point ptr... 0x42b21830, 0x42b21670
Caught exception in looking up space point ptr... 0x1ee08540, 0x6cecf730
Caught exception in looking up space point ptr... 0x6cecf730, 0x443c54c0
Caught exception in looking up space point ptr... 0x686e5020, 0x686e4ed0
Caught exception in looking up space point ptr... 0x686e4ed0, 0x686e4c30
Caught exception in looking up space point ptr... 0x86b40f20, 0x61a806f0
Caught exception in looking up space point ptr... 0x86b44af0, 0x86b40f20
Caught exception in looking up space point ptr... 0x1c1dda30, 0x1c1dd8a0
Caught exception in looking up space point ptr... 0x1c1dd8a0, 0x1c1dda30
Caught exception in looking up space point ptr... 0x3c56b800, 0x3c56b980
Caught exception in looking up space point ptr... 0x3c565aa0, 0x3c56b800
Caught exception in looking up space point ptr... 0x3c278860, 0x3c279700
Caught exception in looking up space point ptr... 0x3c279700, 0x3c278860
Caught exception in looking up space point ptr... 0x1f1b1670, 0x1f1b12b0
Caught exception in looking up space point ptr... 0x1f1b12b0, 0x1f1b0a40
Caught exception in looking up space point ptr... 0x69b6ebd0, 0x69b6ea40
Caught exception in looking up space point ptr... 0x69b6ea40, 0x69b6ebd0
Caught exception in looking up space point ptr... 0xe1f9d40, 0xe1f9e10
Caught exception in looking up space point ptr... 0xe1f9e10, 0x3fa12430
Caught exception in looking up space point ptr... 0x3fa12430, 0x44cef110
Caught exception in looking up space point ptr... 0x870fb1d0, 0x870fc480
Caught exception in looking up space point ptr... 0x870fc480, 0x870fb1d0
++++>>>> total num hits: 81012, num free: 77752
04-Feb-2026 00:54:39 UTC Closed output file "np02vd_raw_run042433_0054_df-s03-d1_dw_0_20260203T190239_reco_stage0_20260204T005439_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 130.554 160.128 184.742 161.632 13.8264 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.8027e-05 9.51084e-05 0.000244617 8.697e-05 3.53944e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.2328 19.1026 23.1863 18.937 1.84605 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.692457 0.779407 0.887771 0.782836 0.0457243 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230624 0.0266482 0.0354534 0.023328 0.00441639 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0228912 0.0249061 0.0555401 0.0232194 0.00722266 19
produce:beamevent:BeamEvent 0.000109024 0.000217313 0.000986661 0.00017334 0.000183553 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.26919 3.65471 4.40981 3.64777 0.309152 19
produce:ophit:OpHitFinder 0.0314828 0.0408291 0.0471427 0.0408485 0.00442721 19
produce:wclsdatavd:WireCellToolkit 82.702 107.824 122.983 108.984 10.2245 19
produce:gaushit:GausHitFinder 0.636821 1.41182 2.35457 1.50016 0.412987 19
produce:nhitsfilter:NumberOfHitsFilter 0.0001666 0.000360773 0.000627813 0.000347402 0.000125898 19
produce:reco3d:SpacePointSolver 6.91826 18.4671 33.8043 17.9119 6.84126 19
produce:hitpdune:DisambigFromSpacePoints 0.0682139 0.219466 0.419656 0.221403 0.0714058 19
produce:cluster3d:Cluster3D 1.08077 3.18783 5.99528 2.93544 1.18213 19
[art]:TriggerResults:TriggerResultInserter 2.5819e-05 4.07812e-05 0.000114452 3.1347e-05 2.49099e-05 19
end_path:out1:RootOutput 3.885e-06 2.57845e-05 0.000329485 8.182e-06 7.18287e-05 19
end_path:out1:RootOutput(write) 3.74592 5.33082 6.48888 5.789 0.883991 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5750.48 MB
Peak resident set size usage (VmHWM): 3434.14 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0054_df-s03-d1_dw_0_20260203T190239_reco_stage0_20260204T005439_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0054_df-s03-d1_dw_0_20260203T190239_reco_stage0_20260204T005439_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0054_df-s03-d1_dw_0_20260203T190239_reco_stage0_20260204T005439_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163377.0,
"core.end_time": 1770166480.0,
"core.events": [
6165,
6171,
6177,
6183,
6189,
6195,
6201,
6207,
6213,
6219,
6225,
6231,
6237,
6243,
6249,
6255,
6261,
6267,
6273
],
"core.event_count": 19,
"core.first_event_number": 6165,
"core.last_event_number": 6273,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0054_df-s03-d1_dw_0_20260203T190239.hdf5"
}
]
} 