Jobsub ID 297923.64@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.64@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce02 |
| Last heartbeat | 2026-02-04 03:02:51 |
| From worker node | Hostname | wn1206240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:58:54 |
| Input files | vd-protodune:np02vd_raw_run042433_0264_df-s04-d0_dw_0_20260203T202229.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (10826s) |
| CPU time | 1h (5815s = 53%) |
| Max RSS bytes | 3446464512 (3286 MiB) |
| Outputting started | 2026-02-04 02:59:22 |
| Output files | |
| Finished | 2026-02-04 03:02:51 |
| Saved logs | justin-logs:297923.64-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ptr... 0x785642d0, 0x7856e1b0
Caught exception in looking up space point ptr... 0x171697f0, 0x17169b10
Caught exception in looking up space point ptr... 0x17169b10, 0x6872f160
Caught exception in looking up space point ptr... 0x9a8d650, 0x9a8d3c0
Caught exception in looking up space point ptr... 0x9a8d3c0, 0x9a95750
Caught exception in looking up space point ptr... 0x80703c20, 0x36e71ca0
Caught exception in looking up space point ptr... 0x80703a90, 0x80703c20
Caught exception in looking up space point ptr... 0x2f515f60, 0x55854a40
Caught exception in looking up space point ptr... 0x55854a40, 0x558548b0
Caught exception in looking up space point ptr... 0x806d0990, 0x36e6d4c0
Caught exception in looking up space point ptr... 0x36e6d4c0, 0x36e6d330
Caught exception in looking up space point ptr... 0x104c7300, 0x104b1430
Caught exception in looking up space point ptr... 0x104c7170, 0x104c7300
Caught exception in looking up space point ptr... 0x104c6e50, 0x14359b90
Caught exception in looking up space point ptr... 0x14359b90, 0x14359a00
Caught exception in looking up space point ptr... 0x678d82b0, 0x678d7f40
Caught exception in looking up space point ptr... 0x678d7f40, 0x678d80d0
Caught exception in looking up space point ptr... 0x51210870, 0x51210d20
Caught exception in looking up space point ptr... 0x51210eb0, 0x51211040
Caught exception in looking up space point ptr... 0x51211040, 0x51210b90
Caught exception in looking up space point ptr... 0x51210a00, 0x51210870
Caught exception in looking up space point ptr... 0x689c8200, 0x689d5cc0
Caught exception in looking up space point ptr... 0x78d20dc0, 0x689c8200
Caught exception in looking up space point ptr... 0x7fe5740, 0x7ff6ef0
Caught exception in looking up space point ptr... 0x7fd3e00, 0x7fe5740
Caught exception in looking up space point ptr... 0x52448d50, 0x6b4f5560
Caught exception in looking up space point ptr... 0x52448ee0, 0x52448d50
Caught exception in looking up space point ptr... 0x1294f180, 0x2a29d2b0
Caught exception in looking up space point ptr... 0x1294f310, 0x1294f180
Caught exception in looking up space point ptr... 0x8d873ed0, 0x5a474680
Caught exception in looking up space point ptr... 0x1937ed50, 0x8d873ed0
Caught exception in looking up space point ptr... 0x73fbbda0, 0x72634150
Caught exception in looking up space point ptr... 0x72634150, 0x72628700
Caught exception in looking up space point ptr... 0x911a2ad0, 0x67eb49a0
Caught exception in looking up space point ptr... 0x67eb5460, 0x911a2ad0
Caught exception in looking up space point ptr... 0x178ca4d0, 0x178b8870
Caught exception in looking up space point ptr... 0x178b8870, 0x178ca660
Caught exception in looking up space point ptr... 0x78d06b00, 0x78d182b0
Caught exception in looking up space point ptr... 0x78d18440, 0x78d06b00
Caught exception in looking up space point ptr... 0x37506190, 0x37506c50
Caught exception in looking up space point ptr... 0x37506c50, 0x45802f50
Caught exception in looking up space point ptr... 0x655e5740, 0x2b44ecf0
Caught exception in looking up space point ptr... 0x2b44ecf0, 0x111e2330
Caught exception in looking up space point ptr... 0x105fdf30, 0x63e59360
Caught exception in looking up space point ptr... 0x63e59360, 0x63e598f0
Caught exception in looking up space point ptr... 0x4aeea980, 0x536095d0
Caught exception in looking up space point ptr... 0x536095d0, 0x536093f0
Caught exception in looking up space point ptr... 0x70374420, 0x160f7bc0
Caught exception in looking up space point ptr... 0x160f7bc0, 0x70374420
Caught exception in looking up space point ptr... 0x70374420, 0x70374200
Caught exception in looking up space point ptr... 0x70374200, 0x70374420
Caught exception in looking up space point ptr... 0x6551aee0, 0x162aaa30
Caught exception in looking up space point ptr... 0x162aaa30, 0x65578b20
Caught exception in looking up space point ptr... 0x176f9700, 0x176f9570
Caught exception in looking up space point ptr... 0x176f9570, 0x176f9700
Caught exception in looking up space point ptr... 0x14bc2db0, 0x655ae9b0
Caught exception in looking up space point ptr... 0x655ae9b0, 0x14bc2940
Caught exception in looking up space point ptr... 0x176f8f70, 0x176f8c80
Caught exception in looking up space point ptr... 0x176f8c80, 0x176f8580
Caught exception in looking up space point ptr... 0x176f8580, 0x176f8c80
Caught exception in looking up space point ptr... 0x176f8c80, 0x176f8dd0
Caught exception in looking up space point ptr... 0x2f43ec60, 0x2f43e670
Caught exception in looking up space point ptr... 0x2f43e670, 0x2f43ec60
Caught exception in looking up space point ptr... 0x4c815470, 0x4c815600
Caught exception in looking up space point ptr... 0x4c815600, 0x4c815920
Caught exception in looking up space point ptr... 0x6d4be310, 0x6d4be3e0
Caught exception in looking up space point ptr... 0x6d4be3e0, 0x6d4be5e0
++++>>>> total num hits: 528695, num free: 521594
04-Feb-2026 02:59:10 GMT Closed output file "np02vd_raw_run042433_0264_df-s04-d0_dw_0_20260203T202229_reco_stage0_20260204T025910_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 411.554 562.021 673.021 574.648 53.0745 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.2344e-05 0.000119281 0.000249699 0.000105047 3.55099e-05 19
produce:tpcrawdecoder:PDVDTPCReader 180.705 245.332 343.507 240.399 41.7308 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.722509 1.21718 2.0063 1.05397 0.354094 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0225434 0.0356823 0.115867 0.0267049 0.0226458 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0222718 0.0244924 0.0527915 0.0228714 0.0067138 19
produce:beamevent:BeamEvent 0.000105578 0.000205048 0.0012538 0.000137249 0.000250633 19
produce:pdvddaphne:DAPHNEReaderPDVD 15.2847 20.9697 28.4395 20.6413 3.10526 19
produce:ophit:OpHitFinder 0.0339606 0.0507507 0.0611026 0.0518203 0.0064505 19
produce:wclsdatavd:WireCellToolkit 139.2 180.111 206.728 183.203 14.7763 19
produce:gaushit:GausHitFinder 1.90333 3.51691 4.92501 3.62922 0.663137 19
produce:nhitsfilter:NumberOfHitsFilter 0.000417776 0.000539353 0.000870518 0.000515219 9.6446e-05 19
produce:reco3d:SpacePointSolver 16.0596 20.9636 27.9973 20.1892 3.01813 19
produce:hitpdune:DisambigFromSpacePoints 0.281879 0.458127 0.599226 0.456193 0.0875596 19
produce:cluster3d:Cluster3D 3.54614 78.7405 118.915 92.4121 33.8056 19
[art]:TriggerResults:TriggerResultInserter 2.4937e-05 4.81328e-05 0.000155042 3.5767e-05 3.70583e-05 19
end_path:out1:RootOutput 3.707e-06 7.20737e-06 3.4825e-05 5.12e-06 7.10815e-06 19
end_path:out1:RootOutput(write) 8.18246 10.5494 12.1259 10.8603 1.17732 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5536.26 MB
Peak resident set size usage (VmHWM): 3446.46 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0264_df-s04-d0_dw_0_20260203T202229_reco_stage0_20260204T025910_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0264_df-s04-d0_dw_0_20260203T202229_reco_stage0_20260204T025910_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0264_df-s04-d0_dw_0_20260203T202229_reco_stage0_20260204T025910_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163150.0,
"core.end_time": 1770173953.0,
"core.events": [
30106,
30112,
30118,
30124,
30130,
30136,
30142,
30148,
30154,
30160,
30166,
30172,
30178,
30184,
30190,
30196,
30202,
30208,
30214
],
"core.event_count": 19,
"core.first_event_number": 30106,
"core.last_event_number": 30214,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0264_df-s04-d0_dw_0_20260203T202229.hdf5"
}
]
} 