Jobsub ID 297921.39@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.39@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_Imperial |
| Entry | DUNE_T2_UK_London_IC_ceprod03 |
| Last heartbeat | 2026-02-04 01:07:58 |
| From worker node | Hostname | wm10.grid.hep.ph.ic.ac.uk |
| cpuinfo | AMD EPYC 7742 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:47:51 |
| Input files | vd-protodune:np02vd_raw_run042433_0055_df-s02-d1_dw_0_20260203T190301.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4636s) |
| CPU time | 1h (4113s = 88%) |
| Max RSS bytes | 3386626048 (3229 MiB) |
| Outputting started | 2026-02-04 01:05:09 |
| Output files | |
| Finished | 2026-02-04 01:07:58 |
| Saved logs | justin-logs:297921.39-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ing up space point ptr... 0x6a8ad4a0, 0x6a8a33a0
Caught exception in looking up space point ptr... 0x6a8a33a0, 0x6a8ad4a0
Caught exception in looking up space point ptr... 0x6770b230, 0x5342bd20
Caught exception in looking up space point ptr... 0x5342e040, 0x6770b230
Caught exception in looking up space point ptr... 0x18e42c50, 0x18e42930
Caught exception in looking up space point ptr... 0x18e42930, 0x18e42c50
Caught exception in looking up space point ptr... 0x7cbd57d0, 0x7cbd58d0
Caught exception in looking up space point ptr... 0x7cbd58d0, 0x7cbd57d0
Caught exception in looking up space point ptr... 0x523d0a50, 0x523d0bf0
Caught exception in looking up space point ptr... 0x523d0bf0, 0x523d0a50
Caught exception in looking up space point ptr... 0x523d0a50, 0x523d0d90
Caught exception in looking up space point ptr... 0x523d0d90, 0x523d0a50
Caught exception in looking up space point ptr... 0x6e7be4e0, 0x6e7c78d0
Caught exception in looking up space point ptr... 0x6e7c78d0, 0x6e7be4e0
Caught exception in looking up space point ptr... 0x17c3e560, 0x19949540
Caught exception in looking up space point ptr... 0x19949540, 0x4e1bab40
Caught exception in looking up space point ptr... 0x79396120, 0x79395fd0
Caught exception in looking up space point ptr... 0x79395fd0, 0x79395e30
Caught exception in looking up space point ptr... 0x4fcaed10, 0x4fcaebc0
Caught exception in looking up space point ptr... 0x4fcaebc0, 0x4fcaed10
Caught exception in looking up space point ptr... 0x4cdee340, 0x4cdf0cc0
Caught exception in looking up space point ptr... 0x4cdf0cc0, 0x4cde1a40
Caught exception in looking up space point ptr... 0x74150ae0, 0x74150f20
Caught exception in looking up space point ptr... 0x74150f20, 0x74150ae0
Caught exception in looking up space point ptr... 0x74150ae0, 0x74150d80
Caught exception in looking up space point ptr... 0x74150d80, 0x74150ae0
Caught exception in looking up space point ptr... 0x9498a50, 0x9497e80
Caught exception in looking up space point ptr... 0x9497e80, 0x9498a50
Caught exception in looking up space point ptr... 0x14613fd0, 0x2bb85ba0
Caught exception in looking up space point ptr... 0x2bb85ba0, 0x2bb85d30
Caught exception in looking up space point ptr... 0x7a1f9fe0, 0x610aaab0
Caught exception in looking up space point ptr... 0x610aaab0, 0x7a1fa0e0
Caught exception in looking up space point ptr... 0x18b84bf0, 0x18b7ced0
Caught exception in looking up space point ptr... 0x18b7ced0, 0x18b84bf0
Caught exception in looking up space point ptr... 0x7ecf5a00, 0x7ecf58b0
Caught exception in looking up space point ptr... 0x7ecf58b0, 0x7ecf5a00
Caught exception in looking up space point ptr... 0x10c6d920, 0x7554fa50
Caught exception in looking up space point ptr... 0x10c6ed90, 0x10c6d920
Caught exception in looking up space point ptr... 0x45836850, 0x5efc9d20
Caught exception in looking up space point ptr... 0x4582e240, 0x45836850
Caught exception in looking up space point ptr... 0x631b8580, 0x631a4940
Caught exception in looking up space point ptr... 0x631a4940, 0x12098200
Caught exception in looking up space point ptr... 0x3c18d480, 0x3c18ff30
Caught exception in looking up space point ptr... 0x3c18ff30, 0x3c18d480
Caught exception in looking up space point ptr... 0x18b91180, 0x18b90e60
Caught exception in looking up space point ptr... 0x18b90e60, 0x18b91180
Caught exception in looking up space point ptr... 0x2f43b6b0, 0x2f43b9d0
Caught exception in looking up space point ptr... 0x2f43b9d0, 0x2f43b6b0
Caught exception in looking up space point ptr... 0x10aa3450, 0x10aa24d0
Caught exception in looking up space point ptr... 0x10aa24d0, 0x10aaa350
Caught exception in looking up space point ptr... 0x4e1e99b0, 0x4e1df690
Caught exception in looking up space point ptr... 0x4e1df690, 0xffaab20
Caught exception in looking up space point ptr... 0x12bcf930, 0x12bcd1f0
Caught exception in looking up space point ptr... 0x12bcd1f0, 0x12bcb860
Caught exception in looking up space point ptr... 0x39b34800, 0x39b34300
Caught exception in looking up space point ptr... 0x39b34300, 0x39b34120
Caught exception in looking up space point ptr... 0x39b34120, 0x39b344e0
Caught exception in looking up space point ptr... 0x146c83b0, 0x7b70e220
Caught exception in looking up space point ptr... 0x7b70e220, 0x146c83b0
Caught exception in looking up space point ptr... 0x32c3b9e0, 0x7e3cabf0
Caught exception in looking up space point ptr... 0x7e3cabf0, 0x32c3eff0
Caught exception in looking up space point ptr... 0x5efe8f40, 0x5efeb720
Caught exception in looking up space point ptr... 0x5efeb720, 0x5efeb870
Caught exception in looking up space point ptr... 0x7ed19630, 0x7ed1d810
Caught exception in looking up space point ptr... 0x7ed1d810, 0x7ed1a1e0
Caught exception in looking up space point ptr... 0x60d7cbd0, 0x60d7cf40
Caught exception in looking up space point ptr... 0x60d7cf40, 0x60d7d120
++++>>>> total num hits: 131239, num free: 126421
04-Feb-2026 01:04:56 GMT Closed output file "np02vd_raw_run042433_0055_df-s02-d1_dw_0_20260203T190301_reco_stage0_20260204T010456_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 185.212 236.644 267.286 241.439 19.8824 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.906e-05 0.00013432 0.000285739 0.000104637 5.82738e-05 19
produce:tpcrawdecoder:PDVDTPCReader 13.6027 15.0018 16.533 14.9921 0.875041 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.483456 0.49569 0.512475 0.493344 0.00886718 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0162584 0.016639 0.0169767 0.0166415 0.00017639 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0161602 0.0166246 0.0169397 0.0166318 0.000231437 19
produce:beamevent:BeamEvent 0.000106901 0.000228648 0.00117293 0.000172015 0.000226682 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.85134 4.5063 4.8137 4.59938 0.261934 19
produce:ophit:OpHitFinder 0.0295825 0.0484499 0.0560415 0.0488311 0.00658513 19
produce:wclsdatavd:WireCellToolkit 132.747 173.166 189.322 179.302 15.5306 19
produce:gaushit:GausHitFinder 1.28028 2.27274 3.0916 2.31476 0.529472 19
produce:nhitsfilter:NumberOfHitsFilter 0.000393382 0.000585273 0.00155154 0.000511674 0.000253037 19
produce:reco3d:SpacePointSolver 17.5418 24.6367 40.5072 22.8135 6.25214 19
produce:hitpdune:DisambigFromSpacePoints 0.221731 0.363028 0.474661 0.334822 0.0703852 19
produce:cluster3d:Cluster3D 3.54105 5.86629 11.8326 5.47089 1.90736 19
[art]:TriggerResults:TriggerResultInserter 2.8644e-05 4.3269e-05 0.000117071 3.3593e-05 2.39138e-05 19
end_path:out1:RootOutput 9.979e-06 2.69461e-05 0.000274858 1.1852e-05 5.86606e-05 19
end_path:out1:RootOutput(write) 8.28534 10.2084 11.4553 10.1624 0.982438 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5315.85 MB
Peak resident set size usage (VmHWM): 3386.63 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0055_df-s02-d1_dw_0_20260203T190301_reco_stage0_20260204T010456_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0055_df-s02-d1_dw_0_20260203T190301_reco_stage0_20260204T010456_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0055_df-s02-d1_dw_0_20260203T190301_reco_stage0_20260204T010456_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162489.0,
"core.end_time": 1770167099.0,
"core.events": [
6277,
6283,
6289,
6295,
6301,
6307,
6313,
6319,
6325,
6331,
6337,
6343,
6349,
6355,
6361,
6367,
6373,
6379,
6385
],
"core.event_count": 19,
"core.first_event_number": 6277,
"core.last_event_number": 6385,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0055_df-s02-d1_dw_0_20260203T190301.hdf5"
}
]
} 