Jobsub ID 297921.120@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.120@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:50:00 |
| From worker node | Hostname | dune002-1603634.0-lcg2704.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:36 |
| Input files | vd-protodune:np02vd_raw_run042433_0395_df-s04-d0_dw_0_20260203T211215.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 51m (3078s) |
| CPU time | 46m (2773s = 90%) |
| Max RSS bytes | 3425812480 (3267 MiB) |
| Outputting started | 2026-02-04 00:47:56 |
| Output files | |
| Finished | 2026-02-04 00:50:00 |
| Saved logs | justin-logs:297921.120-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
r... 0x864ba240, 0x864bef70
Caught exception in looking up space point ptr... 0x864bef70, 0x864bf100
Caught exception in looking up space point ptr... 0x864bf100, 0x864bf290
Caught exception in looking up space point ptr... 0x864bf290, 0x864c2c50
Caught exception in looking up space point ptr... 0x8a7b8990, 0x8a7b8ae0
Caught exception in looking up space point ptr... 0x8a7b8ae0, 0x8a7b8c30
Caught exception in looking up space point ptr... 0x5dbec7b0, 0x5dbecec0
Caught exception in looking up space point ptr... 0x5dbecec0, 0x5dbed450
Caught exception in looking up space point ptr... 0x8a988770, 0x1b7b0d70
Caught exception in looking up space point ptr... 0x1b7b0d70, 0x70326a60
Caught exception in looking up space point ptr... 0x468a1390, 0x459524b0
Caught exception in looking up space point ptr... 0x459524b0, 0x468a1390
Caught exception in looking up space point ptr... 0x38af54d0, 0x38af53a0
Caught exception in looking up space point ptr... 0x38af53a0, 0x38af54d0
Caught exception in looking up space point ptr... 0x62788390, 0x3d7608f0
Caught exception in looking up space point ptr... 0x3d7608f0, 0x5283f2a0
Caught exception in looking up space point ptr... 0x38be5630, 0x38be41c0
Caught exception in looking up space point ptr... 0x38be41c0, 0x38bf1320
Caught exception in looking up space point ptr... 0x702e63d0, 0x3d8a0170
Caught exception in looking up space point ptr... 0x3d8a0170, 0x702e63d0
Caught exception in looking up space point ptr... 0x528767e0, 0x7e926860
Caught exception in looking up space point ptr... 0x7e926860, 0x626dda60
Caught exception in looking up space point ptr... 0x4d388870, 0xf372930
Caught exception in looking up space point ptr... 0x43c7b510, 0x4d388870
Caught exception in looking up space point ptr... 0x155fc2a0, 0xef46100
Caught exception in looking up space point ptr... 0xef46100, 0x155fc2a0
Caught exception in looking up space point ptr... 0x702fe630, 0x70357e30
Caught exception in looking up space point ptr... 0x70357e30, 0x702fe630
Caught exception in looking up space point ptr... 0x893a9010, 0x4f819090
Caught exception in looking up space point ptr... 0x4f819090, 0x893a9010
Caught exception in looking up space point ptr... 0x893a9010, 0x4f818f00
Caught exception in looking up space point ptr... 0x4f818f00, 0x893a9010
Caught exception in looking up space point ptr... 0x70324c60, 0x70324940
Caught exception in looking up space point ptr... 0x70324940, 0x70324c60
Caught exception in looking up space point ptr... 0x8a92d760, 0x370d44e0
Caught exception in looking up space point ptr... 0x370d44e0, 0x64889a40
Caught exception in looking up space point ptr... 0x424af130, 0x3d19d420
Caught exception in looking up space point ptr... 0x1f5179d0, 0x424af130
Caught exception in looking up space point ptr... 0x7d3cb6e0, 0x52c0ca20
Caught exception in looking up space point ptr... 0x52c0ca20, 0x7d3cb6e0
Caught exception in looking up space point ptr... 0x510d68b0, 0x3efd32e0
Caught exception in looking up space point ptr... 0x3efd32e0, 0x439dbcd0
Caught exception in looking up space point ptr... 0x5cee1c00, 0x102b7300
Caught exception in looking up space point ptr... 0x84a1c5f0, 0x5cee1c00
Caught exception in looking up space point ptr... 0x4d38a2a0, 0x4d38a150
Caught exception in looking up space point ptr... 0x4d38a150, 0x4d38a690
Caught exception in looking up space point ptr... 0x1b7a2860, 0x68478fa0
Caught exception in looking up space point ptr... 0x68478fa0, 0x88e7d8f0
Caught exception in looking up space point ptr... 0x7f5eaf70, 0x7f5eac40
Caught exception in looking up space point ptr... 0x7f5eac40, 0x7f5eaf70
Caught exception in looking up space point ptr... 0x7f5eaf70, 0x7f5e4b30
Caught exception in looking up space point ptr... 0x7f5e4b30, 0x7f5eaf70
Caught exception in looking up space point ptr... 0x5dbce710, 0x5dbce3a0
Caught exception in looking up space point ptr... 0x5dbce3a0, 0x5dbd17c0
Caught exception in looking up space point ptr... 0x5dbd17c0, 0x5dbdbf50
Caught exception in looking up space point ptr... 0x1f3a5c20, 0x1f6d4f80
Caught exception in looking up space point ptr... 0x1f6d4f80, 0x1f3a5c20
Caught exception in looking up space point ptr... 0x8a9da530, 0x8a9d9aa0
Caught exception in looking up space point ptr... 0x8a9d9aa0, 0x8a9da530
Caught exception in looking up space point ptr... 0x38ae1670, 0x38ae0a90
Caught exception in looking up space point ptr... 0x38ae0a90, 0x38ae1670
Caught exception in looking up space point ptr... 0x4f785640, 0x16944ae0
Caught exception in looking up space point ptr... 0x16944ae0, 0x4f785640
Caught exception in looking up space point ptr... 0x4f7ac6a0, 0x4cd86dd0
Caught exception in looking up space point ptr... 0x4cd86dd0, 0x4f7ac6a0
Caught exception in looking up space point ptr... 0x864b4570, 0x864b3a20
Caught exception in looking up space point ptr... 0x864b3a20, 0x864b4570
++++>>>> total num hits: 60103, num free: 58156
04-Feb-2026 00:47:48 UTC Closed output file "np02vd_raw_run042433_0395_df-s04-d0_dw_0_20260203T211215_reco_stage0_20260204T004748_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 132.936 157.686 188.477 155.27 13.4822 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.6541e-05 0.000142354 0.000391162 9.6146e-05 7.72727e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.638 16.3426 21.0594 15.991 1.16303 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.688076 0.779704 1.34811 0.748295 0.138421 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229383 0.0276582 0.0814309 0.023288 0.0130718 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229632 0.0231404 0.0236031 0.0231014 0.000163743 19
produce:beamevent:BeamEvent 0.000109645 0.000208845 0.00106283 0.000161053 0.000203516 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.59162 3.23158 3.46129 3.27415 0.201766 19
produce:ophit:OpHitFinder 0.0324031 0.0408714 0.0453398 0.0416704 0.00319035 19
produce:wclsdatavd:WireCellToolkit 89.3625 107.456 120.635 107.36 8.21537 19
produce:gaushit:GausHitFinder 0.694068 1.29107 2.06455 1.20169 0.370882 19
produce:nhitsfilter:NumberOfHitsFilter 0.000239442 0.000344261 0.000526406 0.000346625 8.52562e-05 19
produce:reco3d:SpacePointSolver 10.2741 19.8716 30.7849 20.2263 5.56416 19
produce:hitpdune:DisambigFromSpacePoints 0.0923196 0.208505 0.36118 0.220621 0.0725824 19
produce:cluster3d:Cluster3D 1.04992 3.19213 10.4735 2.93932 1.95023 19
[art]:TriggerResults:TriggerResultInserter 2.8093e-05 3.80007e-05 8.3426e-05 3.4592e-05 1.2353e-05 19
end_path:out1:RootOutput 5.238e-06 9.10658e-06 2.5218e-05 8.083e-06 4.18436e-06 19
end_path:out1:RootOutput(write) 3.87527 5.16666 6.23205 5.29799 0.736252 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5620.94 MB
Peak resident set size usage (VmHWM): 3425.81 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0395_df-s04-d0_dw_0_20260203T211215_reco_stage0_20260204T004748_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0395_df-s04-d0_dw_0_20260203T211215_reco_stage0_20260204T004748_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0395_df-s04-d0_dw_0_20260203T211215_reco_stage0_20260204T004748_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163008.0,
"core.end_time": 1770166070.0,
"core.events": [
45040,
45046,
45052,
45058,
45064,
45070,
45076,
45082,
45088,
45094,
45100,
45106,
45112,
45118,
45124,
45130,
45136,
45142,
45148
],
"core.event_count": 19,
"core.first_event_number": 45040,
"core.last_event_number": 45148,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0395_df-s04-d0_dw_0_20260203T211215.hdf5"
}
]
} 