Jobsub ID 303652.28@dunegpschedd01.fnal.gov
| Jobsub ID | 303652.28@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 02:06:19 |
| From worker node | Hostname | dune002-1602829.0-lcg2531.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:27:42 |
| Input files | vd-protodune:np02vd_raw_run042433_0101_df-s03-d1_dw_0_20260203T192031.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9329s) |
| CPU time | 2h (8791s = 94%) |
| Max RSS bytes | 10642624512 (10149 MiB) |
| Outputting started | 2026-02-04 02:03:16 |
| Output files | |
| Finished | 2026-02-04 02:06:19 |
| Saved logs | justin-logs:303652.28-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0c8f0, 0x10034dea0
Caught exception in looking up space point ptr... 0x5a3d2fe0, 0x3ef7b860
Caught exception in looking up space point ptr... 0x9d838540, 0x5a3d2fe0
Caught exception in looking up space point ptr... 0x8c3e7620, 0x8c408640
Caught exception in looking up space point ptr... 0x8c408640, 0x4a655030
Caught exception in looking up space point ptr... 0x61cddb40, 0x61ccb8a0
Caught exception in looking up space point ptr... 0x105858920, 0x61cddb40
Caught exception in looking up space point ptr... 0x407ae050, 0x407ade00
Caught exception in looking up space point ptr... 0x407ade00, 0x407b0300
Caught exception in looking up space point ptr... 0x9b6b5910, 0x44e264d0
Caught exception in looking up space point ptr... 0x44e264d0, 0x83a29790
Caught exception in looking up space point ptr... 0x9d07e7e0, 0x9d07e590
Caught exception in looking up space point ptr... 0x9d07e590, 0x83d659f0
Caught exception in looking up space point ptr... 0x6fe04f50, 0x7ca41150
Caught exception in looking up space point ptr... 0x7ca41150, 0x12e888630
Caught exception in looking up space point ptr... 0xa6661910, 0x129844140
Caught exception in looking up space point ptr... 0x129844140, 0xb22fd080
Caught exception in looking up space point ptr... 0x91847640, 0x91847370
Caught exception in looking up space point ptr... 0x91847370, 0x91848c00
Caught exception in looking up space point ptr... 0x425bcb70, 0x44e00b90
Caught exception in looking up space point ptr... 0x44e00b90, 0x44df1ff0
Caught exception in looking up space point ptr... 0x910a71d0, 0xb6783390
Caught exception in looking up space point ptr... 0x7fd7e860, 0x910a71d0
Caught exception in looking up space point ptr... 0xa908d9a0, 0xa908d750
Caught exception in looking up space point ptr... 0xa908d750, 0xa909db90
Caught exception in looking up space point ptr... 0xa908c4d0, 0xa908c280
Caught exception in looking up space point ptr... 0xa908c280, 0xa909ba30
Caught exception in looking up space point ptr... 0xa9097390, 0xa909edb0
Caught exception in looking up space point ptr... 0x7c36d670, 0xa9097390
Caught exception in looking up space point ptr... 0x96660a80, 0xe3866c80
Caught exception in looking up space point ptr... 0x966608f0, 0x96660a80
Caught exception in looking up space point ptr... 0x621c7150, 0x6abc68c0
Caught exception in looking up space point ptr... 0x6abc68c0, 0x9e2fc980
Caught exception in looking up space point ptr... 0x408039f0, 0x5cbe2470
Caught exception in looking up space point ptr... 0xb67b1d70, 0x408039f0
Caught exception in looking up space point ptr... 0x69f9cb90, 0x69f8b570
Caught exception in looking up space point ptr... 0x69f8b570, 0x69f79780
Caught exception in looking up space point ptr... 0x69f8b700, 0x69f9cb90
Caught exception in looking up space point ptr... 0x5e700410, 0x72556480
Caught exception in looking up space point ptr... 0x9118d3c0, 0x5e700410
Caught exception in looking up space point ptr... 0x991c5680, 0xb1e13c40
Caught exception in looking up space point ptr... 0xb1e13c40, 0x415c61f0
Caught exception in looking up space point ptr... 0x415c61f0, 0x86e4f300
Caught exception in looking up space point ptr... 0xb64bb790, 0xb64aa300
Caught exception in looking up space point ptr... 0xb64aa300, 0xb64bb600
Caught exception in looking up space point ptr... 0x84ea9c60, 0x84ebb730
Caught exception in looking up space point ptr... 0x84e98c80, 0x84ea9c60
Caught exception in looking up space point ptr... 0xacc5b360, 0x86e75610
Caught exception in looking up space point ptr... 0xacc5b4f0, 0xacc5b360
Caught exception in looking up space point ptr... 0x6462ae80, 0xb0961dc0
Caught exception in looking up space point ptr... 0x6462b010, 0x6462ae80
Caught exception in looking up space point ptr... 0x49d57a40, 0x92c4d1f0
Caught exception in looking up space point ptr... 0x49d57bd0, 0x49d57a40
Caught exception in looking up space point ptr... 0x41d32ed0, 0x41d35900
Caught exception in looking up space point ptr... 0x41d37070, 0x41d32ed0
Caught exception in looking up space point ptr... 0xaae91d50, 0xaae918a0
Caught exception in looking up space point ptr... 0xaae92070, 0xaae91d50
Caught exception in looking up space point ptr... 0xa5775ab0, 0xa5775920
Caught exception in looking up space point ptr... 0xa5775920, 0xaaee4c80
Caught exception in looking up space point ptr... 0x9de5adb0, 0x8fda64d0
Caught exception in looking up space point ptr... 0x8fda64d0, 0x9de5ac20
Caught exception in looking up space point ptr... 0x79582e80, 0x79582f80
Caught exception in looking up space point ptr... 0x79582f80, 0x99963bf0
Caught exception in looking up space point ptr... 0xe3864a60, 0x725c0440
Caught exception in looking up space point ptr... 0x725c0440, 0x8d670d70
Caught exception in looking up space point ptr... 0xb04330c0, 0x95a47190
Caught exception in looking up space point ptr... 0x95a47190, 0xb04330c0
++++>>>> total num hits: 515623, num free: 508278
04-Feb-2026 02:02:59 UTC Closed output file "np02vd_raw_run042433_0101_df-s03-d1_dw_0_20260203T192031_reco_stage0_20260204T020259_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 233.007 483.48 1480.64 353.379 323.193 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000104872 0.000174878 0.000514539 0.000130642 9.25295e-05 19
produce:tpcrawdecoder:PDVDTPCReader 17.0906 24.7856 77.7172 21.0167 14.3676 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.68768 1.11747 6.35203 0.695327 1.28914 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0231844 0.0383344 0.305061 0.0233218 0.0628717 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230373 0.0234224 0.0252677 0.0233202 0.000466743 19
produce:beamevent:BeamEvent 0.000122122 0.000261613 0.00142238 0.000207264 0.00027498 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.32507 5.0202 7.20291 4.8116 0.716433 19
produce:ophit:OpHitFinder 0.0399638 0.0540984 0.0684369 0.054936 0.00721794 19
produce:wclsdatavd:WireCellToolkit 167.159 190.169 209.926 189.657 9.60209 19
produce:gaushit:GausHitFinder 1.81377 4.77871 18.2215 3.86297 3.6507 19
produce:nhitsfilter:NumberOfHitsFilter 0.000454048 0.000742096 0.00117368 0.000640941 0.000254172 19
produce:reco3d:SpacePointSolver 17.1415 40.282 150.735 24.8648 32.6955 19
produce:hitpdune:DisambigFromSpacePoints 0.207781 1.2647 4.13855 0.542819 1.38356 19
produce:cluster3d:Cluster3D 2.15923 202.934 1052.87 92.0854 281.063 19
[art]:TriggerResults:TriggerResultInserter 3.202e-05 8.14403e-05 0.000334856 5.199e-05 6.69443e-05 19
end_path:out1:RootOutput 6.95e-06 4.07149e-05 0.000518509 1.151e-05 0.000112758 19
end_path:out1:RootOutput(write) 6.37722 12.9278 33.903 10.4926 6.70483 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12877.4 MB
Peak resident set size usage (VmHWM): 10642.6 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0101_df-s03-d1_dw_0_20260203T192031_reco_stage0_20260204T020259_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0101_df-s03-d1_dw_0_20260203T192031_reco_stage0_20260204T020259_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0101_df-s03-d1_dw_0_20260203T192031_reco_stage0_20260204T020259_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161283.0,
"core.end_time": 1770170583.0,
"core.events": [
11523,
11529,
11535,
11541,
11547,
11553,
11559,
11565,
11571,
11577,
11583,
11589,
11595,
11601,
11607,
11613,
11619,
11625,
11631
],
"core.event_count": 19,
"core.first_event_number": 11523,
"core.last_event_number": 11631,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0101_df-s03-d1_dw_0_20260203T192031.hdf5"
}
]
} 