Jobsub ID 297923.102@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.102@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 00:57:38 |
| From worker node | Hostname | dune001-1535671.0-lcg2714.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:03:23 |
| Input files | vd-protodune:np02vd_raw_run042433_0177_df-s04-d0_dw_0_20260203T194923.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 52m (3142s) |
| CPU time | 44m (2664s = 84%) |
| Max RSS bytes | 3412197376 (3254 MiB) |
| Outputting started | 2026-02-04 00:55:46 |
| Output files | |
| Finished | 2026-02-04 00:57:38 |
| Saved logs | justin-logs:297923.102-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
.. 0x58c38630, 0x58c380c0
Caught exception in looking up space point ptr... 0x53871d00, 0x32b25c40
Caught exception in looking up space point ptr... 0x32b25c40, 0x32b25540
Caught exception in looking up space point ptr... 0x51cbd050, 0x9ea004d0
Caught exception in looking up space point ptr... 0x9ea004d0, 0x9ea00140
Caught exception in looking up space point ptr... 0x5ad17bb0, 0x58da7160
Caught exception in looking up space point ptr... 0x58da7160, 0x2bda9360
Caught exception in looking up space point ptr... 0x679296d0, 0x67927c40
Caught exception in looking up space point ptr... 0x67927c40, 0x67927ab0
Caught exception in looking up space point ptr... 0x679278d0, 0x679271f0
Caught exception in looking up space point ptr... 0x679271f0, 0x67927740
Caught exception in looking up space point ptr... 0x67927740, 0x679296d0
Caught exception in looking up space point ptr... 0x2e8e36e0, 0x7a0f1490
Caught exception in looking up space point ptr... 0x7a0f1490, 0x7a0f1620
Caught exception in looking up space point ptr... 0x7a0f1620, 0x7a0f1300
Caught exception in looking up space point ptr... 0x7cd189f0, 0x7cd1afe0
Caught exception in looking up space point ptr... 0x7cd1afe0, 0x7cd1b5e0
Caught exception in looking up space point ptr... 0x2a09ae00, 0x2a095930
Caught exception in looking up space point ptr... 0x2a099a60, 0x2a09ae00
Caught exception in looking up space point ptr... 0x962ca0f0, 0x962c10c0
Caught exception in looking up space point ptr... 0x962c10c0, 0x962c0fc0
Caught exception in looking up space point ptr... 0x27dd60b0, 0x2dc051a0
Caught exception in looking up space point ptr... 0x2dc051a0, 0x27dd60b0
Caught exception in looking up space point ptr... 0x2a063ed0, 0x2a060d30
Caught exception in looking up space point ptr... 0x2a060d30, 0x2a063ed0
Caught exception in looking up space point ptr... 0x2a3b7420, 0x2a3bd220
Caught exception in looking up space point ptr... 0x2a3bd220, 0x2a3b7420
Caught exception in looking up space point ptr... 0x2a3b7420, 0x5e2172c0
Caught exception in looking up space point ptr... 0x5e2172c0, 0x2a3b7420
Caught exception in looking up space point ptr... 0x7a11f6b0, 0x7a11f940
Caught exception in looking up space point ptr... 0x28bb1910, 0x7a11f6b0
Caught exception in looking up space point ptr... 0x7a0dcb10, 0x7a0da8a0
Caught exception in looking up space point ptr... 0x7a0da8a0, 0x7a0dcb10
Caught exception in looking up space point ptr... 0x7b6901c0, 0x7b690030
Caught exception in looking up space point ptr... 0x7b690030, 0x7b690350
Caught exception in looking up space point ptr... 0x56037e70, 0x299c28a0
Caught exception in looking up space point ptr... 0x299c28a0, 0x56037e70
Caught exception in looking up space point ptr... 0x575b3910, 0x575b33c0
Caught exception in looking up space point ptr... 0x575b33c0, 0x575b35a0
Caught exception in looking up space point ptr... 0x540e8370, 0x8c654aa0
Caught exception in looking up space point ptr... 0x8c654aa0, 0x5b4d0470
Caught exception in looking up space point ptr... 0x575b4920, 0x575ac990
Caught exception in looking up space point ptr... 0x575ac990, 0x2cb4c770
Caught exception in looking up space point ptr... 0x29f8ea10, 0x29f8e1a0
Caught exception in looking up space point ptr... 0x29f8eef0, 0x29f8ea10
Caught exception in looking up space point ptr... 0x9ea318f0, 0x51cae130
Caught exception in looking up space point ptr... 0x51cae130, 0x9ea318f0
Caught exception in looking up space point ptr... 0x2a065d30, 0x2a062ca0
Caught exception in looking up space point ptr... 0x2a062ca0, 0x2a065d30
Caught exception in looking up space point ptr... 0x67916f10, 0x679198b0
Caught exception in looking up space point ptr... 0x679198b0, 0x67916f10
Caught exception in looking up space point ptr... 0x67916f10, 0x67919730
Caught exception in looking up space point ptr... 0x67919730, 0x67916f10
Caught exception in looking up space point ptr... 0x4627a140, 0x46289e00
Caught exception in looking up space point ptr... 0x46289e00, 0x4627a140
Caught exception in looking up space point ptr... 0x71bdcdb0, 0x71bdcc60
Caught exception in looking up space point ptr... 0x71bdcc60, 0x71bdcdb0
Caught exception in looking up space point ptr... 0x29f8fd10, 0x29f91190
Caught exception in looking up space point ptr... 0x29f91190, 0x29f8fb10
Caught exception in looking up space point ptr... 0x7a100d60, 0x7a100bd0
Caught exception in looking up space point ptr... 0x7a100bd0, 0x7a100d60
Caught exception in looking up space point ptr... 0x58c306a0, 0x58c307f0
Caught exception in looking up space point ptr... 0x58c307f0, 0x58c306a0
Caught exception in looking up space point ptr... 0x9e960740, 0x9e9608d0
Caught exception in looking up space point ptr... 0x9e9608d0, 0x9e960740
Caught exception in looking up space point ptr... 0x2a0725f0, 0xa03aa590
Caught exception in looking up space point ptr... 0xa03aa590, 0x2a0725f0
++++>>>> total num hits: 71155, num free: 67458
04-Feb-2026 00:55:37 UTC Closed output file "np02vd_raw_run042433_0177_df-s04-d0_dw_0_20260203T194923_reco_stage0_20260204T005537_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 138.73 161.24 212.256 159.111 16.6982 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.1573e-05 0.000115287 0.00021257 9.8469e-05 4.05308e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.9011 24.9694 68.2893 20.3518 12.4277 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.682699 0.730281 1.23137 0.688461 0.120297 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228564 0.0263471 0.0446296 0.0231935 0.00627765 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0227716 0.0231739 0.0238857 0.0230655 0.000334304 19
produce:beamevent:BeamEvent 0.000108484 0.000200874 0.00109543 0.000144668 0.000212693 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.26215 3.85791 6.08909 3.59136 0.671659 19
produce:ophit:OpHitFinder 0.0343149 0.04079 0.0472596 0.0413544 0.003448 19
produce:wclsdatavd:WireCellToolkit 101.452 108.252 118.639 108.656 5.34265 19
produce:gaushit:GausHitFinder 0.83111 1.38131 1.73888 1.43529 0.262878 19
produce:nhitsfilter:NumberOfHitsFilter 0.000197197 0.000295735 0.000511731 0.000300823 6.96722e-05 19
produce:reco3d:SpacePointSolver 6.15144 12.6084 16.4803 13.0478 2.70421 19
produce:hitpdune:DisambigFromSpacePoints 0.10274 0.191779 0.251357 0.203849 0.0417686 19
produce:cluster3d:Cluster3D 1.42097 3.79797 26.513 2.66113 5.38508 19
[art]:TriggerResults:TriggerResultInserter 2.7341e-05 3.91168e-05 0.00011906 3.3991e-05 1.97132e-05 19
end_path:out1:RootOutput 6.91e-06 1.19069e-05 3.2318e-05 1.0256e-05 6.2068e-06 19
end_path:out1:RootOutput(write) 4.12618 5.30515 5.97134 5.58064 0.621912 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5700.39 MB
Peak resident set size usage (VmHWM): 3412.2 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0177_df-s04-d0_dw_0_20260203T194923_reco_stage0_20260204T005537_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0177_df-s04-d0_dw_0_20260203T194923_reco_stage0_20260204T005537_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0177_df-s04-d0_dw_0_20260203T194923_reco_stage0_20260204T005537_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163414.0,
"core.end_time": 1770166538.0,
"core.events": [
20188,
20194,
20200,
20206,
20212,
20218,
20224,
20230,
20236,
20242,
20248,
20254,
20260,
20266,
20272,
20278,
20284,
20290,
20296
],
"core.event_count": 19,
"core.first_event_number": 20188,
"core.last_event_number": 20296,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0177_df-s04-d0_dw_0_20260203T194923.hdf5"
}
]
} 