Jobsub ID 293815.0@dunegpschedd02.fnal.gov
| Jobsub ID | 293815.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12253 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2026-01-22 20:59:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-01-23 02:32:46 |
| From worker node | Hostname | dune002-1426316.0-lcg2713.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-22 21:01:06 |
| Input files | vd-protodune:np02vd_raw_run039273_1218_df-s02-d2_dw_0_20250901T023257.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 55m (3312s) |
| CPU time | 47m (2833s = 85%) |
| Max RSS bytes | 4034273280 (3847 MiB) |
| Outputting started | 2026-01-22 21:56:20 |
| Output files | |
| Finished | 2026-01-23 02:32:46 |
| Saved logs | justin-logs:293815.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
5a49c0, 0x9c5a50b0
Caught exception in looking up space point ptr... 0x737a5df0, 0x737a5ca0
Caught exception in looking up space point ptr... 0x737a5ca0, 0x73794aa0
Caught exception in looking up space point ptr... 0x6594c3a0, 0x6594bd60
Caught exception in looking up space point ptr... 0x6594bd60, 0x6594bbd0
Caught exception in looking up space point ptr... 0x9d102330, 0x9d101a30
Caught exception in looking up space point ptr... 0x9d101a30, 0x9d102330
Caught exception in looking up space point ptr... 0xa42ca110, 0x832d2800
Caught exception in looking up space point ptr... 0x8330a9e0, 0xa42ca110
Caught exception in looking up space point ptr... 0x4652ec70, 0x465536b0
Caught exception in looking up space point ptr... 0x465536b0, 0x465534b0
Caught exception in looking up space point ptr... 0x82190b90, 0x821747d0
Caught exception in looking up space point ptr... 0x821747d0, 0x82190b90
Caught exception in looking up space point ptr... 0x8fd0b700, 0x8fd0b3e0
Caught exception in looking up space point ptr... 0x3d4841f0, 0x8fd0b700
Caught exception in looking up space point ptr... 0x94339f30, 0xb0b51780
Caught exception in looking up space point ptr... 0x871a15b0, 0x94339f30
Caught exception in looking up space point ptr... 0x5f8428d0, 0x5f842740
Caught exception in looking up space point ptr... 0x5f842740, 0x5f8428d0
Caught exception in looking up space point ptr... 0x68fc84e0, 0x3d675a60
Caught exception in looking up space point ptr... 0x3d675a60, 0x964b4690
Caught exception in looking up space point ptr... 0x6594ae60, 0x6594ab40
Caught exception in looking up space point ptr... 0x6594ab40, 0x6594ae60
Caught exception in looking up space point ptr... 0x615aa6a0, 0x8ecf0c40
Caught exception in looking up space point ptr... 0x8ecf0c40, 0x72c803b0
Caught exception in looking up space point ptr... 0x90dc3750, 0x5e4e8050
Caught exception in looking up space point ptr... 0x5e4e8050, 0x5e4e77d0
Caught exception in looking up space point ptr... 0x830aa630, 0x8d51e7e0
Caught exception in looking up space point ptr... 0x8d51e7e0, 0x8d51eae0
Caught exception in looking up space point ptr... 0x65244f40, 0x65244db0
Caught exception in looking up space point ptr... 0x65244db0, 0x65244a90
Caught exception in looking up space point ptr... 0x8f412e20, 0x90ff0380
Caught exception in looking up space point ptr... 0x90ff0380, 0x8f412e20
Caught exception in looking up space point ptr... 0x9c47cad0, 0x9c47d0e0
Caught exception in looking up space point ptr... 0x9c47d0e0, 0x9c481290
Caught exception in looking up space point ptr... 0x88bc30e0, 0xaa8f30a0
Caught exception in looking up space point ptr... 0xaa8f30a0, 0x88bc30e0
Caught exception in looking up space point ptr... 0x79ca8b10, 0x468b4990
Caught exception in looking up space point ptr... 0x468b4990, 0x79ca8b10
Caught exception in looking up space point ptr... 0x9c47c670, 0x9c47c570
Caught exception in looking up space point ptr... 0x9c47c570, 0x9c47c670
Caught exception in looking up space point ptr... 0x9d102810, 0x9d102710
Caught exception in looking up space point ptr... 0x9d102710, 0x9d102810
Caught exception in looking up space point ptr... 0x683a4420, 0x6864cc50
Caught exception in looking up space point ptr... 0x6864cc50, 0x683a4420
Caught exception in looking up space point ptr... 0x737ad300, 0x737ad620
Caught exception in looking up space point ptr... 0x737ad620, 0x737ad490
Caught exception in looking up space point ptr... 0x469e0400, 0x46a1ff20
Caught exception in looking up space point ptr... 0x46a1ff20, 0xb06ded60
Caught exception in looking up space point ptr... 0x95da1120, 0x64b70ab0
Caught exception in looking up space point ptr... 0x64b70ab0, 0x95d9e010
Caught exception in looking up space point ptr... 0x6976d7b0, 0x62b5c820
Caught exception in looking up space point ptr... 0x62b5c820, 0x6976d7b0
Caught exception in looking up space point ptr... 0x82162820, 0x8215d410
Caught exception in looking up space point ptr... 0x8215d410, 0x8215d500
Caught exception in looking up space point ptr... 0x6701c1c0, 0x7a643dd0
Caught exception in looking up space point ptr... 0x7a643dd0, 0x36834360
Caught exception in looking up space point ptr... 0x69a43630, 0x83a4a8d0
Caught exception in looking up space point ptr... 0x83a4a8d0, 0x69a43630
Caught exception in looking up space point ptr... 0x9d252410, 0x9d2525a0
Caught exception in looking up space point ptr... 0x9d2525a0, 0x737a4b90
Caught exception in looking up space point ptr... 0xa27d3470, 0x62bf1980
Caught exception in looking up space point ptr... 0x62bf1980, 0x64b5c5c0
Caught exception in looking up space point ptr... 0x6ae0c050, 0x8f6c6700
Caught exception in looking up space point ptr... 0x8f6c6700, 0x6ae0c050
Caught exception in looking up space point ptr... 0x69a75470, 0x73dd0590
Caught exception in looking up space point ptr... 0x73dd0590, 0x74d674a0
++++>>>> total num hits: 145227, num free: 141233
22-Jan-2026 21:56:07 UTC Closed output file "np02vd_raw_run039273_1218_df-s02-d2_dw_0_20250901T023257_reco_stage0_20260122T215607_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 153.108 178.815 220.538 177.919 16.8657 18
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.0626e-05 0.000171827 0.000293351 0.000191267 6.45465e-05 18
produce:tpcrawdecoder:PDVDTPCReader 17.251 23.7038 47.8882 21.45 6.69781 18
produce:triggerrawdecoder:PDVDTriggerReader4 0.0457462 0.0620165 0.259023 0.0465416 0.0484462 18
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229966 0.106131 1.41616 0.0275856 0.3178 18
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113864 0.117771 0.127022 0.115551 0.00435814 18
produce:beamevent:BeamEvent 0.000201323 0.660341 11.3654 0.00121634 2.59709 18
produce:pdvddaphne:DAPHNEReaderPDVD 4.5536 4.92721 5.27218 4.91907 0.200826 18
produce:ophit:OpHitFinder 0.0309241 0.0506579 0.0632586 0.0514178 0.00662063 18
produce:wclsdatavd:WireCellToolkit 106.964 111.394 115.541 112.353 2.51224 18
produce:gaushit:GausHitFinder 0.996066 1.39421 2.03718 1.38585 0.245201 18
produce:nhitsfilter:NumberOfHitsFilter 0.000202374 0.000370573 0.00101124 0.000355339 0.000174176 18
produce:reco3d:SpacePointSolver 8.29498 18.0098 26.5186 18.3519 5.63089 18
produce:hitpdune:DisambigFromSpacePoints 0.140453 0.336599 0.548229 0.344304 0.117497 18
produce:cluster3d:Cluster3D 1.43059 11.7179 26.2249 12.2443 6.11329 18
[art]:TriggerResults:TriggerResultInserter 2.9014e-05 4.6525e-05 9.6546e-05 4.24035e-05 1.55031e-05 18
end_path:out1:RootOutput 6.96e-06 1.23373e-05 2.6369e-05 1.2549e-05 3.94875e-06 18
end_path:out1:RootOutput(write) 4.8838 6.26546 7.50233 6.34064 0.752509 18
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6271.93 MB
Peak resident set size usage (VmHWM): 4034.27 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039273_1218_df-s02-d2_dw_0_20250901T023257_reco_stage0_20260122T215607_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run039273_1218_df-s02-d2_dw_0_20250901T023257_reco_stage0_20260122T215607_offline.root
Ran successfully
{
"name": "np02vd_raw_run039273_1218_df-s02-d2_dw_0_20250901T023257_reco_stage0_20260122T215607_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_beam.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1769115680.0,
"core.end_time": 1769118969.0,
"core.events": [
438484,
438504,
438524,
438544,
438564,
438584,
438604,
438624,
438644,
438664,
438684,
438704,
438724,
438744,
438764,
438784,
438804,
438824
],
"core.event_count": 18,
"core.first_event_number": 438484,
"core.last_event_number": 438824,
"core.data_stream": "physics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39273
],
"core.runs_subruns": [
3927300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039273_1218_df-s02-d2_dw_0_20250901T023257.hdf5"
}
]
} 