Jobsub ID 297923.98@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.98@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 00:54:39 |
| From worker node | Hostname | dune001-1527525.0-lcg2718.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:02:18 |
| Input files | vd-protodune:np02vd_raw_run042433_0630_df-s02-d0_dw_0_20260203T224133.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3031s) |
| CPU time | 45m (2738s = 90%) |
| Max RSS bytes | 3416002560 (3257 MiB) |
| Outputting started | 2026-02-04 00:52:51 |
| Output files | |
| Finished | 2026-02-04 00:54:39 |
| Saved logs | justin-logs:297923.98-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
r... 0x8350caf0, 0x83508650
Caught exception in looking up space point ptr... 0x83508650, 0x83510ba0
Caught exception in looking up space point ptr... 0x83510ba0, 0x8350f810
Caught exception in looking up space point ptr... 0x91332a40, 0x91331b80
Caught exception in looking up space point ptr... 0x91331b80, 0x91332a40
Caught exception in looking up space point ptr... 0x736b6400, 0x736a9f70
Caught exception in looking up space point ptr... 0x736b6b20, 0x736b6400
Caught exception in looking up space point ptr... 0xab8159d0, 0xab815b60
Caught exception in looking up space point ptr... 0xab815b60, 0xab8159d0
Caught exception in looking up space point ptr... 0xb0a439d0, 0xb0a45b80
Caught exception in looking up space point ptr... 0xb0a45b80, 0xb0a439d0
Caught exception in looking up space point ptr... 0x79a18a60, 0x79a18b90
Caught exception in looking up space point ptr... 0x79a18b90, 0x79a18a60
Caught exception in looking up space point ptr... 0xa5882840, 0xa5882390
Caught exception in looking up space point ptr... 0xa5882390, 0xa5882840
Caught exception in looking up space point ptr... 0xaf2ef340, 0xaf2ef210
Caught exception in looking up space point ptr... 0xaf2ef210, 0xaf2ef340
Caught exception in looking up space point ptr... 0x76b121e0, 0x76b15b00
Caught exception in looking up space point ptr... 0x76b15b00, 0x76b159e0
Caught exception in looking up space point ptr... 0x70cb9dd0, 0x70cb9b20
Caught exception in looking up space point ptr... 0x70cb9b20, 0x70cb9dd0
Caught exception in looking up space point ptr... 0x55b7b2d0, 0x6f111610
Caught exception in looking up space point ptr... 0x6f111610, 0x55b7b2d0
Caught exception in looking up space point ptr... 0x55b7b2d0, 0x754a0590
Caught exception in looking up space point ptr... 0x754a0590, 0x55b7b2d0
Caught exception in looking up space point ptr... 0xa58e7d00, 0x6e3d5eb0
Caught exception in looking up space point ptr... 0x6e3d5eb0, 0xa58e7d00
Caught exception in looking up space point ptr... 0xa58cde00, 0x7f1bdd80
Caught exception in looking up space point ptr... 0x7f1bdd80, 0xa58cde00
Caught exception in looking up space point ptr... 0x70089310, 0x70089790
Caught exception in looking up space point ptr... 0x70089790, 0x70089310
Caught exception in looking up space point ptr... 0x74928de0, 0x749290d0
Caught exception in looking up space point ptr... 0x66660820, 0x74928de0
Caught exception in looking up space point ptr... 0x55d4fe00, 0x754a0440
Caught exception in looking up space point ptr... 0x754a0440, 0x55d4fe00
Caught exception in looking up space point ptr... 0x5270d320, 0x5270d450
Caught exception in looking up space point ptr... 0x5270d450, 0x5270d320
Caught exception in looking up space point ptr... 0xab00a490, 0xab009fc0
Caught exception in looking up space point ptr... 0xab009fc0, 0xab00a490
Caught exception in looking up space point ptr... 0x6ba74340, 0x8efd3b40
Caught exception in looking up space point ptr... 0x8efd3b40, 0x708dc870
Caught exception in looking up space point ptr... 0xb0a58230, 0xb0a57d80
Caught exception in looking up space point ptr... 0xb0a57d80, 0xb0a58230
Caught exception in looking up space point ptr... 0x7d1477d0, 0x8f9bd430
Caught exception in looking up space point ptr... 0x8f9bd430, 0x9fc1bb90
Caught exception in looking up space point ptr... 0xa589a930, 0xa589d2e0
Caught exception in looking up space point ptr... 0xa589d2e0, 0xa589d670
Caught exception in looking up space point ptr... 0x8d15b760, 0x8d15b610
Caught exception in looking up space point ptr... 0x8d15b610, 0x8d15b760
Caught exception in looking up space point ptr... 0x6bb4d660, 0x6bb4d4d0
Caught exception in looking up space point ptr... 0x6bb4d4d0, 0x6bb4d660
Caught exception in looking up space point ptr... 0x9a3b63a0, 0x9a3b5b70
Caught exception in looking up space point ptr... 0x9a3b5b70, 0x9a3b63a0
Caught exception in looking up space point ptr... 0x9a3b63a0, 0x9a3b4270
Caught exception in looking up space point ptr... 0x9a3b4270, 0x9a3b63a0
Caught exception in looking up space point ptr... 0x4758d9c0, 0x4758bb60
Caught exception in looking up space point ptr... 0x4758bb60, 0x4758d770
Caught exception in looking up space point ptr... 0xa265e8a0, 0xa265ea30
Caught exception in looking up space point ptr... 0xa265ea30, 0xa265e530
Caught exception in looking up space point ptr... 0x76ba3200, 0x8f31fae0
Caught exception in looking up space point ptr... 0x8f31fae0, 0x7cc63890
Caught exception in looking up space point ptr... 0x9c87cd70, 0xa988d650
Caught exception in looking up space point ptr... 0xa988d650, 0x9c87cd70
Caught exception in looking up space point ptr... 0xb3897cd0, 0xb3897e60
Caught exception in looking up space point ptr... 0xb3897e60, 0xb38979b0
Caught exception in looking up space point ptr... 0x5271e5c0, 0x5271e9f0
Caught exception in looking up space point ptr... 0x5271eb20, 0x5271e5c0
++++>>>> total num hits: 62581, num free: 60174
04-Feb-2026 00:52:41 UTC Closed output file "np02vd_raw_run042433_0630_df-s02-d0_dw_0_20260203T224133_reco_stage0_20260204T005241_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 135.32 155.341 185.574 155.41 13.6111 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.308e-05 0.000133636 0.000326111 9.9319e-05 6.89976e-05 19
produce:tpcrawdecoder:PDVDTPCReader 14.5325 16.022 16.4 16.0935 0.415655 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.661647 0.72011 0.781715 0.713859 0.0326363 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230194 0.0254314 0.0365703 0.0232612 0.00390893 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229635 0.0232801 0.0241178 0.0232078 0.000289507 19
produce:beamevent:BeamEvent 0.000127652 0.000248471 0.00113493 0.000213331 0.000212654 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.05059 3.40613 3.71382 3.37455 0.21815 19
produce:ophit:OpHitFinder 0.0332346 0.040294 0.0446822 0.0403169 0.00262929 19
produce:wclsdatavd:WireCellToolkit 89.6266 104.921 120.341 102.757 8.89308 19
produce:gaushit:GausHitFinder 0.812659 1.37066 2.36922 1.26899 0.400998 19
produce:nhitsfilter:NumberOfHitsFilter 0.000223096 0.000396351 0.000773012 0.000404978 0.000125793 19
produce:reco3d:SpacePointSolver 10.2376 20.4732 33.0344 21.3757 5.9064 19
produce:hitpdune:DisambigFromSpacePoints 0.114161 0.215968 0.40201 0.211949 0.0702222 19
produce:cluster3d:Cluster3D 1.47029 2.72193 4.52969 2.79625 0.842807 19
[art]:TriggerResults:TriggerResultInserter 3.0396e-05 5.16714e-05 0.000147942 4.1883e-05 3.11948e-05 19
end_path:out1:RootOutput 5.097e-06 2.53408e-05 0.000280522 8.954e-06 6.0662e-05 19
end_path:out1:RootOutput(write) 3.95068 5.34243 6.38684 5.49951 0.76147 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5582.32 MB
Peak resident set size usage (VmHWM): 3416 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0630_df-s02-d0_dw_0_20260203T224133_reco_stage0_20260204T005241_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0630_df-s02-d0_dw_0_20260203T224133_reco_stage0_20260204T005241_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0630_df-s02-d0_dw_0_20260203T224133_reco_stage0_20260204T005241_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163349.0,
"core.end_time": 1770166363.0,
"core.events": [
71826,
71832,
71838,
71844,
71850,
71856,
71862,
71868,
71874,
71880,
71886,
71892,
71898,
71904,
71910,
71916,
71922,
71928,
71934
],
"core.event_count": 19,
"core.first_event_number": 71826,
"core.last_event_number": 71934,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0630_df-s02-d0_dw_0_20260203T224133.hdf5"
}
]
} 