Jobsub ID 303730.15@dunegpschedd01.fnal.gov
| Jobsub ID | 303730.15@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 01:20:32 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 02:56:36 |
| From worker node | Hostname | dune001-1535833.0-lcg2727.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 01:21:15 |
| Input files | vd-protodune:np02vd_raw_run042433_0092_df-s03-d1_dw_0_20260203T191706.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5565s) |
| CPU time | 1h (5264s = 94%) |
| Max RSS bytes | 10139766784 (9670 MiB) |
| Outputting started | 2026-02-04 02:54:04 |
| Output files | |
| Finished | 2026-02-04 02:56:36 |
| Saved logs | justin-logs:303730.15-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
oking up space point ptr... 0x60ce27a0, 0x60ce26a0
Caught exception in looking up space point ptr... 0x60ce26a0, 0x60ce27a0
Caught exception in looking up space point ptr... 0x60ce27a0, 0x60cc6500
Caught exception in looking up space point ptr... 0x60cc6500, 0x60ce27a0
Caught exception in looking up space point ptr... 0xeac9a4b0, 0xeac9a5b0
Caught exception in looking up space point ptr... 0xeac9a5b0, 0xeac9a6b0
Caught exception in looking up space point ptr... 0x4530caf0, 0x12a1fc950
Caught exception in looking up space point ptr... 0x12a1fc950, 0x4530f870
Caught exception in looking up space point ptr... 0xaffc9630, 0xaffcd970
Caught exception in looking up space point ptr... 0xaffcd970, 0xaffc9630
Caught exception in looking up space point ptr... 0x802fbb10, 0x802f0c90
Caught exception in looking up space point ptr... 0x802f0c90, 0x802fbb10
Caught exception in looking up space point ptr... 0x14f7f5860, 0x14f7f53b0
Caught exception in looking up space point ptr... 0x14f7f56d0, 0x14f7f5860
Caught exception in looking up space point ptr... 0xf52ef920, 0x1527edaa0
Caught exception in looking up space point ptr... 0x1527edaa0, 0xf52ef920
Caught exception in looking up space point ptr... 0x9d11f460, 0x9d11efb0
Caught exception in looking up space point ptr... 0x9d11efb0, 0x9d11f460
Caught exception in looking up space point ptr... 0xdd0dd960, 0x3c8ce720
Caught exception in looking up space point ptr... 0x3c8ce720, 0xdd0dec50
Caught exception in looking up space point ptr... 0x109c8c020, 0x109c8beb0
Caught exception in looking up space point ptr... 0x109c8beb0, 0x109c8d940
Caught exception in looking up space point ptr... 0x10eb38bc0, 0x10eb38ac0
Caught exception in looking up space point ptr... 0x10eb38ac0, 0x10eb39da0
Caught exception in looking up space point ptr... 0xeb594780, 0xb74f4580
Caught exception in looking up space point ptr... 0xb74f4580, 0xeb594880
Caught exception in looking up space point ptr... 0x802e7a50, 0x802ec0a0
Caught exception in looking up space point ptr... 0x802ec0a0, 0x802ebba0
Caught exception in looking up space point ptr... 0x80316400, 0x80316940
Caught exception in looking up space point ptr... 0x80316940, 0x803167f0
Caught exception in looking up space point ptr... 0x94be5c10, 0x94be1670
Caught exception in looking up space point ptr... 0x94be1670, 0x94be1570
Caught exception in looking up space point ptr... 0xf937e860, 0xf937f140
Caught exception in looking up space point ptr... 0xf937f140, 0xf9380ae0
Caught exception in looking up space point ptr... 0xd69678f0, 0xd69672b0
Caught exception in looking up space point ptr... 0xd69672b0, 0xd69678f0
Caught exception in looking up space point ptr... 0x166a1ebd0, 0x166a1e880
Caught exception in looking up space point ptr... 0x166a1ef90, 0x166a1edb0
Caught exception in looking up space point ptr... 0x166a1edb0, 0x166a1ebd0
Caught exception in looking up space point ptr... 0xa31e72d0, 0xa31e71d0
Caught exception in looking up space point ptr... 0xa31e71d0, 0xa31e7420
Caught exception in looking up space point ptr... 0x61d61c20, 0x61d622b0
Caught exception in looking up space point ptr... 0x61d622b0, 0x61d615e0
Caught exception in looking up space point ptr... 0x17d44eea0, 0x17d44ec30
Caught exception in looking up space point ptr... 0x17d44ec30, 0x17d44eea0
Caught exception in looking up space point ptr... 0x109c90a90, 0x109c90900
Caught exception in looking up space point ptr... 0x109c90900, 0x109c904e0
Caught exception in looking up space point ptr... 0x109c904e0, 0x109c8c520
Caught exception in looking up space point ptr... 0x14f7f4d70, 0x14f7f4a00
Caught exception in looking up space point ptr... 0x14f7f4a00, 0x14f7f4d70
Caught exception in looking up space point ptr... 0xe2bc4d00, 0xe2bc4bb0
Caught exception in looking up space point ptr... 0xe2bc4bb0, 0xe2bc4d00
Caught exception in looking up space point ptr... 0x10c1c4bc0, 0x10c1c4a30
Caught exception in looking up space point ptr... 0x10c1c4a30, 0x10c1c4bc0
Caught exception in looking up space point ptr... 0x453491f0, 0x4534a010
Caught exception in looking up space point ptr... 0x4534a010, 0x45346c40
Caught exception in looking up space point ptr... 0x16ad632e0, 0x16ad63600
Caught exception in looking up space point ptr... 0x16ad63600, 0x16ad63790
Caught exception in looking up space point ptr... 0xd6966930, 0xd698b480
Caught exception in looking up space point ptr... 0xd698b480, 0xd6966930
Caught exception in looking up space point ptr... 0x12a3672f0, 0xa49f86f0
Caught exception in looking up space point ptr... 0xa49f86f0, 0x12a3672f0
Caught exception in looking up space point ptr... 0x61ab0d00, 0x61ab0b60
Caught exception in looking up space point ptr... 0x61ab0b60, 0x61ab0d00
Caught exception in looking up space point ptr... 0xe455d5a0, 0xe6664000
Caught exception in looking up space point ptr... 0xe6664000, 0xe455d5a0
++++>>>> total num hits: 103503, num free: 99379
04-Feb-2026 02:53:51 UTC Closed output file "np02vd_raw_run042433_0092_df-s03-d1_dw_0_20260203T191706_reco_stage0_20260204T025351_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 136.033 288.74 786.616 170.482 213.827 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8854e-05 0.000130405 0.000265681 0.000117278 4.21708e-05 19
produce:tpcrawdecoder:PDVDTPCReader 14.2788 14.6693 15.0323 14.6403 0.223264 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.688711 0.702684 0.71998 0.695452 0.0119623 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229463 0.0240108 0.0304901 0.0233762 0.00196147 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230322 0.0232815 0.0235367 0.0232868 0.000134964 19
produce:beamevent:BeamEvent 0.000122895 0.000212125 0.000999211 0.00017846 0.000187114 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.00727 3.47311 3.91967 3.505 0.319582 19
produce:ophit:OpHitFinder 0.0392032 0.0429056 0.0486531 0.0422021 0.00256438 19
produce:wclsdatavd:WireCellToolkit 87.889 114.808 130.112 117.299 10.8003 19
produce:gaushit:GausHitFinder 0.86447 3.9614 20.8163 1.51553 5.14777 19
produce:nhitsfilter:NumberOfHitsFilter 0.000195746 0.000380287 0.000760029 0.00031724 0.000177705 19
produce:reco3d:SpacePointSolver 8.50182 25.8077 82.0463 18.367 20.1129 19
produce:hitpdune:DisambigFromSpacePoints 0.0990366 0.752421 2.46321 0.272734 0.82456 19
produce:cluster3d:Cluster3D 1.16227 115.942 552.01 3.64757 191.354 19
[art]:TriggerResults:TriggerResultInserter 2.6139e-05 4.74226e-05 8.3857e-05 3.997e-05 1.71104e-05 19
end_path:out1:RootOutput 7.04e-06 1.27598e-05 3.1147e-05 1.1327e-05 5.73346e-06 19
end_path:out1:RootOutput(write) 4.01484 8.44714 18.4481 6.19783 4.62825 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12743.3 MB
Peak resident set size usage (VmHWM): 10139.8 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0092_df-s03-d1_dw_0_20260203T191706_reco_stage0_20260204T025351_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0092_df-s03-d1_dw_0_20260203T191706_reco_stage0_20260204T025351_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0092_df-s03-d1_dw_0_20260203T191706_reco_stage0_20260204T025351_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770168087.0,
"core.end_time": 1770173633.0,
"core.events": [
10497,
10503,
10509,
10515,
10521,
10527,
10533,
10539,
10545,
10551,
10557,
10563,
10569,
10575,
10581,
10587,
10593,
10599,
10605
],
"core.event_count": 19,
"core.first_event_number": 10497,
"core.last_event_number": 10605,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0092_df-s03-d1_dw_0_20260203T191706.hdf5"
}
]
} 