Jobsub ID 303646.166@dunegpschedd01.fnal.gov
| Jobsub ID | 303646.166@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:44:24 |
| Site | UK_Lancaster |
| Entry | UBoone_UK_Lancaster_HEC_grendel_ce02 |
| Last heartbeat | 2026-02-04 01:42:58 |
| From worker node | Hostname | comp22-07 |
| cpuinfo | Intel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:46:32 |
| Input files | vd-protodune:np02vd_raw_run042422_0084_df-s04-d1_dw_0_20260203T160011.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10356s) |
| CPU time | 40m (2454s = 23%) |
| Max RSS bytes | 2618576896 (2497 MiB) |
| Outputting started | 2026-02-04 01:39:14 |
| Output files | |
| Finished | 2026-02-04 01:42:58 |
| Saved logs | justin-logs:303646.166-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
f751a30, 0x333270f0
Caught exception in looking up space point ptr... 0x333270f0, 0x3a678930
Caught exception in looking up space point ptr... 0x4eb9d5e0, 0x4a8cf0c0
Caught exception in looking up space point ptr... 0x4a8cf0c0, 0x4eb9cfa0
Caught exception in looking up space point ptr... 0x4eb9fb90, 0x4a8ce870
Caught exception in looking up space point ptr... 0x4a8ce870, 0x4eb9fb90
Caught exception in looking up space point ptr... 0x4a8d0570, 0x4a8d0250
Caught exception in looking up space point ptr... 0x4a8d0250, 0x4a8d0c50
Caught exception in looking up space point ptr... 0x5bbee3e0, 0x2afaec30
Caught exception in looking up space point ptr... 0x2afaec30, 0x5bbee3e0
Caught exception in looking up space point ptr... 0x151d54a0, 0x5ff8bd60
Caught exception in looking up space point ptr... 0x5ff8bd60, 0x4807b710
Caught exception in looking up space point ptr... 0x4807b710, 0x15f36cc0
Caught exception in looking up space point ptr... 0x4631dbe0, 0x184ea3c0
Caught exception in looking up space point ptr... 0x184ea3c0, 0x184ea230
Caught exception in looking up space point ptr... 0x29f16810, 0x2a01f6a0
Caught exception in looking up space point ptr... 0x2a01f6a0, 0x29f16810
Caught exception in looking up space point ptr... 0x4596b5f0, 0x32cf3950
Caught exception in looking up space point ptr... 0x32cf3950, 0x9ab4dd0
Caught exception in looking up space point ptr... 0x4ca6c870, 0xaee2f70
Caught exception in looking up space point ptr... 0xaee2f70, 0x4ca6c870
Caught exception in looking up space point ptr... 0x3d581970, 0x5fac0700
Caught exception in looking up space point ptr... 0x5fac0700, 0x45950690
Caught exception in looking up space point ptr... 0x45950690, 0x4594eda0
Caught exception in looking up space point ptr... 0x2b14db00, 0x2b14dc90
Caught exception in looking up space point ptr... 0x2b14dc90, 0x2b154a80
Caught exception in looking up space point ptr... 0x15ec7ee0, 0xaee2e40
Caught exception in looking up space point ptr... 0xaee2e40, 0xaedf070
Caught exception in looking up space point ptr... 0xaedf070, 0xaedf230
Caught exception in looking up space point ptr... 0xaedf230, 0x4a8cf510
Caught exception in looking up space point ptr... 0x4a8cf510, 0x15ec7ee0
Caught exception in looking up space point ptr... 0x5d722ac0, 0x2d7147c0
Caught exception in looking up space point ptr... 0x2d7147c0, 0x5d722ac0
Caught exception in looking up space point ptr... 0xb677890, 0xb677740
Caught exception in looking up space point ptr... 0xb677740, 0xb677890
Caught exception in looking up space point ptr... 0x37ca6b30, 0x5fac4920
Caught exception in looking up space point ptr... 0x5fac4920, 0x37ca6b30
Caught exception in looking up space point ptr... 0x561e8db0, 0x47bb3910
Caught exception in looking up space point ptr... 0x47bb3910, 0x561e8db0
Caught exception in looking up space point ptr... 0x29487900, 0x3d5dc2d0
Caught exception in looking up space point ptr... 0x3d5dc2d0, 0x2d5dc570
Caught exception in looking up space point ptr... 0x32fe4a50, 0x4e39a8f0
Caught exception in looking up space point ptr... 0x4e39a8f0, 0x32fe4a50
Caught exception in looking up space point ptr... 0x16086a70, 0x160865c0
Caught exception in looking up space point ptr... 0x160865c0, 0x16086a70
Caught exception in looking up space point ptr... 0xec2f3b0, 0x47310210
Caught exception in looking up space point ptr... 0x47310210, 0xec2f3b0
Caught exception in looking up space point ptr... 0xb6612b0, 0x32368580
Caught exception in looking up space point ptr... 0x32368580, 0xb6612b0
Caught exception in looking up space point ptr... 0x15093e80, 0x1be146c0
Caught exception in looking up space point ptr... 0x1be147d0, 0x15093e80
Caught exception in looking up space point ptr... 0xf3b1810, 0xf39be10
Caught exception in looking up space point ptr... 0x3234e080, 0xf3b1810
Caught exception in looking up space point ptr... 0x4a9b7350, 0x13935910
Caught exception in looking up space point ptr... 0x13935910, 0x4a9b7350
Caught exception in looking up space point ptr... 0x323e2220, 0x1b448c40
Caught exception in looking up space point ptr... 0x1b448c40, 0x419ab0f0
Caught exception in looking up space point ptr... 0x419ab0f0, 0x323e2540
Caught exception in looking up space point ptr... 0x136429d0, 0x2a0e8250
Caught exception in looking up space point ptr... 0x2a0e8250, 0x136429d0
Caught exception in looking up space point ptr... 0x18751950, 0x187518b0
Caught exception in looking up space point ptr... 0x187518b0, 0x597b65c0
Caught exception in looking up space point ptr... 0xb6662d0, 0x37c9d540
Caught exception in looking up space point ptr... 0x37c9d540, 0xb6662d0
Caught exception in looking up space point ptr... 0xec3df90, 0xec3de40
Caught exception in looking up space point ptr... 0xec3de40, 0xec3df90
++++>>>> total num hits: 40180, num free: 38290
04-Feb-2026 01:37:45 GMT Closed output file "np02vd_raw_run042422_0084_df-s04-d1_dw_0_20260203T160011_reco_stage0_20260204T013745_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 222.04 377.417 757.65 333.8 135.248 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.9894e-05 0.000115048 0.000165626 0.00010606 1.58391e-05 27
produce:tpcrawdecoder:PDVDTPCReader 128.028 222.012 369.75 195.981 65.7975 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.782669 1.24382 2.40386 1.11492 0.376801 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0234802 0.0330536 0.110614 0.026281 0.0168915 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.116364 0.140373 0.203969 0.130492 0.0253462 27
produce:beamevent:BeamEvent 9.8755e-05 0.000194905 0.00132847 0.000139033 0.000224867 27
produce:pdvddaphne:DAPHNEReaderPDVD 18.2149 36.5124 171.332 29.8619 29.7321 27
produce:ophit:OpHitFinder 0.0253322 0.0309899 0.0343075 0.0317953 0.00233072 27
produce:wclsdatavd:WireCellToolkit 62.8671 86.7948 409.34 65.7199 70.4028 27
produce:gaushit:GausHitFinder 0.47369 0.876562 1.25901 0.850058 0.184056 27
produce:nhitsfilter:NumberOfHitsFilter 0.000209968 0.000338741 0.00124285 0.000300824 0.000185439 27
produce:reco3d:SpacePointSolver 4.96002 9.28592 15.3822 8.38499 2.90921 27
produce:hitpdune:DisambigFromSpacePoints 0.0528644 0.0958437 0.222014 0.0957862 0.0305849 27
produce:cluster3d:Cluster3D 0.614929 1.71108 11.6811 1.33106 1.99576 27
[art]:TriggerResults:TriggerResultInserter 1.7249e-05 2.2764e-05 6.7002e-05 2.1043e-05 8.99377e-06 27
end_path:out1:RootOutput 6.005e-06 8.50411e-06 2.0784e-05 7.785e-06 2.79835e-06 27
end_path:out1:RootOutput(write) 2.8119 18.6581 345.196 3.1367 65.1634 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4517.83 MB
Peak resident set size usage (VmHWM): 2618.58 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0084_df-s04-d1_dw_0_20260203T160011_reco_stage0_20260204T013745_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0084_df-s04-d1_dw_0_20260203T160011_reco_stage0_20260204T013745_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0084_df-s04-d1_dw_0_20260203T160011_reco_stage0_20260204T013745_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158800.0,
"core.end_time": 1770169124.0,
"core.events": [
13625,
13631,
13637,
13643,
13649,
13655,
13661,
13667,
13673,
13679,
13685,
13691,
13697,
13703,
13709,
13715,
13721,
13727,
13733,
13739,
13745,
13751,
13757,
13763,
13769,
13775,
13781
],
"core.event_count": 27,
"core.first_event_number": 13625,
"core.last_event_number": 13781,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0084_df-s04-d1_dw_0_20260203T160011.hdf5"
}
]
} 