Jobsub ID 297921.134@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.134@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:18:23 |
| From worker node | Hostname | dune002-1603633.0-lcg2474.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:07 |
| Input files | vd-protodune:np02vd_raw_run042433_0008_df-s02-d1_dw_0_20260203T184508.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4830s) |
| CPU time | 1h (4481s = 92%) |
| Max RSS bytes | 3580227584 (3414 MiB) |
| Outputting started | 2026-02-04 01:16:39 |
| Output files | |
| Finished | 2026-02-04 01:18:23 |
| Saved logs | justin-logs:297921.134-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
on in looking up space point ptr... 0x43471150, 0x3fbc3a70
Caught exception in looking up space point ptr... 0x46bff020, 0x5e571e10
Caught exception in looking up space point ptr... 0x81241140, 0x46bff020
Caught exception in looking up space point ptr... 0x5ef21060, 0x5e6940c0
Caught exception in looking up space point ptr... 0x5e6940c0, 0x3745e880
Caught exception in looking up space point ptr... 0x8d3a5c20, 0x8d3b7d30
Caught exception in looking up space point ptr... 0x8d397800, 0x8d3a5c20
Caught exception in looking up space point ptr... 0x763c8400, 0x763ba7b0
Caught exception in looking up space point ptr... 0x763ba7b0, 0x3cfca660
Caught exception in looking up space point ptr... 0x8d4496a0, 0x3511d300
Caught exception in looking up space point ptr... 0x3511d300, 0x8d4496a0
Caught exception in looking up space point ptr... 0x8d4496a0, 0x9517ed70
Caught exception in looking up space point ptr... 0x9517ed70, 0x8d4496a0
Caught exception in looking up space point ptr... 0xb0e838d0, 0x9ce916d0
Caught exception in looking up space point ptr... 0x9ce916d0, 0xb0e838d0
Caught exception in looking up space point ptr... 0xb0e838d0, 0x93952d20
Caught exception in looking up space point ptr... 0x93952d20, 0xb0e838d0
Caught exception in looking up space point ptr... 0xb0e838d0, 0x7fc1b140
Caught exception in looking up space point ptr... 0x7fc1b140, 0xb0e838d0
Caught exception in looking up space point ptr... 0xa239e150, 0x3d86aed0
Caught exception in looking up space point ptr... 0x3d86aed0, 0x43c2ee80
Caught exception in looking up space point ptr... 0x9bedcaa0, 0x8d984680
Caught exception in looking up space point ptr... 0x45034970, 0x9bedcaa0
Caught exception in looking up space point ptr... 0x9517ec40, 0x64092ed0
Caught exception in looking up space point ptr... 0x64092ed0, 0x9517ec40
Caught exception in looking up space point ptr... 0x9517ec40, 0x9517f930
Caught exception in looking up space point ptr... 0x9517f930, 0x9517ec40
Caught exception in looking up space point ptr... 0x970398e0, 0x711b3930
Caught exception in looking up space point ptr... 0x711b3930, 0xa2add030
Caught exception in looking up space point ptr... 0xa2add030, 0x78434f40
Caught exception in looking up space point ptr... 0x65742090, 0x5895edc0
Caught exception in looking up space point ptr... 0x5895edc0, 0x65742090
Caught exception in looking up space point ptr... 0x43df47d0, 0x43df4340
Caught exception in looking up space point ptr... 0x43df4340, 0x43df44e0
Caught exception in looking up space point ptr... 0x7f02dd10, 0x5e7c3da0
Caught exception in looking up space point ptr... 0x5e7c3da0, 0xa094bad0
Caught exception in looking up space point ptr... 0x3727c530, 0x9c300cf0
Caught exception in looking up space point ptr... 0x9c300cf0, 0x5777c180
Caught exception in looking up space point ptr... 0x3d6e9bf0, 0x468667a0
Caught exception in looking up space point ptr... 0x468667a0, 0x46b4e0a0
Caught exception in looking up space point ptr... 0x64a6f1d0, 0x44d30510
Caught exception in looking up space point ptr... 0x44d30510, 0x64a6f1d0
Caught exception in looking up space point ptr... 0x41dc7450, 0x9b5ff780
Caught exception in looking up space point ptr... 0x9b5ff780, 0x578fd960
Caught exception in looking up space point ptr... 0x578fd960, 0x41e24b10
Caught exception in looking up space point ptr... 0xa255fa20, 0xa255ff20
Caught exception in looking up space point ptr... 0xa255ff20, 0xa255fa20
Caught exception in looking up space point ptr... 0x3727cba0, 0x5e8c2b40
Caught exception in looking up space point ptr... 0x838262c0, 0x3727cba0
Caught exception in looking up space point ptr... 0x9ce08420, 0x9ce078a0
Caught exception in looking up space point ptr... 0x9ce078a0, 0x9ce08420
Caught exception in looking up space point ptr... 0x9a0668e0, 0x9a066520
Caught exception in looking up space point ptr... 0x9a066520, 0x9a066700
Caught exception in looking up space point ptr... 0x5d2b2dd0, 0x5d2b2f60
Caught exception in looking up space point ptr... 0x5d2b2f60, 0x5d2b2ab0
Caught exception in looking up space point ptr... 0x764df840, 0x8d4499e0
Caught exception in looking up space point ptr... 0x8d4499e0, 0xa74c9510
Caught exception in looking up space point ptr... 0x6528bb10, 0x697c2930
Caught exception in looking up space point ptr... 0x697c2930, 0x3c821080
Caught exception in looking up space point ptr... 0xb20d3410, 0x3c807fa0
Caught exception in looking up space point ptr... 0x3c807fa0, 0xb20d3410
Caught exception in looking up space point ptr... 0x3bc68cf0, 0x3bc69040
Caught exception in looking up space point ptr... 0x3bc69040, 0x3bc68cf0
Caught exception in looking up space point ptr... 0x7b8e2d30, 0x7b8e2c10
Caught exception in looking up space point ptr... 0x7b8e2c10, 0x9a287960
Caught exception in looking up space point ptr... 0x576c0270, 0x576bff80
Caught exception in looking up space point ptr... 0x576bff80, 0x576c00e0
++++>>>> total num hits: 521794, num free: 510811
04-Feb-2026 01:16:30 UTC Closed output file "np02vd_raw_run042433_0008_df-s02-d1_dw_0_20260203T184508_reco_stage0_20260204T011630_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 186.084 248.809 300.349 262.894 39.9744 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.5732e-05 0.00014022 0.000354327 0.000114686 6.30769e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.764 19.1413 21.0234 19.3855 1.21192 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.680955 0.692567 0.711225 0.69043 0.00747969 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228577 0.0236548 0.0291781 0.0233498 0.00132755 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.022913 0.0233592 0.0241626 0.0232639 0.000305543 19
produce:beamevent:BeamEvent 0.000117772 0.000302287 0.00177869 0.000177614 0.000372311 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.46503 3.87355 4.27082 3.88448 0.203052 19
produce:ophit:OpHitFinder 0.0233997 0.0412366 0.055025 0.0430262 0.00785685 19
produce:wclsdatavd:WireCellToolkit 112.643 141.948 162.946 141.517 15.5176 19
produce:gaushit:GausHitFinder 1.60497 2.68354 3.51893 2.95398 0.622322 19
produce:nhitsfilter:NumberOfHitsFilter 0.000394823 0.000550569 0.00108964 0.000510742 0.000157115 19
produce:reco3d:SpacePointSolver 13.48 19.2879 25.588 19.2484 3.35233 19
produce:hitpdune:DisambigFromSpacePoints 0.180712 0.388256 0.584465 0.404278 0.0986075 19
produce:cluster3d:Cluster3D 2.17538 53.1898 81.7498 67.0877 31.0498 19
[art]:TriggerResults:TriggerResultInserter 2.9065e-05 5.0567e-05 0.000149311 3.8964e-05 2.7622e-05 19
end_path:out1:RootOutput 6.482e-06 1.31874e-05 4.0866e-05 1.0429e-05 7.70718e-06 19
end_path:out1:RootOutput(write) 5.07693 7.4597 9.51125 6.88189 1.36916 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5669.27 MB
Peak resident set size usage (VmHWM): 3580.23 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0008_df-s02-d1_dw_0_20260203T184508_reco_stage0_20260204T011630_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0008_df-s02-d1_dw_0_20260203T184508_reco_stage0_20260204T011630_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0008_df-s02-d1_dw_0_20260203T184508_reco_stage0_20260204T011630_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162981.0,
"core.end_time": 1770167792.0,
"core.events": [
919,
925,
931,
937,
943,
949,
955,
961,
967,
973,
979,
985,
991,
997,
1003,
1009,
1015,
1021,
1027
],
"core.event_count": 19,
"core.first_event_number": 919,
"core.last_event_number": 1027,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0008_df-s02-d1_dw_0_20260203T184508.hdf5"
}
]
} 