Jobsub ID 297922.20@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.20@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:37:12 |
| From worker node | Hostname | dune001-1520387.0-lcg2715.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:32 |
| Input files | vd-protodune:np02vd_raw_run042421_0008_df-s03-d1_dw_0_20260203T133514.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5840s) |
| CPU time | 1h (5217s = 89%) |
| Max RSS bytes | 9685745664 (9237 MiB) |
| Outputting started | 2026-02-04 01:34:56 |
| Output files | |
| Finished | 2026-02-04 01:37:12 |
| Saved logs | justin-logs:297922.20-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
9dd490
Caught exception in looking up space point ptr... 0x622b1df0, 0x622b1ca0
Caught exception in looking up space point ptr... 0x622b1ca0, 0x622b1f40
Caught exception in looking up space point ptr... 0x36de84b0, 0x36de8250
Caught exception in looking up space point ptr... 0x36de8250, 0x36de84b0
Caught exception in looking up space point ptr... 0x37b94410, 0x37b940f0
Caught exception in looking up space point ptr... 0x37b940f0, 0x37b94410
Caught exception in looking up space point ptr... 0x4662b970, 0x20d9a740
Caught exception in looking up space point ptr... 0x20d9a740, 0x4662b970
Caught exception in looking up space point ptr... 0x43690810, 0x57f01210
Caught exception in looking up space point ptr... 0x57f01210, 0x43690810
Caught exception in looking up space point ptr... 0x42e88a10, 0x390f9360
Caught exception in looking up space point ptr... 0x390f9360, 0x42e88a10
Caught exception in looking up space point ptr... 0xdfcbf6e0, 0x4eeb93a0
Caught exception in looking up space point ptr... 0x4eeb93a0, 0xdfcbf6e0
Caught exception in looking up space point ptr... 0x608a74b0, 0x1e614f60
Caught exception in looking up space point ptr... 0x1e614f60, 0x608a74b0
Caught exception in looking up space point ptr... 0x575cc790, 0x575cc620
Caught exception in looking up space point ptr... 0x575cc620, 0x575cc790
Caught exception in looking up space point ptr... 0x59a49ac0, 0x45abbcc0
Caught exception in looking up space point ptr... 0x45abbcc0, 0x59a49ac0
Caught exception in looking up space point ptr... 0x52ff57b0, 0x59af4580
Caught exception in looking up space point ptr... 0x59af4580, 0x52ff57b0
Caught exception in looking up space point ptr... 0x5385b070, 0x20db8710
Caught exception in looking up space point ptr... 0x20db8710, 0x141f8f40
Caught exception in looking up space point ptr... 0x1e4a8aa0, 0x506b3210
Caught exception in looking up space point ptr... 0x506b3210, 0x5985f1d0
Caught exception in looking up space point ptr... 0x49324200, 0x49e68290
Caught exception in looking up space point ptr... 0x49e68290, 0x49324200
Caught exception in looking up space point ptr... 0xfaff3680, 0xfaff3360
Caught exception in looking up space point ptr... 0xfaff3360, 0xfaff3680
Caught exception in looking up space point ptr... 0x1f8564f0, 0x43789ab0
Caught exception in looking up space point ptr... 0x43789ab0, 0x1f8564f0
Caught exception in looking up space point ptr... 0x48d37370, 0x45a90880
Caught exception in looking up space point ptr... 0x45a90880, 0x48d37370
Caught exception in looking up space point ptr... 0x3cd79410, 0x5e5aaa00
Caught exception in looking up space point ptr... 0x4664be10, 0x3cd79410
Caught exception in looking up space point ptr... 0x5e773160, 0x5e415b10
Caught exception in looking up space point ptr... 0x5e415b10, 0x37af06b0
Caught exception in looking up space point ptr... 0x5502d0a0, 0x5502cd00
Caught exception in looking up space point ptr... 0x5502cd00, 0x5502d0a0
Caught exception in looking up space point ptr... 0x59995530, 0x599957d0
Caught exception in looking up space point ptr... 0x599957d0, 0x59995940
Caught exception in looking up space point ptr... 0x49ab8ff0, 0x49ab8ea0
Caught exception in looking up space point ptr... 0x49ab8ea0, 0x49ab8ff0
Caught exception in looking up space point ptr... 0x1204c3750, 0x1204c32a0
Caught exception in looking up space point ptr... 0x1204c32a0, 0x1204c3750
Caught exception in looking up space point ptr... 0x3dd0b2e0, 0x564eca20
Caught exception in looking up space point ptr... 0x564eca20, 0x459d4d80
Caught exception in looking up space point ptr... 0x5511c810, 0x5511c6c0
Caught exception in looking up space point ptr... 0x5511c6c0, 0x5511c810
Caught exception in looking up space point ptr... 0x1e457c20, 0x43840220
Caught exception in looking up space point ptr... 0x43840220, 0x1e457c20
Caught exception in looking up space point ptr... 0x45b6e7f0, 0x1e4682e0
Caught exception in looking up space point ptr... 0x1e4682e0, 0x3c31f9e0
Caught exception in looking up space point ptr... 0x3c31f9e0, 0x4d93f170
Caught exception in looking up space point ptr... 0x435e34f0, 0x506b3440
Caught exception in looking up space point ptr... 0x506b3440, 0x435e34f0
Caught exception in looking up space point ptr... 0x554681d0, 0x3018a940
Caught exception in looking up space point ptr... 0x3018a940, 0x55d2ce60
Caught exception in looking up space point ptr... 0xcaf713f0, 0xcaf71580
Caught exception in looking up space point ptr... 0xcaf71580, 0xcaf713f0
Caught exception in looking up space point ptr... 0x4a48c210, 0x3240e350
Caught exception in looking up space point ptr... 0x3240e350, 0x4a48c210
Caught exception in looking up space point ptr... 0x36026140, 0x63636790
Caught exception in looking up space point ptr... 0x63636790, 0x450fab80
++++>>>> total num hits: 62662, num free: 58613
04-Feb-2026 01:34:44 UTC Closed output file "np02vd_raw_run042421_0008_df-s03-d1_dw_0_20260203T133514_reco_stage0_20260204T013444_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 92.1784 205.477 880.263 109.214 216.118 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.2388e-05 0.000107098 0.000282815 8.6159e-05 5.08558e-05 28
produce:tpcrawdecoder:PDVDTPCReader 13.6397 19.5298 40.5235 17.3134 7.39676 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.683947 0.844222 4.149 0.70758 0.64157 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228549 0.0239427 0.0401905 0.023188 0.00319586 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113465 0.122553 0.137394 0.115613 0.0103161 28
produce:beamevent:BeamEvent 0.000101752 0.00020493 0.00145721 0.000147031 0.00024723 28
produce:pdvddaphne:DAPHNEReaderPDVD 3.32251 4.03766 6.3943 3.77884 0.736605 28
produce:ophit:OpHitFinder 0.0221019 0.0382516 0.044584 0.0398774 0.00485278 28
produce:wclsdatavd:WireCellToolkit 56.9571 66.3883 78.5026 67.0336 5.44132 28
produce:gaushit:GausHitFinder 0.48595 1.99073 9.36117 1.08332 2.24979 28
produce:nhitsfilter:NumberOfHitsFilter 0.000128574 0.000410433 0.00140966 0.00026983 0.000355243 28
produce:reco3d:SpacePointSolver 6.11721 24.5532 106.111 10.8892 31.5964 28
produce:hitpdune:DisambigFromSpacePoints 0.0732671 1.18215 8.11789 0.121861 2.34928 28
produce:cluster3d:Cluster3D 1.06927 80.879 651.357 1.91454 174.875 28
[art]:TriggerResults:TriggerResultInserter 2.2794e-05 4.14285e-05 0.000121343 3.5098e-05 1.92761e-05 28
end_path:out1:RootOutput 4.196e-06 1.12584e-05 3.5533e-05 8.933e-06 7.34902e-06 28
end_path:out1:RootOutput(write) 2.84448 5.83843 20.642 4.11631 4.34242 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12398.6 MB
Peak resident set size usage (VmHWM): 9685.75 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0008_df-s03-d1_dw_0_20260203T133514_reco_stage0_20260204T013444_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0008_df-s03-d1_dw_0_20260203T133514_reco_stage0_20260204T013444_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0008_df-s03-d1_dw_0_20260203T133514_reco_stage0_20260204T013444_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163064.0,
"core.end_time": 1770168886.0,
"core.events": [
1305,
1311,
1317,
1323,
1329,
1335,
1341,
1347,
1353,
1359,
1365,
1371,
1377,
1383,
1389,
1395,
1401,
1407,
1413,
1419,
1425,
1431,
1437,
1443,
1449,
1455,
1461,
1467
],
"core.event_count": 28,
"core.first_event_number": 1305,
"core.last_event_number": 1467,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0008_df-s03-d1_dw_0_20260203T133514.hdf5"
}
]
} 