Jobsub ID 297920.34@dunegpschedd02.fnal.gov
| Jobsub ID | 297920.34@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:27 |
| Site | UK_Oxford |
| Entry | DUNE_UK_SGrid_Oxford_arc01 |
| Last heartbeat | 2026-02-04 03:35:32 |
| From worker node | Hostname | t2wn170.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:37:47 |
| Input files | vd-protodune:np02vd_raw_run042433_0627_df-s02-d0_dw_0_20260203T224025.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13971s) |
| CPU time | 2h (8860s = 63%) |
| Max RSS bytes | 10094055424 (9626 MiB) |
| Outputting started | 2026-02-04 03:30:43 |
| Output files | |
| Finished | 2026-02-04 03:35:32 |
| Saved logs | justin-logs:297920.34-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x65049e10, 0x41599bf0
Caught exception in looking up space point ptr... 0x146cb72f0, 0x65049e10
Caught exception in looking up space point ptr... 0x1048fce70, 0x88e41800
Caught exception in looking up space point ptr... 0x88e41800, 0x66fdf420
Caught exception in looking up space point ptr... 0x31bf0780, 0x62042340
Caught exception in looking up space point ptr... 0x146c8bd30, 0x31bf0780
Caught exception in looking up space point ptr... 0x2b6def60, 0xb5971b0
Caught exception in looking up space point ptr... 0xdd660390, 0x2b6def60
Caught exception in looking up space point ptr... 0x12b5e280, 0x12b86e60
Caught exception in looking up space point ptr... 0x12b86e60, 0x12b86cd0
Caught exception in looking up space point ptr... 0x9554d090, 0x38e26eb0
Caught exception in looking up space point ptr... 0xc1dbc540, 0x9554d090
Caught exception in looking up space point ptr... 0x4bc75920, 0x2b71b660
Caught exception in looking up space point ptr... 0x2b71b660, 0x4bc75920
Caught exception in looking up space point ptr... 0x36924640, 0x369244f0
Caught exception in looking up space point ptr... 0x369244f0, 0xeed0570
Caught exception in looking up space point ptr... 0xdd6c9810, 0x428e2aa0
Caught exception in looking up space point ptr... 0x428e2aa0, 0xa941b00
Caught exception in looking up space point ptr... 0x694460a0, 0x16036750
Caught exception in looking up space point ptr... 0x69446230, 0x694460a0
Caught exception in looking up space point ptr... 0x5614f880, 0x5614fa10
Caught exception in looking up space point ptr... 0x18adf6c0, 0x5614f880
Caught exception in looking up space point ptr... 0x4f74aa90, 0x4f73c990
Caught exception in looking up space point ptr... 0x4f73c990, 0x4f72e890
Caught exception in looking up space point ptr... 0x499b3330, 0x499a1ea0
Caught exception in looking up space point ptr... 0x499c4950, 0x499b3330
Caught exception in looking up space point ptr... 0x2ba88c80, 0x2ba77020
Caught exception in looking up space point ptr... 0x2ba99170, 0x2ba88c80
Caught exception in looking up space point ptr... 0x64057250, 0x3a398470
Caught exception in looking up space point ptr... 0x3a39ae80, 0x64057250
Caught exception in looking up space point ptr... 0x96436120, 0x96424650
Caught exception in looking up space point ptr... 0x96424650, 0x2b070790
Caught exception in looking up space point ptr... 0x7b1acf40, 0x4be698c0
Caught exception in looking up space point ptr... 0x4be698c0, 0x4be69a30
Caught exception in looking up space point ptr... 0x3c6855f0, 0x3c268b10
Caught exception in looking up space point ptr... 0x483459e0, 0x3c6855f0
Caught exception in looking up space point ptr... 0x67705f30, 0x677e2e00
Caught exception in looking up space point ptr... 0x677e2e00, 0x677e2fc0
Caught exception in looking up space point ptr... 0x677e2fc0, 0x5413b060
Caught exception in looking up space point ptr... 0x39d7a4b0, 0x4ea87800
Caught exception in looking up space point ptr... 0x4ea87800, 0x39d7a4b0
Caught exception in looking up space point ptr... 0x5a69a5c0, 0x2c7bd950
Caught exception in looking up space point ptr... 0x2c7bd950, 0x5a69a5c0
Caught exception in looking up space point ptr... 0x5a69a5c0, 0x433788a0
Caught exception in looking up space point ptr... 0x433788a0, 0x5a69a5c0
Caught exception in looking up space point ptr... 0x5412c5e0, 0x7fcca9e0
Caught exception in looking up space point ptr... 0x7fcca9e0, 0x5412c440
Caught exception in looking up space point ptr... 0x3bd002a0, 0x658dfbf0
Caught exception in looking up space point ptr... 0x658dfbf0, 0x658dfaf0
Caught exception in looking up space point ptr... 0x8022e2b0, 0x48b3d490
Caught exception in looking up space point ptr... 0x48b3d490, 0x540baa90
Caught exception in looking up space point ptr... 0x8cb166c0, 0x364c7270
Caught exception in looking up space point ptr... 0x364c7270, 0x364c7120
Caught exception in looking up space point ptr... 0x3b0bc3f0, 0x2c893450
Caught exception in looking up space point ptr... 0x2c893450, 0x3b0bc3f0
Caught exception in looking up space point ptr... 0x433dff80, 0x481c6dd0
Caught exception in looking up space point ptr... 0x481c6dd0, 0x433dff80
Caught exception in looking up space point ptr... 0x433dff80, 0x7b219f40
Caught exception in looking up space point ptr... 0x7b219f40, 0x433dff80
Caught exception in looking up space point ptr... 0xb9f4cef0, 0x38de6780
Caught exception in looking up space point ptr... 0x38de6780, 0xb48b190
Caught exception in looking up space point ptr... 0x57a1c760, 0x57a1c960
Caught exception in looking up space point ptr... 0x57a1c960, 0x57a1c760
Caught exception in looking up space point ptr... 0x152b35a0, 0x7b204840
Caught exception in looking up space point ptr... 0x7b204840, 0x3c6dd030
Caught exception in looking up space point ptr... 0x677aac40, 0x674e7c30
Caught exception in looking up space point ptr... 0x674e7c30, 0x7eaf2fe0
++++>>>> total num hits: 512025, num free: 502810
04-Feb-2026 03:30:15 GMT Closed output file "np02vd_raw_run042433_0627_df-s02-d0_dw_0_20260203T224025_reco_stage0_20260204T033015_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 381.581 727.904 1531.5 537.612 377.882 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.7816e-05 0.000177718 0.00030746 0.000177705 5.22045e-05 19
produce:tpcrawdecoder:PDVDTPCReader 157.12 246.438 353.023 243.521 50.9243 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.765655 1.21518 2.81402 1.17731 0.430585 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0193616 0.0386062 0.26778 0.0204255 0.0568953 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.019256 0.0214269 0.0467962 0.0200338 0.00598955 19
produce:beamevent:BeamEvent 0.000155874 0.000407894 0.00191025 0.000252637 0.000425987 19
produce:pdvddaphne:DAPHNEReaderPDVD 12.2425 19.5601 24.4824 19.8552 3.09137 19
produce:ophit:OpHitFinder 0.0379608 0.0470256 0.0589429 0.0485322 0.00537899 19
produce:wclsdatavd:WireCellToolkit 130.87 160.252 176.364 165.748 13.2874 19
produce:gaushit:GausHitFinder 1.79146 3.85132 11.2604 3.2307 2.18856 19
produce:nhitsfilter:NumberOfHitsFilter 0.000458925 0.000770771 0.00132082 0.000702545 0.000265513 19
produce:reco3d:SpacePointSolver 12.6084 31.902 72.7243 21.7742 20.3548 19
produce:hitpdune:DisambigFromSpacePoints 0.134692 0.861537 2.54212 0.451586 0.789572 19
produce:cluster3d:Cluster3D 2.14887 251.704 981.192 80.9881 338.556 19
[art]:TriggerResults:TriggerResultInserter 2.8344e-05 5.84709e-05 0.000146827 5.5535e-05 2.5928e-05 19
end_path:out1:RootOutput 3.938e-06 2.47698e-05 0.000283925 9.327e-06 6.14163e-05 19
end_path:out1:RootOutput(write) 6.44478 11.9202 24.1608 8.78665 6.26164 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12711.2 MB
Peak resident set size usage (VmHWM): 10094.1 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0627_df-s02-d0_dw_0_20260203T224025_reco_stage0_20260204T033015_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0627_df-s02-d0_dw_0_20260203T224025_reco_stage0_20260204T033015_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0627_df-s02-d0_dw_0_20260203T224025_reco_stage0_20260204T033015_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161885.0,
"core.end_time": 1770175818.0,
"core.events": [
71484,
71490,
71496,
71502,
71508,
71514,
71520,
71526,
71532,
71538,
71544,
71550,
71556,
71562,
71568,
71574,
71580,
71586,
71592
],
"core.event_count": 19,
"core.first_event_number": 71484,
"core.last_event_number": 71592,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0627_df-s02-d0_dw_0_20260203T224025.hdf5"
}
]
} 