Jobsub ID 297920.119@dunegpschedd02.fnal.gov
| Jobsub ID | 297920.119@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:27 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce05 |
| Last heartbeat | 2026-02-04 00:53:42 |
| From worker node | Hostname | dune001-1845412.0-lcg2664.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:42:56 |
| Input files | vd-protodune:np02vd_raw_run042433_0243_df-s04-d0_dw_0_20260203T201429.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4135s) |
| CPU time | 1h (3802s = 91%) |
| Max RSS bytes | 3474395136 (3313 MiB) |
| Outputting started | 2026-02-04 00:51:53 |
| Output files | |
| Finished | 2026-02-04 00:53:42 |
| Saved logs | justin-logs:297920.119-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
.. 0x4c1d4a40, 0x4c1d4c20
Caught exception in looking up space point ptr... 0x4c1d4c20, 0x59d17780
Caught exception in looking up space point ptr... 0x6d023dc0, 0x6d023c30
Caught exception in looking up space point ptr... 0x6d023c30, 0x6d023910
Caught exception in looking up space point ptr... 0x9dc6f0e0, 0x9dc6f1d0
Caught exception in looking up space point ptr... 0x9dc6f1d0, 0x9dc6f0e0
Caught exception in looking up space point ptr... 0x2cfb6e30, 0x34700910
Caught exception in looking up space point ptr... 0x34700910, 0x2cfb6e30
Caught exception in looking up space point ptr... 0x818e5640, 0x818e0860
Caught exception in looking up space point ptr... 0x818e0860, 0x818de710
Caught exception in looking up space point ptr... 0x80fd8b70, 0x6d03eac0
Caught exception in looking up space point ptr... 0x6d03eac0, 0x51c16b30
Caught exception in looking up space point ptr... 0x8f2f9540, 0x32e46330
Caught exception in looking up space point ptr... 0x32e46330, 0x8f2f9540
Caught exception in looking up space point ptr... 0x8f2f9540, 0x32e461e0
Caught exception in looking up space point ptr... 0x32e461e0, 0x8f2f9540
Caught exception in looking up space point ptr... 0x94bc3440, 0x94bc3540
Caught exception in looking up space point ptr... 0x94bc3540, 0x94bc3740
Caught exception in looking up space point ptr... 0x986191f0, 0x98618ed0
Caught exception in looking up space point ptr... 0x986134e0, 0x986191f0
Caught exception in looking up space point ptr... 0x7dfd8740, 0x7dfd8420
Caught exception in looking up space point ptr... 0x7dfee120, 0x7dfd8740
Caught exception in looking up space point ptr... 0x68093e60, 0x80332d40
Caught exception in looking up space point ptr... 0x80332d40, 0x68093e60
Caught exception in looking up space point ptr... 0x51c2f540, 0x51c17440
Caught exception in looking up space point ptr... 0x51c17440, 0x51c141a0
Caught exception in looking up space point ptr... 0x51c141a0, 0x51c11000
Caught exception in looking up space point ptr... 0x36039aa0, 0x65be5eb0
Caught exception in looking up space point ptr... 0x65be5eb0, 0x806b8360
Caught exception in looking up space point ptr... 0x60527aa0, 0x60527c30
Caught exception in looking up space point ptr... 0x60527c30, 0x60527dc0
Caught exception in looking up space point ptr... 0x345649c0, 0x34564870
Caught exception in looking up space point ptr... 0x34564870, 0x345649c0
Caught exception in looking up space point ptr... 0x35f30370, 0x35f30500
Caught exception in looking up space point ptr... 0x35f30500, 0x35f30690
Caught exception in looking up space point ptr... 0x35747260, 0x35745b90
Caught exception in looking up space point ptr... 0x35737890, 0x810d89d0
Caught exception in looking up space point ptr... 0x810d89d0, 0x810d8ad0
Caught exception in looking up space point ptr... 0x810d8ad0, 0x35747260
Caught exception in looking up space point ptr... 0x9045ab60, 0x9045ae80
Caught exception in looking up space point ptr... 0x9045ae80, 0x9045acf0
Caught exception in looking up space point ptr... 0x94e31dc0, 0x94e31fa0
Caught exception in looking up space point ptr... 0x94e31fa0, 0x94e2db20
Caught exception in looking up space point ptr... 0x7f77d5a0, 0x7f77d730
Caught exception in looking up space point ptr... 0x7f77d730, 0x7f77d8c0
Caught exception in looking up space point ptr... 0x7f79b970, 0x7f79b4c0
Caught exception in looking up space point ptr... 0x7f79b4c0, 0x7f79b970
Caught exception in looking up space point ptr... 0x9570e130, 0x8e765190
Caught exception in looking up space point ptr... 0x8e765190, 0x9570e130
Caught exception in looking up space point ptr... 0x5e484930, 0x5e484760
Caught exception in looking up space point ptr... 0x5e484760, 0x94f99df0
Caught exception in looking up space point ptr... 0x647d3610, 0x8a3dac10
Caught exception in looking up space point ptr... 0x8a3dac10, 0x647d3610
Caught exception in looking up space point ptr... 0x3573fb00, 0x81104930
Caught exception in looking up space point ptr... 0x81104930, 0x3573fb00
Caught exception in looking up space point ptr... 0x80fe79a0, 0x80fe3b10
Caught exception in looking up space point ptr... 0x80fe2ee0, 0x80fe79a0
Caught exception in looking up space point ptr... 0x3158f1e0, 0x31591fd0
Caught exception in looking up space point ptr... 0x31591fd0, 0x3158f1e0
Caught exception in looking up space point ptr... 0x7f798e90, 0x7f798f90
Caught exception in looking up space point ptr... 0x7f798f90, 0x7f798e90
Caught exception in looking up space point ptr... 0x3280c7f0, 0x3280bf00
Caught exception in looking up space point ptr... 0x3280bf00, 0x3280c7f0
Caught exception in looking up space point ptr... 0x6803db30, 0x6803de50
Caught exception in looking up space point ptr... 0x6803de50, 0x6803db30
Caught exception in looking up space point ptr... 0x98e941e0, 0x98e94310
Caught exception in looking up space point ptr... 0x98e94310, 0x98e941e0
++++>>>> total num hits: 89812, num free: 86852
04-Feb-2026 00:51:40 UTC Closed output file "np02vd_raw_run042433_0243_df-s04-d0_dw_0_20260203T201429_reco_stage0_20260204T005140_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 183.238 212.119 320.417 204.016 27.5765 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000105229 0.000145607 0.000330134 0.000119937 6.07644e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.6583 18.0092 18.9394 18.0304 0.533763 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.686938 0.697231 0.716078 0.694287 0.00966116 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0231721 0.0241917 0.0384421 0.0233663 0.00336532 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0230749 0.0237391 0.028613 0.0234074 0.00117687 19
produce:beamevent:BeamEvent 0.000128653 0.00026826 0.00127365 0.000228631 0.00024094 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.55827 3.97907 4.47967 3.92081 0.263463 19
produce:ophit:OpHitFinder 0.0277582 0.0476126 0.0684857 0.0502197 0.00948043 19
produce:wclsdatavd:WireCellToolkit 120.482 142.633 162.433 140.806 10.3868 19
produce:gaushit:GausHitFinder 1.25445 1.97992 3.05922 1.91165 0.450562 19
produce:nhitsfilter:NumberOfHitsFilter 0.000417579 0.000575992 0.000996023 0.000566038 0.000120511 19
produce:reco3d:SpacePointSolver 21.89 30.0676 58.7993 29.1229 7.74768 19
produce:hitpdune:DisambigFromSpacePoints 0.183248 0.313824 0.820709 0.272731 0.142941 19
produce:cluster3d:Cluster3D 2.16997 7.23951 71.0463 3.61272 15.0778 19
[art]:TriggerResults:TriggerResultInserter 2.5388e-05 5.29599e-05 0.000270861 3.6489e-05 5.52877e-05 19
end_path:out1:RootOutput 7.114e-06 2.4541e-05 0.000235835 1.1852e-05 5.01406e-05 19
end_path:out1:RootOutput(write) 5.7 7.02796 9.54957 7.06539 0.877675 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5736.84 MB
Peak resident set size usage (VmHWM): 3474.4 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0243_df-s04-d0_dw_0_20260203T201429_reco_stage0_20260204T005140_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0243_df-s04-d0_dw_0_20260203T201429_reco_stage0_20260204T005140_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0243_df-s04-d0_dw_0_20260203T201429_reco_stage0_20260204T005140_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162192.0,
"core.end_time": 1770166302.0,
"core.events": [
27712,
27718,
27724,
27730,
27736,
27742,
27748,
27754,
27760,
27766,
27772,
27778,
27784,
27790,
27796,
27802,
27808,
27814,
27820
],
"core.event_count": 19,
"core.first_event_number": 27712,
"core.last_event_number": 27820,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0243_df-s04-d0_dw_0_20260203T201429.hdf5"
}
]
} 