Jobsub ID 297921.126@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.126@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:22:45 |
| From worker node | Hostname | dune002-1603636.0-lcg2678.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:04 |
| Input files | vd-protodune:np02vd_raw_run042433_0462_df-s04-d0_dw_0_20260203T213742.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5054s) |
| CPU time | 1h (4697s = 92%) |
| Max RSS bytes | 3542917120 (3378 MiB) |
| Outputting started | 2026-02-04 01:20:21 |
| Output files | |
| Finished | 2026-02-04 01:22:45 |
| Saved logs | justin-logs:297921.126-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0xb82661b0, 0x9d471400
Caught exception in looking up space point ptr... 0xb9491b90, 0xb9491940
Caught exception in looking up space point ptr... 0xb949ad90, 0xb9491b90
Caught exception in looking up space point ptr... 0x8f7dd150, 0x8f7e3d30
Caught exception in looking up space point ptr... 0x8f7dcf00, 0x8f7dd150
Caught exception in looking up space point ptr... 0x44988310, 0x449c2470
Caught exception in looking up space point ptr... 0x449ed520, 0x44988310
Caught exception in looking up space point ptr... 0x40c9f820, 0x5ce28bf0
Caught exception in looking up space point ptr... 0x64d2aa80, 0x40c9f820
Caught exception in looking up space point ptr... 0x9d497fa0, 0x9d4982f0
Caught exception in looking up space point ptr... 0x9d4982f0, 0x9d485490
Caught exception in looking up space point ptr... 0x3d86f460, 0x9bf30db0
Caught exception in looking up space point ptr... 0x9bf30db0, 0x400d51a0
Caught exception in looking up space point ptr... 0x743c0780, 0x8a201b00
Caught exception in looking up space point ptr... 0xb9440840, 0x743c0780
Caught exception in looking up space point ptr... 0x977258f0, 0x385024a0
Caught exception in looking up space point ptr... 0x97725760, 0x977258f0
Caught exception in looking up space point ptr... 0x8f81e2c0, 0xb8256400
Caught exception in looking up space point ptr... 0xb8256400, 0x9d46b7e0
Caught exception in looking up space point ptr... 0x73fa5ee0, 0x889beae0
Caught exception in looking up space point ptr... 0x889beae0, 0x889be950
Caught exception in looking up space point ptr... 0x64fb91d0, 0x64fb9360
Caught exception in looking up space point ptr... 0x64fb9360, 0x64fb9680
Caught exception in looking up space point ptr... 0x89f8a320, 0x4721dee0
Caught exception in looking up space point ptr... 0x4721dee0, 0x89f8a320
Caught exception in looking up space point ptr... 0x38cd1b00, 0x38cd1c50
Caught exception in looking up space point ptr... 0x38cd1c50, 0x38cd1b00
Caught exception in looking up space point ptr... 0x5ba4fa00, 0x5ba4f8b0
Caught exception in looking up space point ptr... 0x5ba4f8b0, 0x9391e790
Caught exception in looking up space point ptr... 0x3e805b40, 0x3e7f3710
Caught exception in looking up space point ptr... 0x3e817160, 0x3e805b40
Caught exception in looking up space point ptr... 0x71a9b970, 0x71aa0830
Caught exception in looking up space point ptr... 0x71aa0830, 0x71a9bbc0
Caught exception in looking up space point ptr... 0x9771e870, 0x384fb290
Caught exception in looking up space point ptr... 0x9771ea00, 0x9771e870
Caught exception in looking up space point ptr... 0x709d26f0, 0x709d23d0
Caught exception in looking up space point ptr... 0x709d23d0, 0x709d1f20
Caught exception in looking up space point ptr... 0x3e67a760, 0x3fb553d0
Caught exception in looking up space point ptr... 0x3e67a8f0, 0x3e67a760
Caught exception in looking up space point ptr... 0x434cfd00, 0x434cfb70
Caught exception in looking up space point ptr... 0x434cfb70, 0x8e01baf0
Caught exception in looking up space point ptr... 0x9776fcf0, 0x9776fb60
Caught exception in looking up space point ptr... 0x9776fb60, 0x3dfa0e40
Caught exception in looking up space point ptr... 0x8dff9250, 0x8dff8f30
Caught exception in looking up space point ptr... 0x8dff8f30, 0x8dff8a80
Caught exception in looking up space point ptr... 0x6a397c30, 0x6a3854e0
Caught exception in looking up space point ptr... 0x6a3aa3d0, 0x6a397c30
Caught exception in looking up space point ptr... 0x9c9f8ed0, 0x72bf4170
Caught exception in looking up space point ptr... 0x9ca0a4f0, 0x9c9f8ed0
Caught exception in looking up space point ptr... 0xb467e170, 0x9af6e8c0
Caught exception in looking up space point ptr... 0x88065f80, 0xb467e170
Caught exception in looking up space point ptr... 0x93e512a0, 0x93e3f960
Caught exception in looking up space point ptr... 0x93e3f960, 0x93e2e980
Caught exception in looking up space point ptr... 0x95049990, 0xb8af6790
Caught exception in looking up space point ptr... 0xb8af6790, 0x95049990
Caught exception in looking up space point ptr... 0x8ffece00, 0x8ffed2f0
Caught exception in looking up space point ptr... 0x8ffed2f0, 0x8ffece00
Caught exception in looking up space point ptr... 0x8a21ba70, 0x706a4e30
Caught exception in looking up space point ptr... 0x706a4e30, 0x8a21ba70
Caught exception in looking up space point ptr... 0x7039c460, 0x7039c910
Caught exception in looking up space point ptr... 0x7039c910, 0x7039c460
Caught exception in looking up space point ptr... 0x6892ab80, 0x6892aa30
Caught exception in looking up space point ptr... 0x6892aa30, 0x6892ab80
Caught exception in looking up space point ptr... 0x882b5770, 0xa7d5bb80
Caught exception in looking up space point ptr... 0xa7d5bb80, 0xa7d59ee0
Caught exception in looking up space point ptr... 0x8733adb0, 0x7c873f30
Caught exception in looking up space point ptr... 0x7c873f30, 0x8733adb0
++++>>>> total num hits: 520784, num free: 510574
04-Feb-2026 01:20:08 UTC Closed output file "np02vd_raw_run042433_0462_df-s04-d0_dw_0_20260203T213742_reco_stage0_20260204T012008_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 189.857 260.642 311.502 279.021 37.3024 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000108124 0.000172044 0.000368262 0.000133731 8.01311e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.8448 18.0678 21.4535 17.4517 1.40438 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.680787 0.695306 0.726963 0.691605 0.0124385 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229323 0.0232571 0.0243539 0.0231695 0.0003453 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229201 0.0235746 0.027962 0.0231111 0.00126439 19
produce:beamevent:BeamEvent 0.000110357 0.000270663 0.00149452 0.000216928 0.000290681 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.34967 4.25689 4.82833 4.29883 0.399257 19
produce:ophit:OpHitFinder 0.0369328 0.0500228 0.055718 0.0507777 0.00416549 19
produce:wclsdatavd:WireCellToolkit 140.559 158.487 166.493 159.385 6.62467 19
produce:gaushit:GausHitFinder 1.57964 2.81719 4.30121 2.99796 0.745678 19
produce:nhitsfilter:NumberOfHitsFilter 0.000349838 0.000536776 0.00113853 0.000495111 0.000174144 19
produce:reco3d:SpacePointSolver 8.44123 19.3208 31.4106 19.5922 4.70448 19
produce:hitpdune:DisambigFromSpacePoints 0.171558 0.416267 0.799287 0.435064 0.149555 19
produce:cluster3d:Cluster3D 2.60311 47.9006 78.9208 67.9531 33.9748 19
[art]:TriggerResults:TriggerResultInserter 2.658e-05 5.84114e-05 0.000156244 4.5676e-05 3.5153e-05 19
end_path:out1:RootOutput 4.809e-06 2.68263e-05 0.000333607 9.358e-06 7.24492e-05 19
end_path:out1:RootOutput(write) 6.52377 8.51761 10.0797 9.01877 1.18854 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5734.76 MB
Peak resident set size usage (VmHWM): 3542.92 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0462_df-s04-d0_dw_0_20260203T213742_reco_stage0_20260204T012008_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0462_df-s04-d0_dw_0_20260203T213742_reco_stage0_20260204T012008_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0462_df-s04-d0_dw_0_20260203T213742_reco_stage0_20260204T012008_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162977.0,
"core.end_time": 1770168010.0,
"core.events": [
52678,
52684,
52690,
52696,
52702,
52708,
52714,
52720,
52726,
52732,
52738,
52744,
52750,
52756,
52762,
52768,
52774,
52780,
52786
],
"core.event_count": 19,
"core.first_event_number": 52678,
"core.last_event_number": 52786,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0462_df-s04-d0_dw_0_20260203T213742.hdf5"
}
]
} 