Jobsub ID 303654.123@dunegpschedd01.fnal.gov
| Jobsub ID | 303654.123@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:13:49 |
| From worker node | Hostname | dune002-1603976.0-lcg2693.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:09:44 |
| Input files | vd-protodune:np02vd_raw_run042433_0191_df-s04-d1_dw_0_20260203T195442.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3733s) |
| CPU time | 56m (3369s = 90%) |
| Max RSS bytes | 3352289280 (3196 MiB) |
| Outputting started | 2026-02-04 01:11:58 |
| Output files | |
| Finished | 2026-02-04 01:13:49 |
| Saved logs | justin-logs:303654.123-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x4c01dd40, 0x4c01ded0
Caught exception in looking up space point ptr... 0x4c01ded0, 0x4c01dd40
Caught exception in looking up space point ptr... 0x1f33dcc0, 0x25c94360
Caught exception in looking up space point ptr... 0x25c94360, 0x1f33dcc0
Caught exception in looking up space point ptr... 0x1f33dcc0, 0x25c92490
Caught exception in looking up space point ptr... 0x25c92490, 0x1f33dcc0
Caught exception in looking up space point ptr... 0x54b8ec90, 0x80a5f6a0
Caught exception in looking up space point ptr... 0x80a5f6a0, 0x80a5f510
Caught exception in looking up space point ptr... 0x3d6b44b0, 0x3d6b47d0
Caught exception in looking up space point ptr... 0x3d6b47d0, 0x3d6b44b0
Caught exception in looking up space point ptr... 0x576c9210, 0x576c94a0
Caught exception in looking up space point ptr... 0x298ae870, 0x576c9210
Caught exception in looking up space point ptr... 0x221297e0, 0x2212dea0
Caught exception in looking up space point ptr... 0x2212dea0, 0x221297e0
Caught exception in looking up space point ptr... 0x515f0ca0, 0x22207310
Caught exception in looking up space point ptr... 0x22207310, 0x515f0ca0
Caught exception in looking up space point ptr... 0x28df2180, 0x28df2080
Caught exception in looking up space point ptr... 0x1a9416c0, 0x28df2180
Caught exception in looking up space point ptr... 0x567a2240, 0x567a2390
Caught exception in looking up space point ptr... 0x567a2390, 0x567a2240
Caught exception in looking up space point ptr... 0x7459df70, 0x1a96c580
Caught exception in looking up space point ptr... 0x1a96c580, 0x7459df70
Caught exception in looking up space point ptr... 0x4823baa0, 0x80b39a80
Caught exception in looking up space point ptr... 0x80b39a80, 0x5665c110
Caught exception in looking up space point ptr... 0x5665c110, 0x80b39a80
Caught exception in looking up space point ptr... 0x80b39a80, 0x5398d9f0
Caught exception in looking up space point ptr... 0x52507d60, 0x5aa7c140
Caught exception in looking up space point ptr... 0x5aa7c140, 0x52507d60
Caught exception in looking up space point ptr... 0x44619540, 0x44619900
Caught exception in looking up space point ptr... 0x44619900, 0x4460d670
Caught exception in looking up space point ptr... 0x4214dc80, 0x4215bc30
Caught exception in looking up space point ptr... 0x4215bc30, 0x4214dc80
Caught exception in looking up space point ptr... 0x4214dc80, 0x42155be0
Caught exception in looking up space point ptr... 0x42155be0, 0x4214dc80
Caught exception in looking up space point ptr... 0x52556630, 0x487659d0
Caught exception in looking up space point ptr... 0x487659d0, 0x52556630
Caught exception in looking up space point ptr... 0x7a818ca0, 0x7a818da0
Caught exception in looking up space point ptr... 0x7a818da0, 0x7a818ca0
Caught exception in looking up space point ptr... 0x563403d0, 0x563402a0
Caught exception in looking up space point ptr... 0x563402a0, 0x563403d0
Caught exception in looking up space point ptr... 0x234f2810, 0x234f2680
Caught exception in looking up space point ptr... 0x234f2680, 0x234f2810
Caught exception in looking up space point ptr... 0x1f24b030, 0x1f24d5a0
Caught exception in looking up space point ptr... 0x1f24d5a0, 0x1f24d280
Caught exception in looking up space point ptr... 0x8896b820, 0x8896b690
Caught exception in looking up space point ptr... 0x8896b690, 0x8896b820
Caught exception in looking up space point ptr... 0x421697e0, 0x4214df60
Caught exception in looking up space point ptr... 0x4214df60, 0x421697e0
Caught exception in looking up space point ptr... 0x5fd111a0, 0x5fd19c00
Caught exception in looking up space point ptr... 0x5fd19c00, 0x5fd1a450
Caught exception in looking up space point ptr... 0x87ff77d0, 0x203c7150
Caught exception in looking up space point ptr... 0x203c7150, 0x87ff78d0
Caught exception in looking up space point ptr... 0x80e3fd00, 0x80e3fe50
Caught exception in looking up space point ptr... 0x80e3fe50, 0x1c440530
Caught exception in looking up space point ptr... 0x56804e30, 0x56804980
Caught exception in looking up space point ptr... 0x56804980, 0x56804e30
Caught exception in looking up space point ptr... 0x4d84cc10, 0x2a8b5a70
Caught exception in looking up space point ptr... 0x2a8b5a70, 0x4d3d45d0
Caught exception in looking up space point ptr... 0x745acb00, 0x745acc90
Caught exception in looking up space point ptr... 0x745acc90, 0x745ad140
Caught exception in looking up space point ptr... 0x745ad140, 0x745ad2d0
Caught exception in looking up space point ptr... 0x1c440e70, 0x452d2ed0
Caught exception in looking up space point ptr... 0x452d2ed0, 0x1c440e70
Caught exception in looking up space point ptr... 0x52552250, 0x525520c0
Caught exception in looking up space point ptr... 0x525520c0, 0x52552250
Caught exception in looking up space point ptr... 0x1b9c6ef0, 0x1b9c6cf0
Caught exception in looking up space point ptr... 0x1b9c6cf0, 0x1b9c6ef0
++++>>>> total num hits: 144167, num free: 138273
04-Feb-2026 01:11:45 UTC Closed output file "np02vd_raw_run042433_0191_df-s04-d1_dw_0_20260203T195442_reco_stage0_20260204T011145_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 170.324 190.379 208.984 191.107 10.3373 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.4152e-05 0.000146783 0.000357018 0.000107231 8.06178e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.0667 18.0287 19.5369 18.2942 1.30203 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.684992 0.700484 0.757094 0.691381 0.018894 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0232151 0.0257615 0.0615807 0.0233655 0.00856979 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0231003 0.0233676 0.0237088 0.0233533 0.000153635 19
produce:beamevent:BeamEvent 0.000175314 0.000293664 0.0013751 0.000226691 0.000258514 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.78685 4.10566 4.49223 4.06617 0.184478 19
produce:ophit:OpHitFinder 0.0290421 0.0474244 0.0657943 0.0481289 0.00749826 19
produce:wclsdatavd:WireCellToolkit 118.491 132.43 142.4 132.581 6.60624 19
produce:gaushit:GausHitFinder 1.17435 1.89968 2.64824 1.91677 0.426377 19
produce:nhitsfilter:NumberOfHitsFilter 0.000248454 0.000485191 0.00145707 0.000439862 0.000262235 19
produce:reco3d:SpacePointSolver 12.7778 22.2562 37.2686 21.8273 6.41151 19
produce:hitpdune:DisambigFromSpacePoints 0.157747 0.27539 0.344745 0.282473 0.0509144 19
produce:cluster3d:Cluster3D 2.40754 3.70881 5.37357 3.6864 0.648567 19
[art]:TriggerResults:TriggerResultInserter 3.1598e-05 5.50471e-05 0.000163746 3.9379e-05 3.76308e-05 19
end_path:out1:RootOutput 9.364e-06 3.34995e-05 0.000382165 1.2579e-05 8.24956e-05 19
end_path:out1:RootOutput(write) 5.08573 6.80325 8.45397 7.07588 0.812648 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5641.48 MB
Peak resident set size usage (VmHWM): 3352.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0191_df-s04-d1_dw_0_20260203T195442_reco_stage0_20260204T011145_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0191_df-s04-d1_dw_0_20260203T195442_reco_stage0_20260204T011145_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0191_df-s04-d1_dw_0_20260203T195442_reco_stage0_20260204T011145_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163800.0,
"core.end_time": 1770167508.0,
"core.events": [
21785,
21791,
21797,
21803,
21809,
21815,
21821,
21827,
21833,
21839,
21845,
21851,
21857,
21863,
21869,
21875,
21881,
21887,
21893
],
"core.event_count": 19,
"core.first_event_number": 21785,
"core.last_event_number": 21893,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0191_df-s04-d1_dw_0_20260203T195442.hdf5"
}
]
} 