Jobsub ID 297923.105@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.105@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:14:11 |
| From worker node | Hostname | dune001-1520611.0-lcg2721.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:03:27 |
| Input files | vd-protodune:np02vd_raw_run042433_0215_df-s02-d1_dw_0_20260203T200349.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4124s) |
| CPU time | 1h (3747s = 90%) |
| Max RSS bytes | 3566366720 (3401 MiB) |
| Outputting started | 2026-02-04 01:12:13 |
| Output files | |
| Finished | 2026-02-04 01:14:11 |
| Saved logs | justin-logs:297923.105-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x41caaba0, 0x243e4960
Caught exception in looking up space point ptr... 0x57a50660, 0x57a504c0
Caught exception in looking up space point ptr... 0x57a504c0, 0x57a507b0
Caught exception in looking up space point ptr... 0x2b0a3ea0, 0x7dad4750
Caught exception in looking up space point ptr... 0x7dad4750, 0x8059bdc0
Caught exception in looking up space point ptr... 0x5adaaa50, 0x5adaaf00
Caught exception in looking up space point ptr... 0x5adaaf00, 0x5adaaa50
Caught exception in looking up space point ptr... 0x5adaaa50, 0x5adaad70
Caught exception in looking up space point ptr... 0x5adaad70, 0x5adaaa50
Caught exception in looking up space point ptr... 0x69edadf0, 0x915b5aa0
Caught exception in looking up space point ptr... 0x69edaf80, 0x69edadf0
Caught exception in looking up space point ptr... 0x58ac6ed0, 0x2c2720b0
Caught exception in looking up space point ptr... 0x58a7c250, 0x58ac6ed0
Caught exception in looking up space point ptr... 0x8d9e8160, 0x55c04250
Caught exception in looking up space point ptr... 0x8d9e82f0, 0x8d9e8160
Caught exception in looking up space point ptr... 0x65276e00, 0x2bbb6440
Caught exception in looking up space point ptr... 0x65277120, 0x65276e00
Caught exception in looking up space point ptr... 0x4cb20740, 0x55c23c90
Caught exception in looking up space point ptr... 0x55c23c90, 0x55c23e20
Caught exception in looking up space point ptr... 0x8b13fe50, 0x52018d10
Caught exception in looking up space point ptr... 0x52018d10, 0x6449fbe0
Caught exception in looking up space point ptr... 0x24632dd0, 0x24625180
Caught exception in looking up space point ptr... 0x24641510, 0x24632dd0
Caught exception in looking up space point ptr... 0x292cbe60, 0x292bab60
Caught exception in looking up space point ptr... 0x292bab60, 0x292a9d10
Caught exception in looking up space point ptr... 0x797371c0, 0x79745f40
Caught exception in looking up space point ptr... 0x79725a10, 0x797371c0
Caught exception in looking up space point ptr... 0x2957ecb0, 0x761aaa30
Caught exception in looking up space point ptr... 0x2958ca90, 0x2957ecb0
Caught exception in looking up space point ptr... 0x51fe8590, 0x51fe80e0
Caught exception in looking up space point ptr... 0x51fe80e0, 0x51fe8400
Caught exception in looking up space point ptr... 0x4ce957e0, 0x4ce83220
Caught exception in looking up space point ptr... 0x4ce83220, 0x4ce715c0
Caught exception in looking up space point ptr... 0x56642690, 0x409e08c0
Caught exception in looking up space point ptr... 0x26d8e0b0, 0x56642690
Caught exception in looking up space point ptr... 0x5ada9d90, 0x5ada9c40
Caught exception in looking up space point ptr... 0x5ada9c40, 0x5adaa430
Caught exception in looking up space point ptr... 0x74ef34a0, 0x5adec290
Caught exception in looking up space point ptr... 0x5adec290, 0x74ef34a0
Caught exception in looking up space point ptr... 0x7062fdb0, 0x7062fc20
Caught exception in looking up space point ptr... 0x7062fc20, 0x7062f900
Caught exception in looking up space point ptr... 0x8ffe6cf0, 0x8ffe6e40
Caught exception in looking up space point ptr... 0x8ffe6e40, 0x8ffe6cf0
Caught exception in looking up space point ptr... 0x7b4d9e00, 0x7b4d9f90
Caught exception in looking up space point ptr... 0x7b4d9f90, 0x7b4d9c70
Caught exception in looking up space point ptr... 0x798eb2e0, 0x8fac1ca0
Caught exception in looking up space point ptr... 0x8fac1ca0, 0x798eb2e0
Caught exception in looking up space point ptr... 0x798eb2e0, 0x8fac1b10
Caught exception in looking up space point ptr... 0x8fac1b10, 0x798eb2e0
Caught exception in looking up space point ptr... 0x7c59d510, 0x7c59d800
Caught exception in looking up space point ptr... 0x7c59d800, 0x7c59d6b0
Caught exception in looking up space point ptr... 0x7e6c68b0, 0x264db0c0
Caught exception in looking up space point ptr... 0x264db0c0, 0x30219ca0
Caught exception in looking up space point ptr... 0x5018bad0, 0x5018bcb0
Caught exception in looking up space point ptr... 0x5018bcb0, 0x5018bad0
Caught exception in looking up space point ptr... 0x5add0cc0, 0x5add12b0
Caught exception in looking up space point ptr... 0x5add12b0, 0x5adce2f0
Caught exception in looking up space point ptr... 0x5dc039b0, 0x5dc03b40
Caught exception in looking up space point ptr... 0x5dc03b40, 0x5dc039b0
Caught exception in looking up space point ptr... 0x730039f0, 0x73003660
Caught exception in looking up space point ptr... 0x73003660, 0x73003790
Caught exception in looking up space point ptr... 0x90438270, 0x90438400
Caught exception in looking up space point ptr... 0x90438400, 0x904380e0
Caught exception in looking up space point ptr... 0x68bde0a0, 0x68bddd80
Caught exception in looking up space point ptr... 0x68bddd80, 0x68bddbf0
Caught exception in looking up space point ptr... 0x8f3e7760, 0x8f3e7cb0
Caught exception in looking up space point ptr... 0x8f3e7cb0, 0x8f3e7760
++++>>>> total num hits: 538733, num free: 527472
04-Feb-2026 01:12:04 UTC Closed output file "np02vd_raw_run042433_0215_df-s02-d1_dw_0_20260203T200349_reco_stage0_20260204T011204_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 168.481 212.652 240.804 212.224 18.3918 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.2399e-05 0.000152474 0.000270168 0.000121423 5.79388e-05 19
produce:tpcrawdecoder:PDVDTPCReader 19.1429 19.5439 20.1306 19.4688 0.255978 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.685715 0.698675 0.71544 0.692952 0.0107477 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230809 0.0233028 0.0237984 0.0232754 0.000184187 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.023132 0.0232637 0.0238672 0.0232511 0.000149558 19
produce:beamevent:BeamEvent 0.000149335 0.000260183 0.00146056 0.000200773 0.000284053 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.23013 3.56698 4.31015 3.49261 0.254771 19
produce:ophit:OpHitFinder 0.0356358 0.0407675 0.0483932 0.0398802 0.00323579 19
produce:wclsdatavd:WireCellToolkit 104.267 114.874 125.132 113.304 6.30303 19
produce:gaushit:GausHitFinder 1.38064 2.38425 3.37542 2.40063 0.513161 19
produce:nhitsfilter:NumberOfHitsFilter 0.000199761 0.000545292 0.00380813 0.00035113 0.000777069 19
produce:reco3d:SpacePointSolver 10.1918 15.9778 23.6471 15.8857 3.47793 19
produce:hitpdune:DisambigFromSpacePoints 0.202218 0.333821 0.518574 0.332842 0.0819914 19
produce:cluster3d:Cluster3D 2.24602 48.5623 64.8064 52.3696 16.8672 19
[art]:TriggerResults:TriggerResultInserter 3.1478e-05 4.86371e-05 0.000129756 4.5108e-05 2.01734e-05 19
end_path:out1:RootOutput 3.445e-06 1.02106e-05 3.2879e-05 9.535e-06 5.7881e-06 19
end_path:out1:RootOutput(write) 4.96675 6.56708 8.07252 6.73092 1.02107 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5835.42 MB
Peak resident set size usage (VmHWM): 3566.37 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0215_df-s02-d1_dw_0_20260203T200349_reco_stage0_20260204T011204_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0215_df-s02-d1_dw_0_20260203T200349_reco_stage0_20260204T011204_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0215_df-s02-d1_dw_0_20260203T200349_reco_stage0_20260204T011204_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163418.0,
"core.end_time": 1770167525.0,
"core.events": [
24517,
24523,
24529,
24535,
24541,
24547,
24553,
24559,
24565,
24571,
24577,
24583,
24589,
24595,
24601,
24607,
24613,
24619,
24625
],
"core.event_count": 19,
"core.first_event_number": 24517,
"core.last_event_number": 24625,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0215_df-s02-d1_dw_0_20260203T200349.hdf5"
}
]
} 