Jobsub ID 297917.111@dunegpschedd02.fnal.gov
| Jobsub ID | 297917.111@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce505 |
| Last heartbeat | 2026-02-03 23:54:50 |
| From worker node | Hostname | b9p35p0031.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:22:14 |
| Input files | vd-protodune:np02vd_raw_run042421_0112_df-s02-d1_dw_0_20260203T143134.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 30m (1830s) |
| CPU time | 28m (1723s = 94%) |
| Max RSS bytes | 2590883840 (2470 MiB) |
| Outputting started | 2026-02-03 23:52:45 |
| Output files | |
| Finished | 2026-02-03 23:54:50 |
| Saved logs | justin-logs:297917.111-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0b0
Caught exception in looking up space point ptr... 0x8f060b0, 0x11ee42c0
Caught exception in looking up space point ptr... 0x11ee42c0, 0x2b950ed0
Caught exception in looking up space point ptr... 0x2b950ed0, 0x422d5ae0
Caught exception in looking up space point ptr... 0x306f55f0, 0x306f1220
Caught exception in looking up space point ptr... 0x306f1220, 0x2b466d50
Caught exception in looking up space point ptr... 0x2b466d50, 0x573b1430
Caught exception in looking up space point ptr... 0x573b1430, 0x38645a90
Caught exception in looking up space point ptr... 0x32502b10, 0x48721be0
Caught exception in looking up space point ptr... 0x48721be0, 0x487218f0
Caught exception in looking up space point ptr... 0x487218f0, 0x2279a800
Caught exception in looking up space point ptr... 0x204896b0, 0x32502b10
Caught exception in looking up space point ptr... 0xc3735e0, 0x523b8b50
Caught exception in looking up space point ptr... 0x523b8b50, 0xc3735e0
Caught exception in looking up space point ptr... 0x3005a040, 0x38647b60
Caught exception in looking up space point ptr... 0x38647e00, 0x3005a360
Caught exception in looking up space point ptr... 0x3005a360, 0x3005a040
Caught exception in looking up space point ptr... 0x20fab8e0, 0x20fa4d30
Caught exception in looking up space point ptr... 0x20fa4d30, 0x20fa9620
Caught exception in looking up space point ptr... 0x20fa9620, 0x20fa3480
Caught exception in looking up space point ptr... 0x20fa3480, 0x20fac090
Caught exception in looking up space point ptr... 0x20fabf90, 0x20fab8e0
Caught exception in looking up space point ptr... 0xd06bb70, 0x5c765100
Caught exception in looking up space point ptr... 0x48a81e50, 0xd06bb70
Caught exception in looking up space point ptr... 0x5c752c40, 0x6125d4c0
Caught exception in looking up space point ptr... 0x53d28dd0, 0x5c752c40
Caught exception in looking up space point ptr... 0x397be030, 0x35434d60
Caught exception in looking up space point ptr... 0x35434d60, 0x2130cf50
Caught exception in looking up space point ptr... 0x2f8daa40, 0x2a94def0
Caught exception in looking up space point ptr... 0x39348480, 0x2f8daa40
Caught exception in looking up space point ptr... 0x24a01d20, 0x48b02a40
Caught exception in looking up space point ptr... 0x48b02a40, 0x24a01d20
Caught exception in looking up space point ptr... 0x129cf050, 0x249edb60
Caught exception in looking up space point ptr... 0x249edb60, 0x129cf050
Caught exception in looking up space point ptr... 0x3aaf0f00, 0x303853a0
Caught exception in looking up space point ptr... 0x303853a0, 0x53b87fb0
Caught exception in looking up space point ptr... 0x55f275d0, 0x55f279c0
Caught exception in looking up space point ptr... 0x55f279c0, 0x55f275d0
Caught exception in looking up space point ptr... 0x28929e60, 0x2892a160
Caught exception in looking up space point ptr... 0x2892a160, 0x2892c070
Caught exception in looking up space point ptr... 0x3353d200, 0x3353d390
Caught exception in looking up space point ptr... 0x3353d390, 0x3353d200
Caught exception in looking up space point ptr... 0x3bbbcad0, 0x247b1830
Caught exception in looking up space point ptr... 0x247b1830, 0x247b1970
Caught exception in looking up space point ptr... 0x49f67720, 0x2ac15800
Caught exception in looking up space point ptr... 0x2ac15800, 0xe28bbd0
Caught exception in looking up space point ptr... 0x5b581fb0, 0x2f1059f0
Caught exception in looking up space point ptr... 0x2f1059f0, 0x5b581fb0
Caught exception in looking up space point ptr... 0x546dc210, 0x546dc390
Caught exception in looking up space point ptr... 0x546dc390, 0x546dc210
Caught exception in looking up space point ptr... 0x546dc210, 0x546dc090
Caught exception in looking up space point ptr... 0x546dc090, 0x546dc210
Caught exception in looking up space point ptr... 0x546dc210, 0x546dbf60
Caught exception in looking up space point ptr... 0x546dbf60, 0x546dc210
Caught exception in looking up space point ptr... 0x3eeb2a40, 0x3eeb2c90
Caught exception in looking up space point ptr... 0x56168770, 0x3eeb2a40
Caught exception in looking up space point ptr... 0x5bfc4f50, 0x2b951c30
Caught exception in looking up space point ptr... 0x2b951c30, 0x4a7713d0
Caught exception in looking up space point ptr... 0xe8b1a20, 0xe8b1cc0
Caught exception in looking up space point ptr... 0xe8b1cc0, 0xe8b1a20
Caught exception in looking up space point ptr... 0x3c1bf210, 0x443af1f0
Caught exception in looking up space point ptr... 0x3aaf0a30, 0x3c1bf210
Caught exception in looking up space point ptr... 0x3bb16e80, 0x5bf3db20
Caught exception in looking up space point ptr... 0x5bf3db20, 0x48702b90
Caught exception in looking up space point ptr... 0x11b7daf0, 0x11b7dd90
Caught exception in looking up space point ptr... 0x11b7dd90, 0x11b7daf0
++++>>>> total num hits: 42789, num free: 41272
04-Feb-2026 00:52:39 CET Closed output file "np02vd_raw_run042421_0112_df-s02-d1_dw_0_20260203T143134_reco_stage0_20260203T235239_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.5669 65.9876 89.2383 64.6316 5.74881 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.483e-05 7.43175e-05 0.00012138 7.268e-05 1.50267e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.972 5.34842 33.2558 4.25251 5.47762 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00869285 0.0135563 0.0356551 0.0115323 0.00617376 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00037853 0.000599165 0.00091827 0.0005633 0.000140249 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.001173 0.00164395 0.00323656 0.00152865 0.000474688 27
produce:beamevent:BeamEvent 5.979e-05 0.000105865 0.00060293 8.573e-05 9.86265e-05 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.65812 2.02304 2.2786 2.05569 0.162738 27
produce:ophit:OpHitFinder 0.0235729 0.0330651 0.0410704 0.0345209 0.00546837 27
produce:wclsdatavd:WireCellToolkit 42.513 46.8827 52.0003 46.6797 2.49907 27
produce:gaushit:GausHitFinder 0.453018 0.706156 1.25338 0.678373 0.174857 27
produce:nhitsfilter:NumberOfHitsFilter 0.00010877 0.000171697 0.0004421 0.00015564 6.22508e-05 27
produce:reco3d:SpacePointSolver 3.75519 6.3478 11.2855 6.2892 1.67804 27
produce:hitpdune:DisambigFromSpacePoints 0.0346018 0.0687625 0.196816 0.0617388 0.0328708 27
produce:cluster3d:Cluster3D 0.418396 1.23205 2.73911 1.09538 0.608833 27
[art]:TriggerResults:TriggerResultInserter 2.305e-05 3.77778e-05 0.00019135 2.821e-05 3.15062e-05 27
end_path:out1:RootOutput 4.85e-06 6.22037e-06 1.775e-05 5.67e-06 2.47668e-06 27
end_path:out1:RootOutput(write) 2.73218 3.30574 4.26735 3.27073 0.305925 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4584.56 MB
Peak resident set size usage (VmHWM): 2590.88 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0112_df-s02-d1_dw_0_20260203T143134_reco_stage0_20260203T235239_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0112_df-s02-d1_dw_0_20260203T143134_reco_stage0_20260203T235239_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0112_df-s02-d1_dw_0_20260203T143134_reco_stage0_20260203T235239_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160940.0,
"core.end_time": 1770162761.0,
"core.events": [
18205,
18211,
18217,
18223,
18229,
18235,
18241,
18247,
18253,
18259,
18265,
18271,
18277,
18283,
18289,
18295,
18301,
18307,
18313,
18319,
18325,
18331,
18337,
18343,
18349,
18355,
18361
],
"core.event_count": 27,
"core.first_event_number": 18205,
"core.last_event_number": 18361,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0112_df-s02-d1_dw_0_20260203T143134.hdf5"
}
]
} 