Jobsub ID 297920.27@dunegpschedd02.fnal.gov
| Jobsub ID | 297920.27@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:27 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 00:30:25 |
| From worker node | Hostname | b9p10p7838.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:37:10 |
| Input files | vd-protodune:np02vd_raw_run042433_0164_df-s03-d1_dw_0_20260203T194427.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 50m (3047s) |
| CPU time | 49m (2945s = 96%) |
| Max RSS bytes | 3369275392 (3213 MiB) |
| Outputting started | 2026-02-04 00:27:59 |
| Output files | |
| Finished | 2026-02-04 00:30:25 |
| Saved logs | justin-logs:297920.27-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
p space point ptr... 0x38f4e1b0, 0x45a8d680
Caught exception in looking up space point ptr... 0x1371d2a0, 0x1371d200
Caught exception in looking up space point ptr... 0xae25210, 0x1371d2a0
Caught exception in looking up space point ptr... 0x442f1220, 0x66e3e390
Caught exception in looking up space point ptr... 0x66e3e390, 0x442f1220
Caught exception in looking up space point ptr... 0x622b0cc0, 0x43db8f30
Caught exception in looking up space point ptr... 0x43db8e00, 0x622b0cc0
Caught exception in looking up space point ptr... 0x1797aa90, 0x50de45b0
Caught exception in looking up space point ptr... 0x50de45b0, 0x61b43870
Caught exception in looking up space point ptr... 0x11fdf5e0, 0x11fe0090
Caught exception in looking up space point ptr... 0x11fe0090, 0x11fdbce0
Caught exception in looking up space point ptr... 0x131793a0, 0x621c9430
Caught exception in looking up space point ptr... 0x621c9430, 0x13198180
Caught exception in looking up space point ptr... 0x63594db0, 0x635985e0
Caught exception in looking up space point ptr... 0x635985e0, 0x6359a200
Caught exception in looking up space point ptr... 0xa538bb0, 0xa538950
Caught exception in looking up space point ptr... 0xa538950, 0xa538bb0
Caught exception in looking up space point ptr... 0xa50cb10, 0xa51ea80
Caught exception in looking up space point ptr... 0xa51ea80, 0xa50cc50
Caught exception in looking up space point ptr... 0xa50cfe0, 0xa5214e0
Caught exception in looking up space point ptr... 0xa5214e0, 0xa50d110
Caught exception in looking up space point ptr... 0x124e5770, 0x4766d0d0
Caught exception in looking up space point ptr... 0x4766d0d0, 0x124e5770
Caught exception in looking up space point ptr... 0x34b88090, 0xe8a2500
Caught exception in looking up space point ptr... 0xe8a2500, 0x2b3e5720
Caught exception in looking up space point ptr... 0x59ebafc0, 0x5cd3dd40
Caught exception in looking up space point ptr... 0x5cd3dd40, 0x59ebafc0
Caught exception in looking up space point ptr... 0x5986dad0, 0x61f41b30
Caught exception in looking up space point ptr... 0x61f41b30, 0x5986dad0
Caught exception in looking up space point ptr... 0x33d4e200, 0x33d4dee0
Caught exception in looking up space point ptr... 0x33d4dee0, 0x33d4e390
Caught exception in looking up space point ptr... 0x103ecc30, 0x103ecaa0
Caught exception in looking up space point ptr... 0x103ecaa0, 0x103ecc30
Caught exception in looking up space point ptr... 0x103ecc30, 0x103ec780
Caught exception in looking up space point ptr... 0x103ec780, 0x103ecc30
Caught exception in looking up space point ptr... 0x118e1cd0, 0x118e1f60
Caught exception in looking up space point ptr... 0x118e1f60, 0x118e2380
Caught exception in looking up space point ptr... 0x10a2c8f0, 0x7da23df0
Caught exception in looking up space point ptr... 0x7da23df0, 0x4777f180
Caught exception in looking up space point ptr... 0x5b8de8b0, 0x5b8bd050
Caught exception in looking up space point ptr... 0x5b8bd050, 0x5b8de8b0
Caught exception in looking up space point ptr... 0x103ea780, 0x103ea460
Caught exception in looking up space point ptr... 0x103ea460, 0x103ea2d0
Caught exception in looking up space point ptr... 0x18dc45c0, 0x18dc4470
Caught exception in looking up space point ptr... 0x18dc4470, 0x18dc45c0
Caught exception in looking up space point ptr... 0x7deb4a40, 0x58c50e10
Caught exception in looking up space point ptr... 0x58c50e10, 0x7deb6ec0
Caught exception in looking up space point ptr... 0x13714de0, 0x13716330
Caught exception in looking up space point ptr... 0x13716330, 0x13714cb0
Caught exception in looking up space point ptr... 0x1796aba0, 0x3e5f8d40
Caught exception in looking up space point ptr... 0x2d783b60, 0x1796aba0
Caught exception in looking up space point ptr... 0x12bc02d0, 0x12bc0170
Caught exception in looking up space point ptr... 0x12bc0170, 0x12bc02d0
Caught exception in looking up space point ptr... 0xae1eee0, 0xae22440
Caught exception in looking up space point ptr... 0xae22440, 0xae1eee0
Caught exception in looking up space point ptr... 0x2a0ee670, 0x59872fb0
Caught exception in looking up space point ptr... 0x59872fb0, 0x2a0ee670
Caught exception in looking up space point ptr... 0x2a0ee670, 0x6ae18510
Caught exception in looking up space point ptr... 0x6ae18510, 0x2a0ee670
Caught exception in looking up space point ptr... 0x856f36c0, 0x2a0d04d0
Caught exception in looking up space point ptr... 0x2a0d04d0, 0x7cedda40
Caught exception in looking up space point ptr... 0x67bd19f0, 0x132ffbf0
Caught exception in looking up space point ptr... 0x132ffbf0, 0x67bd19f0
Caught exception in looking up space point ptr... 0x3d1b5910, 0x91ad6f0
Caught exception in looking up space point ptr... 0x91ad6f0, 0x3d1b5910
Caught exception in looking up space point ptr... 0x66e78340, 0x66e77fd0
Caught exception in looking up space point ptr... 0x66e77fd0, 0x66e78340
++++>>>> total num hits: 107039, num free: 102768
04-Feb-2026 01:27:49 CET Closed output file "np02vd_raw_run042433_0164_df-s03-d1_dw_0_20260203T194427_reco_stage0_20260204T002749_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 130.583 156.61 185.987 153.956 14.3253 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.3541e-05 0.000119652 0.000286241 0.00010151 5.81639e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.12509 6.71732 7.3501 6.73356 0.331118 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0122551 0.0216049 0.0609647 0.0169383 0.0116799 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000471001 0.00058236 0.000819411 0.000544504 0.000100722 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000430395 0.000536351 0.000778922 0.000526701 8.4046e-05 19
produce:beamevent:BeamEvent 8.202e-05 0.000148816 0.000759195 0.000100861 0.00014983 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.27234 2.82467 3.23533 2.82883 0.295767 19
produce:ophit:OpHitFinder 0.0313624 0.0375963 0.0455712 0.0377528 0.00386234 19
produce:wclsdatavd:WireCellToolkit 102.301 117.461 140.179 116.295 11.0935 19
produce:gaushit:GausHitFinder 0.83604 1.43127 2.10105 1.39059 0.285316 19
produce:nhitsfilter:NumberOfHitsFilter 0.000246842 0.000390763 0.000580784 0.000403845 7.44456e-05 19
produce:reco3d:SpacePointSolver 11.2996 19.859 24.3545 21.3954 3.82487 19
produce:hitpdune:DisambigFromSpacePoints 0.100571 0.187947 0.309418 0.16434 0.0580139 19
produce:cluster3d:Cluster3D 1.35606 2.59459 3.76284 2.57953 0.667061 19
[art]:TriggerResults:TriggerResultInserter 2.398e-05 3.48722e-05 0.00011048 3.014e-05 1.84286e-05 19
end_path:out1:RootOutput 4.1e-06 9.59105e-06 3.086e-05 8.13e-06 5.87779e-06 19
end_path:out1:RootOutput(write) 4.21467 5.43614 6.47774 5.44237 0.796731 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5362.29 MB
Peak resident set size usage (VmHWM): 3369.28 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0164_df-s03-d1_dw_0_20260203T194427_reco_stage0_20260204T002749_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0164_df-s03-d1_dw_0_20260203T194427_reco_stage0_20260204T002749_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0164_df-s03-d1_dw_0_20260203T194427_reco_stage0_20260204T002749_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161846.0,
"core.end_time": 1770164871.0,
"core.events": [
18705,
18711,
18717,
18723,
18729,
18735,
18741,
18747,
18753,
18759,
18765,
18771,
18777,
18783,
18789,
18795,
18801,
18807,
18813
],
"core.event_count": 19,
"core.first_event_number": 18705,
"core.last_event_number": 18813,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0164_df-s03-d1_dw_0_20260203T194427.hdf5"
}
]
} 