Jobsub ID 297923.33@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.33@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce503 |
| Last heartbeat | 2026-02-04 00:42:09 |
| From worker node | Hostname | b9p02p6824.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:57:43 |
| Input files | vd-protodune:np02vd_raw_run042433_0584_df-s03-d1_dw_0_20260203T222404.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2526s) |
| CPU time | 40m (2423s = 95%) |
| Max RSS bytes | 3370618880 (3214 MiB) |
| Outputting started | 2026-02-04 00:39:50 |
| Output files | |
| Finished | 2026-02-04 00:42:09 |
| Saved logs | justin-logs:297923.33-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
looking up space point ptr... 0x809cffe0, 0x809d0b70
Caught exception in looking up space point ptr... 0x413e9620, 0x413e36b0
Caught exception in looking up space point ptr... 0x413e36b0, 0x413e3520
Caught exception in looking up space point ptr... 0x71730770, 0x71733040
Caught exception in looking up space point ptr... 0x71733040, 0x71730770
Caught exception in looking up space point ptr... 0x74ccfa0, 0x74ccd70
Caught exception in looking up space point ptr... 0x74ccd70, 0x74ce140
Caught exception in looking up space point ptr... 0x809858b0, 0x717374f0
Caught exception in looking up space point ptr... 0x717374f0, 0x809858b0
Caught exception in looking up space point ptr... 0x17d39140, 0x5e471fe0
Caught exception in looking up space point ptr... 0x5e471fe0, 0x17d39140
Caught exception in looking up space point ptr... 0x72001ad0, 0x72001bd0
Caught exception in looking up space point ptr... 0x72001bd0, 0x720045c0
Caught exception in looking up space point ptr... 0x5e34ee10, 0x4e5a0e80
Caught exception in looking up space point ptr... 0x4e5a0e80, 0x5e34ee10
Caught exception in looking up space point ptr... 0xd9f26f0, 0xd9f2510
Caught exception in looking up space point ptr... 0xd9f2510, 0xd9f26f0
Caught exception in looking up space point ptr... 0x3b774c20, 0x3b774f90
Caught exception in looking up space point ptr... 0x3b774f90, 0x3b774c20
Caught exception in looking up space point ptr... 0xf86f5a0, 0xf86f410
Caught exception in looking up space point ptr... 0xf86f410, 0xf865140
Caught exception in looking up space point ptr... 0xf865140, 0xf864fb0
Caught exception in looking up space point ptr... 0xf864fb0, 0xf8652d0
Caught exception in looking up space point ptr... 0xf8652d0, 0xf86f280
Caught exception in looking up space point ptr... 0xf86f280, 0xf86f5a0
Caught exception in looking up space point ptr... 0x80a06b70, 0x80a07fd0
Caught exception in looking up space point ptr... 0x80a07fd0, 0x80a06b70
Caught exception in looking up space point ptr... 0x80a06b70, 0x79a833d0
Caught exception in looking up space point ptr... 0x79a833d0, 0x80a06b70
Caught exception in looking up space point ptr... 0x2f075ab0, 0x2f0759b0
Caught exception in looking up space point ptr... 0x2f0759b0, 0x2f075ab0
Caught exception in looking up space point ptr... 0x63516970, 0x635167e0
Caught exception in looking up space point ptr... 0x635167e0, 0x63516970
Caught exception in looking up space point ptr... 0x79a9c260, 0x79aa6560
Caught exception in looking up space point ptr... 0x79aa6560, 0x79a9c260
Caught exception in looking up space point ptr... 0x88cda70, 0x88c4240
Caught exception in looking up space point ptr... 0x88c4240, 0x88cda70
Caught exception in looking up space point ptr... 0x4e654d40, 0x4daf0cd0
Caught exception in looking up space point ptr... 0x4daf0cd0, 0x171e9aa0
Caught exception in looking up space point ptr... 0x3c3274b0, 0x3c327360
Caught exception in looking up space point ptr... 0x3c327360, 0x3c3270f0
Caught exception in looking up space point ptr... 0x7200b800, 0x72001f70
Caught exception in looking up space point ptr... 0x72001f70, 0xa147910
Caught exception in looking up space point ptr... 0xa147910, 0x72009fc0
Caught exception in looking up space point ptr... 0x72009fc0, 0x7200b800
Caught exception in looking up space point ptr... 0x4134aad0, 0x4134be10
Caught exception in looking up space point ptr... 0x4134be10, 0x4134aad0
Caught exception in looking up space point ptr... 0x5ec20010, 0x5ec1fd10
Caught exception in looking up space point ptr... 0x5ec1fd10, 0x5ec20010
Caught exception in looking up space point ptr... 0x79a9b520, 0x79a857f0
Caught exception in looking up space point ptr... 0x79a857f0, 0x79a9b520
Caught exception in looking up space point ptr... 0x79a9b520, 0x79a9b620
Caught exception in looking up space point ptr... 0x79a9b620, 0x79a9b520
Caught exception in looking up space point ptr... 0x5e4849a0, 0x5e484b30
Caught exception in looking up space point ptr... 0x5e484b30, 0x5e4849a0
Caught exception in looking up space point ptr... 0x3fc014d0, 0x3fc04a50
Caught exception in looking up space point ptr... 0x3fc04a50, 0x3fc014d0
Caught exception in looking up space point ptr... 0xa1565e0, 0x3d8477b0
Caught exception in looking up space point ptr... 0x3d8477b0, 0x2abcbb40
Caught exception in looking up space point ptr... 0xc027790, 0xc027920
Caught exception in looking up space point ptr... 0xc027920, 0xc0275b0
Caught exception in looking up space point ptr... 0x33097720, 0x33097270
Caught exception in looking up space point ptr... 0x33097270, 0x33097720
Caught exception in looking up space point ptr... 0x51008ff0, 0x510092e0
Caught exception in looking up space point ptr... 0x510092e0, 0x51008ff0
Caught exception in looking up space point ptr... 0x2a098280, 0x4490d5f0
Caught exception in looking up space point ptr... 0x4490d5f0, 0x2a0980f0
++++>>>> total num hits: 128355, num free: 122689
04-Feb-2026 01:39:42 CET Closed output file "np02vd_raw_run042433_0584_df-s03-d1_dw_0_20260203T222404_reco_stage0_20260204T003942_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 112.129 129.595 140.614 128.814 8.5412 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.127e-05 7.758e-05 0.000172302 7.219e-05 2.86046e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.93356 6.84804 7.35905 6.94089 0.366055 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.010349 0.0174534 0.033829 0.0167514 0.00723892 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000385233 0.000485054 0.000761116 0.000459674 9.5019e-05 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000369113 0.000461796 0.000751866 0.000430703 9.83548e-05 19
produce:beamevent:BeamEvent 5.898e-05 0.000126564 0.000888738 7.2611e-05 0.000181283 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.20648 2.67442 3.3056 2.58991 0.288708 19
produce:ophit:OpHitFinder 0.0223422 0.0342213 0.0428765 0.035299 0.00524963 19
produce:wclsdatavd:WireCellToolkit 85.9891 98.2985 111.795 97.9775 6.82766 19
produce:gaushit:GausHitFinder 0.751819 1.13303 1.49145 1.1481 0.218406 19
produce:nhitsfilter:NumberOfHitsFilter 0.000163181 0.000284144 0.000508864 0.000259822 8.47412e-05 19
produce:reco3d:SpacePointSolver 8.13265 13.667 23.9141 13.102 3.56859 19
produce:hitpdune:DisambigFromSpacePoints 0.0834062 0.139313 0.1989 0.147525 0.0305445 19
produce:cluster3d:Cluster3D 1.15378 2.03822 3.23328 1.98545 0.547899 19
[art]:TriggerResults:TriggerResultInserter 1.8761e-05 2.91428e-05 0.000134461 2.308e-05 2.5039e-05 19
end_path:out1:RootOutput 3.69e-06 6.99642e-06 3.3781e-05 5.54e-06 6.49654e-06 19
end_path:out1:RootOutput(write) 3.91531 4.71928 6.32582 4.64785 0.592073 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5341.62 MB
Peak resident set size usage (VmHWM): 3370.62 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0584_df-s03-d1_dw_0_20260203T222404_reco_stage0_20260204T003942_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0584_df-s03-d1_dw_0_20260203T222404_reco_stage0_20260204T003942_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0584_df-s03-d1_dw_0_20260203T222404_reco_stage0_20260204T003942_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163076.0,
"core.end_time": 1770165583.0,
"core.events": [
66585,
66591,
66597,
66603,
66609,
66615,
66621,
66627,
66633,
66639,
66645,
66651,
66657,
66663,
66669,
66675,
66681,
66687,
66693
],
"core.event_count": 19,
"core.first_event_number": 66585,
"core.last_event_number": 66693,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0584_df-s03-d1_dw_0_20260203T222404.hdf5"
}
]
} 