Jobsub ID 303654.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303654.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce504 |
| Last heartbeat | 2026-02-04 00:42:19 |
| From worker node | Hostname | b9p02p3882.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:56 |
| Input files | vd-protodune:np02vd_raw_run042433_0359_df-s02-d0_dw_0_20260203T205833.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 48m (2930s) |
| CPU time | 46m (2765s = 94%) |
| Max RSS bytes | 3390824448 (3233 MiB) |
| Outputting started | 2026-02-04 00:37:48 |
| Output files | |
| Finished | 2026-02-04 00:42:19 |
| Saved logs | justin-logs:303654.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ing up space point ptr... 0xb4e5e30, 0x6fb44870
Caught exception in looking up space point ptr... 0x6fb44870, 0xb4e5e30
Caught exception in looking up space point ptr... 0x1a053010, 0x6f747040
Caught exception in looking up space point ptr... 0x6f747040, 0x1a053010
Caught exception in looking up space point ptr... 0x1a053010, 0x1a052e80
Caught exception in looking up space point ptr... 0x1a052e80, 0x1a053010
Caught exception in looking up space point ptr... 0x48623250, 0x58912040
Caught exception in looking up space point ptr... 0x58912040, 0x5f34e630
Caught exception in looking up space point ptr... 0x45436220, 0x13f1a9a0
Caught exception in looking up space point ptr... 0x13f1a9a0, 0x3faf9ad0
Caught exception in looking up space point ptr... 0x158811b0, 0x15886840
Caught exception in looking up space point ptr... 0x15886840, 0x158811b0
Caught exception in looking up space point ptr... 0x158811b0, 0x15883ce0
Caught exception in looking up space point ptr... 0x15883ce0, 0x158811b0
Caught exception in looking up space point ptr... 0x104764e0, 0x104761c0
Caught exception in looking up space point ptr... 0x104761c0, 0x104764e0
Caught exception in looking up space point ptr... 0x6174c480, 0x610558c0
Caught exception in looking up space point ptr... 0x610558c0, 0x6174c480
Caught exception in looking up space point ptr... 0xfbab320, 0x5fc1c510
Caught exception in looking up space point ptr... 0x5fc1c510, 0xfba4640
Caught exception in looking up space point ptr... 0x3e59d890, 0x3e59da20
Caught exception in looking up space point ptr... 0x131482d0, 0x3e59d890
Caught exception in looking up space point ptr... 0x830bdb90, 0x830bda90
Caught exception in looking up space point ptr... 0x830bda90, 0x830bdb90
Caught exception in looking up space point ptr... 0x948f740, 0x947c8d0
Caught exception in looking up space point ptr... 0x947c8d0, 0x9491550
Caught exception in looking up space point ptr... 0x9491550, 0x947c770
Caught exception in looking up space point ptr... 0x947c770, 0x948ef70
Caught exception in looking up space point ptr... 0x3950dc30, 0x3950d780
Caught exception in looking up space point ptr... 0x3950d780, 0x3950dc30
Caught exception in looking up space point ptr... 0x5eea37f0, 0x5eea3940
Caught exception in looking up space point ptr... 0x5eea3940, 0x5eea37f0
Caught exception in looking up space point ptr... 0x13929230, 0x1392d430
Caught exception in looking up space point ptr... 0x1392d430, 0x1392d5c0
Caught exception in looking up space point ptr... 0x1392d5c0, 0x1392d750
Caught exception in looking up space point ptr... 0x16966dd0, 0xf256070
Caught exception in looking up space point ptr... 0xf256070, 0x16966dd0
Caught exception in looking up space point ptr... 0xe336ab0, 0xe336960
Caught exception in looking up space point ptr... 0xe33c5a0, 0xe336ab0
Caught exception in looking up space point ptr... 0x81f4bc60, 0x86560e60
Caught exception in looking up space point ptr... 0x86560e60, 0x81f4bc60
Caught exception in looking up space point ptr... 0x5aac2030, 0x5aac2130
Caught exception in looking up space point ptr... 0x5aac2130, 0x132b60f0
Caught exception in looking up space point ptr... 0x4f2374f0, 0x58889510
Caught exception in looking up space point ptr... 0x58889510, 0x4f2374f0
Caught exception in looking up space point ptr... 0xb4782b0, 0xb4783e0
Caught exception in looking up space point ptr... 0xb4783e0, 0xb4782b0
Caught exception in looking up space point ptr... 0x19344e30, 0x19344980
Caught exception in looking up space point ptr... 0x19344980, 0x19344e30
Caught exception in looking up space point ptr... 0x7011b190, 0x7013f6f0
Caught exception in looking up space point ptr... 0x7013f6f0, 0x7011b190
Caught exception in looking up space point ptr... 0x6fb72470, 0x13235dc0
Caught exception in looking up space point ptr... 0x13235dc0, 0x6fb72470
Caught exception in looking up space point ptr... 0x86b67920, 0x86b6aec0
Caught exception in looking up space point ptr... 0x86b6aec0, 0x86b67920
Caught exception in looking up space point ptr... 0x2c01d250, 0x1a0802e0
Caught exception in looking up space point ptr... 0x1a0802e0, 0x2c01d250
Caught exception in looking up space point ptr... 0x648e9740, 0x648eaec0
Caught exception in looking up space point ptr... 0x648eaec0, 0x648e9740
Caught exception in looking up space point ptr... 0x648e9740, 0x648ea5b0
Caught exception in looking up space point ptr... 0x648ea5b0, 0x648e9740
Caught exception in looking up space point ptr... 0xf33a990, 0xf33a800
Caught exception in looking up space point ptr... 0xf33a800, 0xf33a990
Caught exception in looking up space point ptr... 0x4e1de1b0, 0x396f90f0
Caught exception in looking up space point ptr... 0x396f90f0, 0x4e1de1b0
Caught exception in looking up space point ptr... 0x2c04cad0, 0x2c04c8f0
Caught exception in looking up space point ptr... 0x2c04c8f0, 0x37f796c0
++++>>>> total num hits: 110880, num free: 106509
04-Feb-2026 01:37:39 CET Closed output file "np02vd_raw_run042433_0359_df-s02-d0_dw_0_20260203T205833_reco_stage0_20260204T003739_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 124.627 150.784 194.858 152.081 17.0027 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.8811e-05 9.69075e-05 0.000156712 8.9441e-05 2.31944e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.62845 10.0656 26.0499 7.44272 5.41761 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0118601 0.0361975 0.2601 0.0175352 0.0552188 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000474146 0.000651787 0.00167762 0.000577406 0.000268534 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000422385 0.000551225 0.00117744 0.000502026 0.000159593 19
produce:beamevent:BeamEvent 8.0551e-05 0.000151754 0.000928661 0.000113981 0.000183719 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.23437 2.91802 3.46207 2.92381 0.328146 19
produce:ophit:OpHitFinder 0.0204541 0.0368152 0.044775 0.0395798 0.00680783 19
produce:wclsdatavd:WireCellToolkit 92.2553 109.966 127.617 111.538 8.53214 19
produce:gaushit:GausHitFinder 0.775398 1.22429 2.16125 1.18456 0.37482 19
produce:nhitsfilter:NumberOfHitsFilter 0.000209342 0.000324251 0.000612836 0.000305043 9.51178e-05 19
produce:reco3d:SpacePointSolver 7.96322 18.3226 35.477 18.7823 6.1679 19
produce:hitpdune:DisambigFromSpacePoints 0.089025 0.18243 0.284624 0.154904 0.0596101 19
produce:cluster3d:Cluster3D 1.33158 2.42387 4.10332 2.10659 0.84422 19
[art]:TriggerResults:TriggerResultInserter 2.4e-05 3.08498e-05 7.8111e-05 2.804e-05 1.16896e-05 19
end_path:out1:RootOutput 4.62e-06 7.42321e-06 2.389e-05 6.13e-06 4.08763e-06 19
end_path:out1:RootOutput(write) 4.40823 5.57329 6.93652 5.49782 0.691472 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5360.53 MB
Peak resident set size usage (VmHWM): 3390.82 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0359_df-s02-d0_dw_0_20260203T205833_reco_stage0_20260204T003739_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0359_df-s02-d0_dw_0_20260203T205833_reco_stage0_20260204T003739_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0359_df-s02-d0_dw_0_20260203T205833_reco_stage0_20260204T003739_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162547.0,
"core.end_time": 1770165461.0,
"core.events": [
40932,
40938,
40944,
40950,
40956,
40962,
40968,
40974,
40980,
40986,
40992,
40998,
41004,
41010,
41016,
41022,
41028,
41034,
41040
],
"core.event_count": 19,
"core.first_event_number": 40932,
"core.last_event_number": 41040,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0359_df-s02-d0_dw_0_20260203T205833.hdf5"
}
]
} 