Jobsub ID 303652.160@dunegpschedd01.fnal.gov
| Jobsub ID | 303652.160@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 00:33:41 |
| From worker node | Hostname | b9p10p7838.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:33:36 |
| Input files | vd-protodune:np02vd_raw_run042433_0202_df-s03-d1_dw_0_20260203T195854.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 57m (3425s) |
| CPU time | 54m (3295s = 96%) |
| Max RSS bytes | 3446558720 (3286 MiB) |
| Outputting started | 2026-02-04 00:30:44 |
| Output files | |
| Finished | 2026-02-04 00:33:29 |
| Saved logs | justin-logs:303652.160-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce point ptr... 0x38f3a240, 0x679e2ae0
Caught exception in looking up space point ptr... 0x679e2ae0, 0x3ac0a050
Caught exception in looking up space point ptr... 0x3ac0a050, 0x679e2ae0
Caught exception in looking up space point ptr... 0x49d58c50, 0x49d58860
Caught exception in looking up space point ptr... 0x49d58860, 0x49d58c50
Caught exception in looking up space point ptr... 0x8df9390, 0x5330ca30
Caught exception in looking up space point ptr... 0x5330ca30, 0x8df9390
Caught exception in looking up space point ptr... 0x8df9390, 0x8dfa080
Caught exception in looking up space point ptr... 0x8dfa080, 0x8df9390
Caught exception in looking up space point ptr... 0x390e6b90, 0x3bd0e8e0
Caught exception in looking up space point ptr... 0x3bd0e8e0, 0x390e6b90
Caught exception in looking up space point ptr... 0x611bfc70, 0x42248e30
Caught exception in looking up space point ptr... 0x42248e30, 0x611bfc70
Caught exception in looking up space point ptr... 0x48050dd0, 0x67939620
Caught exception in looking up space point ptr... 0x67939620, 0x48050dd0
Caught exception in looking up space point ptr... 0x49e855d0, 0x4a5f0b90
Caught exception in looking up space point ptr... 0x4a5f0b90, 0x10cb0780
Caught exception in looking up space point ptr... 0x78bb4cf0, 0xe171530
Caught exception in looking up space point ptr... 0xe171530, 0x78bb4cf0
Caught exception in looking up space point ptr... 0x78bb4cf0, 0x2ffc08f0
Caught exception in looking up space point ptr... 0x2ffc08f0, 0x78bb4cf0
Caught exception in looking up space point ptr... 0x5bd4cce0, 0x83967790
Caught exception in looking up space point ptr... 0x83967790, 0x4751e510
Caught exception in looking up space point ptr... 0x4723f880, 0x4723f730
Caught exception in looking up space point ptr... 0x4723f730, 0x4723f880
Caught exception in looking up space point ptr... 0x4723f880, 0x4723f440
Caught exception in looking up space point ptr... 0x4723f440, 0x4723f880
Caught exception in looking up space point ptr... 0x3b1a0390, 0xe3b6bc0
Caught exception in looking up space point ptr... 0xe3b6bc0, 0x3b1a0390
Caught exception in looking up space point ptr... 0x3b1a0390, 0x3b1a0240
Caught exception in looking up space point ptr... 0x3b1a0240, 0x3b1a0390
Caught exception in looking up space point ptr... 0x58e18fb0, 0x6e605b20
Caught exception in looking up space point ptr... 0x6e605b20, 0x58e18fb0
Caught exception in looking up space point ptr... 0x47a90e90, 0x47a90d00
Caught exception in looking up space point ptr... 0x47a90d00, 0x47a91020
Caught exception in looking up space point ptr... 0x19a7cbd0, 0x3ae1f0f0
Caught exception in looking up space point ptr... 0x3ae1f0f0, 0x3ae1f1f0
Caught exception in looking up space point ptr... 0x1332bd30, 0x33a2d130
Caught exception in looking up space point ptr... 0x33a2d130, 0x611d4f60
Caught exception in looking up space point ptr... 0x79175680, 0x791758d0
Caught exception in looking up space point ptr... 0x79175b20, 0x79175680
Caught exception in looking up space point ptr... 0x5bc015c0, 0x5bc014c0
Caught exception in looking up space point ptr... 0x5bc014c0, 0x5bc015c0
Caught exception in looking up space point ptr... 0x421a7080, 0x421a72d0
Caught exception in looking up space point ptr... 0x421a7520, 0x421a7080
Caught exception in looking up space point ptr... 0x85665a00, 0x856657e0
Caught exception in looking up space point ptr... 0x856657e0, 0x85665a00
Caught exception in looking up space point ptr... 0x119a2580, 0x119a2b70
Caught exception in looking up space point ptr... 0x119a2b70, 0x119a2320
Caught exception in looking up space point ptr... 0x62069100, 0x62068ea0
Caught exception in looking up space point ptr... 0x62068ea0, 0x667c4ff0
Caught exception in looking up space point ptr... 0x2fad9500, 0x9f9d2d0
Caught exception in looking up space point ptr... 0x9f9d2d0, 0x2fad9500
Caught exception in looking up space point ptr... 0x6e546870, 0x725653e0
Caught exception in looking up space point ptr... 0x725653e0, 0x6e546870
Caught exception in looking up space point ptr... 0x71a26810, 0x5bbe60d0
Caught exception in looking up space point ptr... 0x5bbe60d0, 0x71a26810
Caught exception in looking up space point ptr... 0xe1a54a0, 0x6ac10eb0
Caught exception in looking up space point ptr... 0x6ac10eb0, 0xe1a5740
Caught exception in looking up space point ptr... 0x48006930, 0x4a4a98f0
Caught exception in looking up space point ptr... 0x4a4a98f0, 0x48006930
Caught exception in looking up space point ptr... 0x78ad22e0, 0x630e71f0
Caught exception in looking up space point ptr... 0x630e71f0, 0x78ad22e0
Caught exception in looking up space point ptr... 0x6e9f8330, 0x447fa960
Caught exception in looking up space point ptr... 0x447fa960, 0x6e9f8330
Caught exception in looking up space point ptr... 0x3b9aac90, 0x3b9aab10
Caught exception in looking up space point ptr... 0x3b9aab10, 0x3b9aac90
++++>>>> total num hits: 68064, num free: 65396
04-Feb-2026 01:30:35 CET Closed output file "np02vd_raw_run042433_0202_df-s03-d1_dw_0_20260203T195854_reco_stage0_20260204T003035_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 152.595 176.611 205.235 173.208 13.0983 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.4901e-05 9.69126e-05 0.000234052 8.445e-05 3.95363e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.47404 7.45217 11.4116 7.2263 0.97587 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0111091 0.0146212 0.0298504 0.0129249 0.00422864 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000440023 0.000630364 0.00108118 0.000551063 0.000189077 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000434716 0.0005833 0.00105228 0.000506405 0.00017819 19
produce:beamevent:BeamEvent 7.3531e-05 0.000153498 0.000956527 0.00010404 0.000191058 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.37084 3.10817 3.68306 3.15567 0.349384 19
produce:ophit:OpHitFinder 0.0243101 0.0397732 0.0476336 0.040301 0.00566765 19
produce:wclsdatavd:WireCellToolkit 114.172 132.152 157.843 132.863 11.9945 19
produce:gaushit:GausHitFinder 0.945251 1.65811 2.5089 1.64237 0.410142 19
produce:nhitsfilter:NumberOfHitsFilter 0.000259593 0.000427089 0.000723756 0.000407412 0.00012716 19
produce:reco3d:SpacePointSolver 14.965 22.8957 32.7087 21.5106 5.22865 19
produce:hitpdune:DisambigFromSpacePoints 0.137126 0.241498 0.380398 0.225625 0.0610795 19
produce:cluster3d:Cluster3D 1.69618 3.17592 5.89466 2.98853 1.05737 19
[art]:TriggerResults:TriggerResultInserter 2.603e-05 3.6173e-05 7.8771e-05 3.2241e-05 1.36087e-05 19
end_path:out1:RootOutput 5.7e-06 1.08454e-05 3.3031e-05 9.011e-06 6.58175e-06 19
end_path:out1:RootOutput(write) 5.01111 5.83324 7.09885 5.93528 0.654229 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5402.85 MB
Peak resident set size usage (VmHWM): 3446.56 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0202_df-s03-d1_dw_0_20260203T195854_reco_stage0_20260204T003035_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0202_df-s03-d1_dw_0_20260203T195854_reco_stage0_20260204T003035_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0202_df-s03-d1_dw_0_20260203T195854_reco_stage0_20260204T003035_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161630.0,
"core.end_time": 1770165036.0,
"core.events": [
23037,
23043,
23049,
23055,
23061,
23067,
23073,
23079,
23085,
23091,
23097,
23103,
23109,
23115,
23121,
23127,
23133,
23139,
23145
],
"core.event_count": 19,
"core.first_event_number": 23037,
"core.last_event_number": 23145,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0202_df-s03-d1_dw_0_20260203T195854.hdf5"
}
]
} 