Jobsub ID 297923.47@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.47@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2026-02-04 00:50:48 |
| From worker node | Hostname | b9p35p0043.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:59:27 |
| Input files | vd-protodune:np02vd_raw_run042433_0004_df-s03-d0_dw_0_20260203T184337.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 48m (2933s) |
| CPU time | 47m (2840s = 96%) |
| Max RSS bytes | 3602337792 (3435 MiB) |
| Outputting started | 2026-02-04 00:48:22 |
| Output files | |
| Finished | 2026-02-04 00:50:48 |
| Saved logs | justin-logs:297923.47-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
fa0, 0xe7cd0b0
Caught exception in looking up space point ptr... 0xe7a94d0, 0xe7bafa0
Caught exception in looking up space point ptr... 0x35e4d8e0, 0x8c3a2d0
Caught exception in looking up space point ptr... 0xe707fb0, 0x35e4d8e0
Caught exception in looking up space point ptr... 0x945b540, 0x945b090
Caught exception in looking up space point ptr... 0x945b860, 0x945b540
Caught exception in looking up space point ptr... 0x13949c10, 0x3da459f0
Caught exception in looking up space point ptr... 0x13949da0, 0x13949c10
Caught exception in looking up space point ptr... 0x13a81a00, 0x55658040
Caught exception in looking up space point ptr... 0x13a81b90, 0x13a81a00
Caught exception in looking up space point ptr... 0x8cef3f0, 0xc6e4900
Caught exception in looking up space point ptr... 0x8cef580, 0x8cef3f0
Caught exception in looking up space point ptr... 0x32b37b40, 0x80a93bb0
Caught exception in looking up space point ptr... 0x32b38060, 0x32b37b40
Caught exception in looking up space point ptr... 0x13906460, 0x6a62fb60
Caught exception in looking up space point ptr... 0x6a62fb60, 0xd35ce10
Caught exception in looking up space point ptr... 0x72254420, 0x3718d170
Caught exception in looking up space point ptr... 0x3718d170, 0x3da0d1a0
Caught exception in looking up space point ptr... 0x6eec8580, 0x6a5b3470
Caught exception in looking up space point ptr... 0x6a5b3470, 0x6eec86d0
Caught exception in looking up space point ptr... 0x4f43e8c0, 0x5b0c3b50
Caught exception in looking up space point ptr... 0x32df8c30, 0x4f43e8c0
Caught exception in looking up space point ptr... 0x369a18b0, 0x369a1a40
Caught exception in looking up space point ptr... 0x369a1a40, 0x369a1d60
Caught exception in looking up space point ptr... 0x7f4ac970, 0x7f4b1ac0
Caught exception in looking up space point ptr... 0x7f4b1ac0, 0x7f4ac970
Caught exception in looking up space point ptr... 0x4963fb50, 0x88cad030
Caught exception in looking up space point ptr... 0x16a3ab90, 0x4963fb50
Caught exception in looking up space point ptr... 0x45748f00, 0x855750b0
Caught exception in looking up space point ptr... 0x855750b0, 0x45747470
Caught exception in looking up space point ptr... 0x659b78f0, 0x659b80b0
Caught exception in looking up space point ptr... 0x659b80b0, 0x659b78f0
Caught exception in looking up space point ptr... 0x721e4810, 0x721e5920
Caught exception in looking up space point ptr... 0x721e5920, 0x721e4810
Caught exception in looking up space point ptr... 0x721e4810, 0x721e5820
Caught exception in looking up space point ptr... 0x721e5820, 0x721e4810
Caught exception in looking up space point ptr... 0x65422df0, 0x65422710
Caught exception in looking up space point ptr... 0x65422710, 0x65421e50
Caught exception in looking up space point ptr... 0x198b42d0, 0x198b4460
Caught exception in looking up space point ptr... 0x198b4460, 0x198b42d0
Caught exception in looking up space point ptr... 0x198b42d0, 0xc4c21a0
Caught exception in looking up space point ptr... 0xc4c21a0, 0x198b42d0
Caught exception in looking up space point ptr... 0x198b42d0, 0xc4c1eb0
Caught exception in looking up space point ptr... 0xc4c1eb0, 0x198b42d0
Caught exception in looking up space point ptr... 0x88ea5860, 0x4a602260
Caught exception in looking up space point ptr... 0x4a602260, 0x4a6027c0
Caught exception in looking up space point ptr... 0x4a6027c0, 0x4a602530
Caught exception in looking up space point ptr... 0x4a601fd0, 0x88ea5860
Caught exception in looking up space point ptr... 0x9ac5300, 0x9ac5450
Caught exception in looking up space point ptr... 0x9ac5450, 0x9ac08c0
Caught exception in looking up space point ptr... 0x73981930, 0x73981ca0
Caught exception in looking up space point ptr... 0x73981ca0, 0x73981930
Caught exception in looking up space point ptr... 0x73981930, 0x739817a0
Caught exception in looking up space point ptr... 0x739817a0, 0x73981930
Caught exception in looking up space point ptr... 0x855735d0, 0x3bd08900
Caught exception in looking up space point ptr... 0x3bd08900, 0x85573360
Caught exception in looking up space point ptr... 0x2da1a9a0, 0x2da1a5a0
Caught exception in looking up space point ptr... 0x2da1a5a0, 0x2da1a9a0
Caught exception in looking up space point ptr... 0x350ee340, 0x130fc9d0
Caught exception in looking up space point ptr... 0x130fc9d0, 0x350ed640
Caught exception in looking up space point ptr... 0x2da1b0c0, 0x9185570
Caught exception in looking up space point ptr... 0x9185570, 0x2da1b0c0
Caught exception in looking up space point ptr... 0x59784730, 0x59783670
Caught exception in looking up space point ptr... 0x59783670, 0x59784730
Caught exception in looking up space point ptr... 0x59784730, 0x5b340a60
Caught exception in looking up space point ptr... 0x5b340a60, 0x59784730
Caught exception in looking up space point ptr... 0x50cc9e30, 0x50cc8310
Caught exception in looking up space point ptr... 0x50cc8310, 0x50cc9e30
++++>>>> total num hits: 564045, num free: 554736
04-Feb-2026 01:48:14 CET Closed output file "np02vd_raw_run042433_0004_df-s03-d0_dw_0_20260203T184337_reco_stage0_20260204T004814_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 107.284 151.62 197.515 153.061 23.0234 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.167e-05 7.91101e-05 0.00015691 7.593e-05 1.91196e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.75073 6.46542 7.93236 6.41568 0.459726 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00810056 0.013607 0.0335097 0.0102386 0.00787026 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.00037618 0.000495611 0.00066224 0.00049007 7.53537e-05 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00029809 0.000451148 0.00068177 0.00043259 0.000102573 19
produce:beamevent:BeamEvent 6.399e-05 0.000122937 0.00082685 8.146e-05 0.000166448 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.5983 2.0402 2.28879 2.04829 0.19022 19
produce:ophit:OpHitFinder 0.0196476 0.0312969 0.039889 0.0333606 0.00548867 19
produce:wclsdatavd:WireCellToolkit 72.0756 82.1752 96.0847 81.4637 6.53341 19
produce:gaushit:GausHitFinder 0.901674 1.73034 2.48262 1.75315 0.459914 19
produce:nhitsfilter:NumberOfHitsFilter 0.00019553 0.000263511 0.00038718 0.00025394 4.94781e-05 19
produce:reco3d:SpacePointSolver 9.84934 15.7259 29.531 13.8894 5.10863 19
produce:hitpdune:DisambigFromSpacePoints 0.124362 0.219099 0.397272 0.201633 0.0715973 19
produce:cluster3d:Cluster3D 1.91219 37.2446 56.8066 48.2934 21.1484 19
[art]:TriggerResults:TriggerResultInserter 2.538e-05 3.68521e-05 9.046e-05 3.357e-05 1.40331e-05 19
end_path:out1:RootOutput 4.42e-06 6.45316e-06 2.284e-05 5.71e-06 3.90561e-06 19
end_path:out1:RootOutput(write) 4.0538 5.93106 7.74356 5.84279 0.886345 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5605.47 MB
Peak resident set size usage (VmHWM): 3602.34 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0004_df-s03-d0_dw_0_20260203T184337_reco_stage0_20260204T004814_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0004_df-s03-d0_dw_0_20260203T184337_reco_stage0_20260204T004814_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0004_df-s03-d0_dw_0_20260203T184337_reco_stage0_20260204T004814_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163174.0,
"core.end_time": 1770166096.0,
"core.events": [
464,
470,
476,
482,
488,
494,
500,
506,
512,
518,
524,
530,
536,
542,
548,
554,
560,
566,
572
],
"core.event_count": 19,
"core.first_event_number": 464,
"core.last_event_number": 572,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0004_df-s03-d0_dw_0_20260203T184337.hdf5"
}
]
} 