Jobsub ID 303659.173@dunegpschedd01.fnal.gov
| Jobsub ID | 303659.173@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:25 |
| Site | IT_CNAF |
| Entry | CMSHTPC_T1_IT_CNAF_condor_ce02 |
| Last heartbeat | 2026-02-04 00:58:44 |
| From worker node | Hostname | wn-s04-05-09-03.cr.cnaf.infn.it |
| cpuinfo | AMD EPYC 7313 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:17:56 |
| Input files | vd-protodune:np02vd_raw_run042421_0141_df-s04-d0_dw_0_20260203T144714.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 34m (2085s) |
| CPU time | 27m (1639s = 78%) |
| Max RSS bytes | 2600001536 (2479 MiB) |
| Outputting started | 2026-02-04 00:52:42 |
| Output files | |
| Finished | 2026-02-04 00:58:44 |
| Saved logs | justin-logs:303659.173-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x5794ac70
Caught exception in looking up space point ptr... 0x356b5fd0, 0x356b6b70
Caught exception in looking up space point ptr... 0x356b6b70, 0x356b6ad0
Caught exception in looking up space point ptr... 0x591ade30, 0x591ac810
Caught exception in looking up space point ptr... 0x591ac810, 0x591aac20
Caught exception in looking up space point ptr... 0x4d5a86f0, 0x4d5aaa10
Caught exception in looking up space point ptr... 0x4d5aaa10, 0x28b5a720
Caught exception in looking up space point ptr... 0x28b57a40, 0x4d5a94e0
Caught exception in looking up space point ptr... 0x4d5a94e0, 0x4d5ab3a0
Caught exception in looking up space point ptr... 0x4d5ab3a0, 0x4d5a86f0
Caught exception in looking up space point ptr... 0x44df00d0, 0x44dee940
Caught exception in looking up space point ptr... 0x44dee940, 0x44df00d0
Caught exception in looking up space point ptr... 0x4aa15ba0, 0x4aa15ec0
Caught exception in looking up space point ptr... 0x4aa15ec0, 0x4aa160a0
Caught exception in looking up space point ptr... 0x4aa160a0, 0x4aa16280
Caught exception in looking up space point ptr... 0x4aa16280, 0x4aa15d30
Caught exception in looking up space point ptr... 0x4aa15d30, 0x4aa15a10
Caught exception in looking up space point ptr... 0x3c3e2be0, 0x3c3ebf40
Caught exception in looking up space point ptr... 0x3c3ebf40, 0x3c3ebdb0
Caught exception in looking up space point ptr... 0x48c8e7a0, 0x48c71260
Caught exception in looking up space point ptr... 0x48c71260, 0x48c710d0
Caught exception in looking up space point ptr... 0xe6c19e0, 0xe6bf180
Caught exception in looking up space point ptr... 0xe6bf180, 0xe6c19e0
Caught exception in looking up space point ptr... 0x2b14eca0, 0x322df340
Caught exception in looking up space point ptr... 0x322df340, 0x2b14eca0
Caught exception in looking up space point ptr... 0x3d59db00, 0x3d59dc90
Caught exception in looking up space point ptr... 0x3d59dc90, 0x3d59db00
Caught exception in looking up space point ptr... 0x3d59db00, 0x3d59d970
Caught exception in looking up space point ptr... 0x3d59d970, 0x3d59db00
Caught exception in looking up space point ptr... 0x56f036e0, 0x56f03480
Caught exception in looking up space point ptr... 0x56f03480, 0x56f036e0
Caught exception in looking up space point ptr... 0x3e5e41c0, 0x3e5e3e30
Caught exception in looking up space point ptr... 0x3e5e3e30, 0x3e5e41c0
Caught exception in looking up space point ptr... 0x3e5e0fc0, 0x3e5e0e90
Caught exception in looking up space point ptr... 0x3e5e0e90, 0x3e5e1220
Caught exception in looking up space point ptr... 0x3c38f930, 0x3c88c180
Caught exception in looking up space point ptr... 0x3c88c180, 0x3c8710d0
Caught exception in looking up space point ptr... 0x322b9090, 0x322b8260
Caught exception in looking up space point ptr... 0x322b8260, 0x322b7f10
Caught exception in looking up space point ptr... 0x52f4f580, 0x52f485e0
Caught exception in looking up space point ptr... 0x52f49a50, 0x52f4f580
Caught exception in looking up space point ptr... 0x4aa31090, 0x4aa33580
Caught exception in looking up space point ptr... 0x4aa33580, 0x4aa31090
Caught exception in looking up space point ptr... 0x3d5ef2b0, 0x2cc73d60
Caught exception in looking up space point ptr... 0x2cc73d60, 0x108e4400
Caught exception in looking up space point ptr... 0x57d8ae30, 0x57d983b0
Caught exception in looking up space point ptr... 0x57d983b0, 0x57d8ae30
Caught exception in looking up space point ptr... 0x159e5f00, 0x159f2500
Caught exception in looking up space point ptr... 0x159f2500, 0x159f28c0
Caught exception in looking up space point ptr... 0x28b71fc0, 0x28b71e30
Caught exception in looking up space point ptr... 0x28b71e30, 0x4d5af5b0
Caught exception in looking up space point ptr... 0xab67dd0, 0xab6c620
Caught exception in looking up space point ptr... 0xab6c620, 0xab6c490
Caught exception in looking up space point ptr... 0xab6c490, 0xab6b570
Caught exception in looking up space point ptr... 0x4d5b06d0, 0x4d5aff00
Caught exception in looking up space point ptr... 0x4d5aff00, 0x4d5afb90
Caught exception in looking up space point ptr... 0x3acd6370, 0x3acd16b0
Caught exception in looking up space point ptr... 0x3acd16b0, 0x3acd2dc0
Caught exception in looking up space point ptr... 0x29239b60, 0x29239980
Caught exception in looking up space point ptr... 0x29239980, 0x29239b60
Caught exception in looking up space point ptr... 0xa9a2180, 0xa9a1ff0
Caught exception in looking up space point ptr... 0xa9a1ff0, 0xa9a2180
Caught exception in looking up space point ptr... 0x4d5ac0b0, 0x4d5ac360
Caught exception in looking up space point ptr... 0x4d5ac360, 0x4d5ac0b0
Caught exception in looking up space point ptr... 0x4d5ac0b0, 0x4d5ac010
Caught exception in looking up space point ptr... 0x4d5ac010, 0x4d5ac0b0
++++>>>> total num hits: 77543, num free: 74759
04-Feb-2026 01:52:36 CET Closed output file "np02vd_raw_run042421_0141_df-s04-d0_dw_0_20260203T144714_reco_stage0_20260204T005236_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 59.9511 65.5879 70.9429 66.295 2.74683 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.9743e-05 8.24591e-05 0.000174499 6.8519e-05 3.14593e-05 27
produce:tpcrawdecoder:PDVDTPCReader 6.78484 7.05089 7.41132 7.0283 0.140004 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.302019 0.313316 0.329705 0.313432 0.00611199 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.01009 0.0115086 0.042853 0.0102754 0.00614921 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0496485 0.0507776 0.0518135 0.0509069 0.000564139 27
produce:beamevent:BeamEvent 4.6958e-05 0.000118043 0.000967309 7.7546e-05 0.000169376 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.81152 2.13674 2.34501 2.17881 0.170409 27
produce:ophit:OpHitFinder 0.0215246 0.028153 0.0346245 0.0283603 0.0033994 27
produce:wclsdatavd:WireCellToolkit 43.296 44.2723 45.6179 44.1471 0.615004 27
produce:gaushit:GausHitFinder 0.357802 0.603638 0.857572 0.589942 0.142145 27
produce:nhitsfilter:NumberOfHitsFilter 0.000130345 0.000207588 0.000355308 0.000202791 4.91496e-05 27
produce:reco3d:SpacePointSolver 2.98969 7.1714 11.261 7.56846 2.22985 27
produce:hitpdune:DisambigFromSpacePoints 0.0351893 0.0606227 0.0909471 0.0590383 0.014469 27
produce:cluster3d:Cluster3D 0.599858 1.24104 2.69349 1.1773 0.444149 27
[art]:TriggerResults:TriggerResultInserter 1.7703e-05 2.54616e-05 6.8709e-05 2.2022e-05 1.04519e-05 27
end_path:out1:RootOutput 2.675e-06 5.38337e-06 1.7743e-05 5.39e-06 3.06513e-06 27
end_path:out1:RootOutput(write) 2.41448 2.62561 3.00442 2.62146 0.11811 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4522.2 MB
Peak resident set size usage (VmHWM): 2600 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0141_df-s04-d0_dw_0_20260203T144714_reco_stage0_20260204T005236_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0141_df-s04-d0_dw_0_20260203T144714_reco_stage0_20260204T005236_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0141_df-s04-d0_dw_0_20260203T144714_reco_stage0_20260204T005236_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164285.0,
"core.end_time": 1770166356.0,
"core.events": [
22906,
22912,
22918,
22924,
22930,
22936,
22942,
22948,
22954,
22960,
22966,
22972,
22978,
22984,
22990,
22996,
23002,
23008,
23014,
23020,
23026,
23032,
23038,
23044,
23050,
23056,
23062
],
"core.event_count": 27,
"core.first_event_number": 22906,
"core.last_event_number": 23062,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0141_df-s04-d0_dw_0_20260203T144714.hdf5"
}
]
} 