Jobsub ID 297923.135@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.135@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 02:35:24 |
| From worker node | Hostname | hnode76.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:05:12 |
| Input files | vd-protodune:np02vd_raw_run042433_0621_df-s03-d1_dw_0_20260203T223809.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8890s) |
| CPU time | 39m (2355s = 26%) |
| Max RSS bytes | 3376435200 (3220 MiB) |
| Outputting started | 2026-02-04 02:33:25 |
| Output files | |
| Finished | 2026-02-04 02:35:24 |
| Saved logs | justin-logs:297923.135-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x62acf0f0, 0x62ad0ed0
Caught exception in looking up space point ptr... 0x161112c0, 0x146d8790
Caught exception in looking up space point ptr... 0x146d8790, 0x161112c0
Caught exception in looking up space point ptr... 0x7c244470, 0x364a6d60
Caught exception in looking up space point ptr... 0x364a6d60, 0x368fbc20
Caught exception in looking up space point ptr... 0x5c9cce00, 0x5c9ccf50
Caught exception in looking up space point ptr... 0x5c9ccf50, 0x5c9cc200
Caught exception in looking up space point ptr... 0x450e5350, 0x450e2ae0
Caught exception in looking up space point ptr... 0x450e2ae0, 0x450e5350
Caught exception in looking up space point ptr... 0x3c8fdc60, 0x6e96de00
Caught exception in looking up space point ptr... 0x6e96de00, 0x3c8fdc60
Caught exception in looking up space point ptr... 0x139dc6b0, 0x139dd050
Caught exception in looking up space point ptr... 0x139dd050, 0x139dbb90
Caught exception in looking up space point ptr... 0x39cc4230, 0x1b30a7f0
Caught exception in looking up space point ptr... 0x1b30a7f0, 0x39cc4230
Caught exception in looking up space point ptr... 0x4678bf40, 0x17c0f950
Caught exception in looking up space point ptr... 0x17c0f950, 0x4678bf40
Caught exception in looking up space point ptr... 0x3124b780, 0x3124b090
Caught exception in looking up space point ptr... 0x3124b090, 0x3124b780
Caught exception in looking up space point ptr... 0x65818390, 0x65818070
Caught exception in looking up space point ptr... 0x65818070, 0x65818390
Caught exception in looking up space point ptr... 0x2e77ee50, 0x557163d0
Caught exception in looking up space point ptr... 0x557163d0, 0x2e77ee50
Caught exception in looking up space point ptr... 0x3c616ea0, 0x3c615f40
Caught exception in looking up space point ptr... 0x3c615f40, 0x3c6169e0
Caught exception in looking up space point ptr... 0x821bf8d0, 0x12a90690
Caught exception in looking up space point ptr... 0x12a90690, 0x821bf8d0
Caught exception in looking up space point ptr... 0x194c9690, 0x194dab30
Caught exception in looking up space point ptr... 0x194dab30, 0x194da9a0
Caught exception in looking up space point ptr... 0x60fef980, 0x60fefb10
Caught exception in looking up space point ptr... 0x60fefb10, 0x60fef980
Caught exception in looking up space point ptr... 0x82cbd990, 0x82cb0300
Caught exception in looking up space point ptr... 0x82cb0300, 0x82cbd990
Caught exception in looking up space point ptr... 0x7cddc900, 0x7cddc5e0
Caught exception in looking up space point ptr... 0x7cddc5e0, 0x7cddc900
Caught exception in looking up space point ptr... 0x7cdcdfa0, 0x7cdcb7b0
Caught exception in looking up space point ptr... 0x7cdcb7b0, 0x7cdcdfa0
Caught exception in looking up space point ptr... 0x452320c0, 0x138bbd40
Caught exception in looking up space point ptr... 0x138bbd40, 0x452320c0
Caught exception in looking up space point ptr... 0x8169dc00, 0x8169c950
Caught exception in looking up space point ptr... 0x8169c950, 0x8169dc00
Caught exception in looking up space point ptr... 0x82cbe8a0, 0x82cbed30
Caught exception in looking up space point ptr... 0x82cbed30, 0x82cbee80
Caught exception in looking up space point ptr... 0x7c7886d0, 0x1ac5c970
Caught exception in looking up space point ptr... 0x1ac5c970, 0x7c7887d0
Caught exception in looking up space point ptr... 0x2ca3a850, 0x2ca3a9a0
Caught exception in looking up space point ptr... 0x2ca3a9a0, 0x2ca3a700
Caught exception in looking up space point ptr... 0x19597080, 0x337ca000
Caught exception in looking up space point ptr... 0x337ca000, 0x19596ef0
Caught exception in looking up space point ptr... 0x36931720, 0x334fed30
Caught exception in looking up space point ptr... 0x334fed30, 0x60f79270
Caught exception in looking up space point ptr... 0x3b3ab9b0, 0x6fce91c0
Caught exception in looking up space point ptr... 0x6fce91c0, 0x3b3ab9b0
Caught exception in looking up space point ptr... 0x6ec56280, 0x31d15d60
Caught exception in looking up space point ptr... 0x31d15d60, 0x6ec56280
Caught exception in looking up space point ptr... 0x3117c240, 0x3117c4a0
Caught exception in looking up space point ptr... 0x3117c4a0, 0x3117c240
Caught exception in looking up space point ptr... 0x821b0530, 0x821ad130
Caught exception in looking up space point ptr... 0x821ad130, 0x821ab6c0
Caught exception in looking up space point ptr... 0x6b017ba0, 0x6b017a10
Caught exception in looking up space point ptr... 0x6b017a10, 0x6b017ec0
Caught exception in looking up space point ptr... 0x55afa900, 0x592d6650
Caught exception in looking up space point ptr... 0x592d6650, 0x55afa900
Caught exception in looking up space point ptr... 0x55afa900, 0x415285c0
Caught exception in looking up space point ptr... 0x415285c0, 0x55afa900
Caught exception in looking up space point ptr... 0x55afa900, 0x4273bbc0
Caught exception in looking up space point ptr... 0x4273bbc0, 0x55afa900
++++>>>> total num hits: 135254, num free: 129504
04-Feb-2026 03:33:17 CET Closed output file "np02vd_raw_run042433_0621_df-s03-d1_dw_0_20260203T223809_reco_stage0_20260204T023317_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 382.151 464.118 616.764 444.951 56.53 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.3622e-05 8.51276e-05 0.000165604 7.8272e-05 2.65353e-05 19
produce:tpcrawdecoder:PDVDTPCReader 247.398 321.822 468.548 306.612 54.4408 19
produce:triggerrawdecoder:PDVDTriggerReader4 1.18765 2.10047 11.6996 1.469 2.28549 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0338912 0.0423958 0.122406 0.0393839 0.0192385 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0338412 0.0343259 0.0346816 0.0342987 0.000200404 19
produce:beamevent:BeamEvent 6.6532e-05 0.000156714 0.00102975 0.000108823 0.000206749 19
produce:pdvddaphne:DAPHNEReaderPDVD 18.2628 25.1959 37.1227 23.7395 4.87419 19
produce:ophit:OpHitFinder 0.019672 0.0300061 0.0371936 0.0303734 0.00417857 19
produce:wclsdatavd:WireCellToolkit 83.3393 88.0532 93.3816 87.764 2.50426 19
produce:gaushit:GausHitFinder 0.704204 1.08158 1.38752 1.05376 0.186401 19
produce:nhitsfilter:NumberOfHitsFilter 0.000304689 0.000438683 0.00100274 0.000415022 0.0001561 19
produce:reco3d:SpacePointSolver 11.9679 19.0126 25.4205 19.3367 3.6946 19
produce:hitpdune:DisambigFromSpacePoints 0.0993582 0.155534 0.195796 0.154662 0.0301541 19
produce:cluster3d:Cluster3D 1.46328 2.43606 3.67342 2.26515 0.596507 19
[art]:TriggerResults:TriggerResultInserter 1.921e-05 3.05552e-05 0.000141894 2.4201e-05 2.65406e-05 19
end_path:out1:RootOutput 3.151e-06 6.20174e-06 4.1451e-05 3.97e-06 8.43186e-06 19
end_path:out1:RootOutput(write) 3.88543 4.099 4.29973 4.08225 0.130133 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5359.72 MB
Peak resident set size usage (VmHWM): 3376.44 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0621_df-s03-d1_dw_0_20260203T223809_reco_stage0_20260204T023317_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0621_df-s03-d1_dw_0_20260203T223809_reco_stage0_20260204T023317_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0621_df-s03-d1_dw_0_20260203T223809_reco_stage0_20260204T023317_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163520.0,
"core.end_time": 1770172399.0,
"core.events": [
70803,
70809,
70815,
70821,
70827,
70833,
70839,
70845,
70851,
70857,
70863,
70869,
70875,
70881,
70887,
70893,
70899,
70905,
70911
],
"core.event_count": 19,
"core.first_event_number": 70803,
"core.last_event_number": 70911,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0621_df-s03-d1_dw_0_20260203T223809.hdf5"
}
]
} 