Jobsub ID 298013.2@dunegpschedd02.fnal.gov
| Jobsub ID | 298013.2@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 01:42:31 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 02:27:58 |
| From worker node | Hostname | hnode76.pic.es |
| cpuinfo | AMD EPYC 7443P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 01:42:48 |
| Input files | vd-protodune:np02vd_raw_run042433_0269_df-s03-d0_dw_0_20260203T202421.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 43m (2590s) |
| CPU time | 36m (2196s = 84%) |
| Max RSS bytes | 3388641280 (3231 MiB) |
| Outputting started | 2026-02-04 02:26:00 |
| Output files | |
| Finished | 2026-02-04 02:27:58 |
| Saved logs | justin-logs:298013.2-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
... 0x83b05f40, 0x378f2d50
Caught exception in looking up space point ptr... 0x378f2d50, 0x378f3070
Caught exception in looking up space point ptr... 0x378f3070, 0x378f3b60
Caught exception in looking up space point ptr... 0x378f3b60, 0x83b05f40
Caught exception in looking up space point ptr... 0x40f55cb0, 0x78a69a30
Caught exception in looking up space point ptr... 0x78a69a30, 0x40f55cb0
Caught exception in looking up space point ptr... 0x41ebfdc0, 0x41ebfc30
Caught exception in looking up space point ptr... 0x53eb3880, 0x41ebfdc0
Caught exception in looking up space point ptr... 0x3ac9c2c0, 0x58b13990
Caught exception in looking up space point ptr... 0x3aca55f0, 0x3ac9c2c0
Caught exception in looking up space point ptr... 0x58992d80, 0x58992f10
Caught exception in looking up space point ptr... 0x58992f10, 0x589930a0
Caught exception in looking up space point ptr... 0x6bc69800, 0x69e78c70
Caught exception in looking up space point ptr... 0x69e78c70, 0x78a92e10
Caught exception in looking up space point ptr... 0x37961180, 0x6bc69800
Caught exception in looking up space point ptr... 0x3e7ca200, 0x55cc96b0
Caught exception in looking up space point ptr... 0x55cc96b0, 0x2be91090
Caught exception in looking up space point ptr... 0x408e4060, 0x408e6980
Caught exception in looking up space point ptr... 0x408e6980, 0x408e6e50
Caught exception in looking up space point ptr... 0x197a2e20, 0x37d0acd0
Caught exception in looking up space point ptr... 0x6d523650, 0x197a2e20
Caught exception in looking up space point ptr... 0x77c976e0, 0x77c973c0
Caught exception in looking up space point ptr... 0x77c973c0, 0x77c976e0
Caught exception in looking up space point ptr... 0x5f8fdfb0, 0x5f8fee90
Caught exception in looking up space point ptr... 0x5f8fee90, 0x5f8fdfb0
Caught exception in looking up space point ptr... 0x494c29b0, 0x494c2f80
Caught exception in looking up space point ptr... 0x494c2f80, 0x494c3910
Caught exception in looking up space point ptr... 0x19ef4fb0, 0x19ef2490
Caught exception in looking up space point ptr... 0x19ef2490, 0x19eeec50
Caught exception in looking up space point ptr... 0x5202de10, 0x1725b270
Caught exception in looking up space point ptr... 0x1725b270, 0x5202de10
Caught exception in looking up space point ptr... 0x5202de10, 0x31f83cb0
Caught exception in looking up space point ptr... 0x31f83cb0, 0x5202de10
Caught exception in looking up space point ptr... 0x3dc93200, 0x3dc93570
Caught exception in looking up space point ptr... 0x3dc93570, 0x3dc93200
Caught exception in looking up space point ptr... 0x50f957c0, 0x50f959a0
Caught exception in looking up space point ptr... 0x50f959a0, 0x50f957c0
Caught exception in looking up space point ptr... 0x19deead0, 0x5398d160
Caught exception in looking up space point ptr... 0x5398d160, 0x14a90c40
Caught exception in looking up space point ptr... 0x41aca700, 0x42604790
Caught exception in looking up space point ptr... 0x42604790, 0x5899c4f0
Caught exception in looking up space point ptr... 0x5a1cc4a0, 0x81663f60
Caught exception in looking up space point ptr... 0x81663f60, 0x5a1cc4a0
Caught exception in looking up space point ptr... 0x145aa8b0, 0x145abbb0
Caught exception in looking up space point ptr... 0x145abbb0, 0x145aa8b0
Caught exception in looking up space point ptr... 0xd716ec0, 0x565cb860
Caught exception in looking up space point ptr... 0x565cb860, 0xd716ec0
Caught exception in looking up space point ptr... 0x4918d1e0, 0x431240f0
Caught exception in looking up space point ptr... 0x431240f0, 0x4918d1e0
Caught exception in looking up space point ptr... 0x4918d1e0, 0x51c9ac20
Caught exception in looking up space point ptr... 0x51c9ac20, 0x4918d1e0
Caught exception in looking up space point ptr... 0x589bd020, 0x5ee382b0
Caught exception in looking up space point ptr... 0x5ee382b0, 0x589bd020
Caught exception in looking up space point ptr... 0x513ce4f0, 0x513c8c30
Caught exception in looking up space point ptr... 0x513c8c30, 0x513ce750
Caught exception in looking up space point ptr... 0x61159c40, 0x4b4dd6e0
Caught exception in looking up space point ptr... 0x4b4dd6e0, 0x61159c40
Caught exception in looking up space point ptr... 0x49821690, 0x49821390
Caught exception in looking up space point ptr... 0x49821390, 0x49821690
Caught exception in looking up space point ptr... 0x301e9ef0, 0x4e551b80
Caught exception in looking up space point ptr... 0x4e551b80, 0x301e9ef0
Caught exception in looking up space point ptr... 0x3b4ec380, 0x3b4d8ed0
Caught exception in looking up space point ptr... 0x3b4d8ed0, 0x3b4ecd00
Caught exception in looking up space point ptr... 0x6e473c60, 0x6e473f60
Caught exception in looking up space point ptr... 0x6e473f60, 0x6e473c60
Caught exception in looking up space point ptr... 0x5fd9d4e0, 0x14316510
Caught exception in looking up space point ptr... 0x14316510, 0x5fd9d4e0
++++>>>> total num hits: 81066, num free: 77568
04-Feb-2026 03:25:53 CET Closed output file "np02vd_raw_run042433_0269_df-s03-d0_dw_0_20260203T202421_reco_stage0_20260204T022553_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 125.267 132.723 141.764 132.436 4.0114 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.6092e-05 8.21423e-05 0.000179425 7.6702e-05 2.6886e-05 19
produce:tpcrawdecoder:PDVDTPCReader 19.9621 21.332 29.8088 20.9436 2.06579 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.993995 1.04147 1.07209 1.03324 0.0194477 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.034413 0.0355249 0.0517797 0.0345371 0.00383436 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.034411 0.0346312 0.0350883 0.0345749 0.000155537 19
produce:beamevent:BeamEvent 7.6473e-05 0.000170065 0.00101689 0.000123683 0.000200827 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.40546 2.72287 3.05529 2.73 0.165563 19
produce:ophit:OpHitFinder 0.0199031 0.0303722 0.0362047 0.03211 0.00493469 19
produce:wclsdatavd:WireCellToolkit 85.6033 88.7233 91.5545 88.2613 1.7875 19
produce:gaushit:GausHitFinder 0.638596 0.973615 1.18833 0.98529 0.123764 19
produce:nhitsfilter:NumberOfHitsFilter 0.000267387 0.000330927 0.000410172 0.000339399 4.31322e-05 19
produce:reco3d:SpacePointSolver 7.2946 11.8847 15.7937 11.6233 1.9787 19
produce:hitpdune:DisambigFromSpacePoints 0.0772722 0.129941 0.164631 0.130225 0.0211041 19
produce:cluster3d:Cluster3D 1.10384 1.85285 2.99669 1.7541 0.439136 19
[art]:TriggerResults:TriggerResultInserter 1.96e-05 2.74234e-05 7.7002e-05 2.411e-05 1.22946e-05 19
end_path:out1:RootOutput 3.151e-06 4.70542e-06 2.0511e-05 3.761e-06 3.75098e-06 19
end_path:out1:RootOutput(write) 3.74333 3.91013 4.08861 3.92125 0.0866639 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5344.29 MB
Peak resident set size usage (VmHWM): 3388.64 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0269_df-s03-d0_dw_0_20260203T202421_reco_stage0_20260204T022553_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0269_df-s03-d0_dw_0_20260203T202421_reco_stage0_20260204T022553_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0269_df-s03-d0_dw_0_20260203T202421_reco_stage0_20260204T022553_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770169378.0,
"core.end_time": 1770171954.0,
"core.events": [
30674,
30680,
30686,
30692,
30698,
30704,
30710,
30716,
30722,
30728,
30734,
30740,
30746,
30752,
30758,
30764,
30770,
30776,
30782
],
"core.event_count": 19,
"core.first_event_number": 30674,
"core.last_event_number": 30782,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0269_df-s03-d0_dw_0_20260203T202421.hdf5"
}
]
} 