Jobsub ID 303650.50@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.50@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:24:44 |
| From worker node | Hostname | wn-snel-010.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:14:26 |
| Input files | vd-protodune:np02vd_raw_run042433_0168_df-s04-d0_dw_0_20260203T194558.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7677s) |
| CPU time | 1h (3721s = 48%) |
| Max RSS bytes | 3818766336 (3641 MiB) |
| Outputting started | 2026-02-04 01:22:24 |
| Output files | |
| Finished | 2026-02-04 01:24:44 |
| Saved logs | justin-logs:303650.50-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x51841ca0, 0x71cbb7a0
Caught exception in looking up space point ptr... 0x71cbb7a0, 0x51841d90
Caught exception in looking up space point ptr... 0x51841d90, 0x71cbb640
Caught exception in looking up space point ptr... 0x5d77d900, 0x6a3ad380
Caught exception in looking up space point ptr... 0x6a3ad380, 0x5d9ee360
Caught exception in looking up space point ptr... 0x6d76cd60, 0x6d76c390
Caught exception in looking up space point ptr... 0x6d76c390, 0x6d76cd60
Caught exception in looking up space point ptr... 0x48c18940, 0x6b1bb6c0
Caught exception in looking up space point ptr... 0x6b1bb6c0, 0x44fdf3a0
Caught exception in looking up space point ptr... 0x45e24640, 0x416b6a30
Caught exception in looking up space point ptr... 0x416b6a30, 0x23488b80
Caught exception in looking up space point ptr... 0x48ef7f10, 0x48ef7d30
Caught exception in looking up space point ptr... 0x48ef7d30, 0x48ef8410
Caught exception in looking up space point ptr... 0x45ac1500, 0x6d1784c0
Caught exception in looking up space point ptr... 0x6d1784c0, 0x45ac1500
Caught exception in looking up space point ptr... 0x1c135010, 0x51863f30
Caught exception in looking up space point ptr... 0x443f8380, 0x1c135010
Caught exception in looking up space point ptr... 0x2837cf40, 0x6bb31f80
Caught exception in looking up space point ptr... 0x6bb31f80, 0x6bb33250
Caught exception in looking up space point ptr... 0x44822360, 0x437e5430
Caught exception in looking up space point ptr... 0x437e5430, 0x6c7328f0
Caught exception in looking up space point ptr... 0x6b967970, 0x6b967790
Caught exception in looking up space point ptr... 0x6b967790, 0x6b967970
Caught exception in looking up space point ptr... 0x447c4b10, 0x40068060
Caught exception in looking up space point ptr... 0x447c4710, 0x447c4a10
Caught exception in looking up space point ptr... 0x447c4a10, 0x447c4810
Caught exception in looking up space point ptr... 0x447c4810, 0x447c4910
Caught exception in looking up space point ptr... 0x447c4910, 0x447c4b10
Caught exception in looking up space point ptr... 0x4cdb2040, 0x4cdb38e0
Caught exception in looking up space point ptr... 0x4cdb38e0, 0x4cdb2040
Caught exception in looking up space point ptr... 0x4cdb2040, 0x5063d420
Caught exception in looking up space point ptr... 0x5063d420, 0x4cdb2040
Caught exception in looking up space point ptr... 0x45fb6610, 0x45fb6510
Caught exception in looking up space point ptr... 0x45fb6510, 0x45fb6610
Caught exception in looking up space point ptr... 0x236afa60, 0x45a3c0e0
Caught exception in looking up space point ptr... 0x50616a90, 0x236afa60
Caught exception in looking up space point ptr... 0x45fd5990, 0x28a5fcb0
Caught exception in looking up space point ptr... 0x28a5fcb0, 0x45fd5990
Caught exception in looking up space point ptr... 0x40184e10, 0x40184710
Caught exception in looking up space point ptr... 0x488fe940, 0x40184e10
Caught exception in looking up space point ptr... 0x43a813d0, 0x43a812d0
Caught exception in looking up space point ptr... 0x43a812d0, 0x43a813d0
Caught exception in looking up space point ptr... 0x5ea543a0, 0x5ea545c0
Caught exception in looking up space point ptr... 0x5ea545c0, 0x5f4001c0
Caught exception in looking up space point ptr... 0x5f4001c0, 0x5f3ffea0
Caught exception in looking up space point ptr... 0x6b850550, 0x6d3f4ce0
Caught exception in looking up space point ptr... 0x6d3f4ce0, 0x6b850550
Caught exception in looking up space point ptr... 0x72b52a60, 0x50ccfaa0
Caught exception in looking up space point ptr... 0x50ccfaa0, 0x72b52a60
Caught exception in looking up space point ptr... 0x72971af0, 0x49cf8280
Caught exception in looking up space point ptr... 0x49cf8280, 0x49cf7f80
Caught exception in looking up space point ptr... 0x6c864620, 0x5963f360
Caught exception in looking up space point ptr... 0x5963f360, 0x6a98d690
Caught exception in looking up space point ptr... 0x45890f80, 0x6c2f0620
Caught exception in looking up space point ptr... 0x6c2f0620, 0x45890f80
Caught exception in looking up space point ptr... 0x718a0420, 0x11ea8f80
Caught exception in looking up space point ptr... 0x11ea8f80, 0x718a0420
Caught exception in looking up space point ptr... 0x556dbf20, 0x23428d40
Caught exception in looking up space point ptr... 0x23428d40, 0x556dbf20
Caught exception in looking up space point ptr... 0x6bccbef0, 0x64961f70
Caught exception in looking up space point ptr... 0x64961f70, 0x64961de0
Caught exception in looking up space point ptr... 0x6cbb3330, 0x6cbb3500
Caught exception in looking up space point ptr... 0x6cbb3500, 0x6cbb3330
Caught exception in looking up space point ptr... 0x234d1b20, 0x234d1350
Caught exception in looking up space point ptr... 0x234d1350, 0x234d1b20
Caught exception in looking up space point ptr... 0x4061c8d0, 0x6afc6c10
Caught exception in looking up space point ptr... 0x6afc6c10, 0x4061c8d0
++++>>>> total num hits: 66894, num free: 63661
04-Feb-2026 02:22:14 CET Closed output file "np02vd_raw_run042433_0168_df-s04-d0_dw_0_20260203T194558_reco_stage0_20260204T012214_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 328.562 398.324 532.947 384.808 50.825 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.1274e-05 0.000203863 0.00191111 9.8285e-05 0.000405145 19
produce:tpcrawdecoder:PDVDTPCReader 131.882 200.014 286.985 188.622 43.3459 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.615885 1.03736 2.64395 0.901188 0.448431 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0173853 0.0225085 0.0482265 0.021407 0.00683287 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0172271 0.0187251 0.0349077 0.0178424 0.00382265 19
produce:beamevent:BeamEvent 7.0833e-05 0.0001837 0.00123227 0.000130125 0.000248809 19
produce:pdvddaphne:DAPHNEReaderPDVD 11.7349 17.3547 22.3694 17.1526 2.58132 19
produce:ophit:OpHitFinder 0.033185 0.0433787 0.0506735 0.0434341 0.00414845 19
produce:wclsdatavd:WireCellToolkit 115.008 141.255 163.629 143.151 12.215 19
produce:gaushit:GausHitFinder 1.08613 1.75653 3.37706 1.68826 0.555437 19
produce:nhitsfilter:NumberOfHitsFilter 0.000358743 0.000674494 0.00159079 0.000610105 0.000262737 19
produce:reco3d:SpacePointSolver 10.7875 19.5523 47.139 17.6054 7.49599 19
produce:hitpdune:DisambigFromSpacePoints 0.153629 0.304927 1.28717 0.254353 0.23765 19
produce:cluster3d:Cluster3D 2.2179 9.71147 113.263 3.74141 24.4642 19
[art]:TriggerResults:TriggerResultInserter 2.2593e-05 3.93555e-05 0.000131036 2.8984e-05 2.71886e-05 19
end_path:out1:RootOutput 3.647e-06 6.08679e-06 3.1128e-05 4.278e-06 6.169e-06 19
end_path:out1:RootOutput(write) 5.37848 7.19466 8.95274 7.14434 0.906552 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5746.14 MB
Peak resident set size usage (VmHWM): 3818.77 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0168_df-s04-d0_dw_0_20260203T194558_reco_stage0_20260204T012214_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0168_df-s04-d0_dw_0_20260203T194558_reco_stage0_20260204T012214_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0168_df-s04-d0_dw_0_20260203T194558_reco_stage0_20260204T012214_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160479.0,
"core.end_time": 1770168136.0,
"core.events": [
19162,
19168,
19174,
19180,
19186,
19192,
19198,
19204,
19210,
19216,
19222,
19228,
19234,
19240,
19246,
19252,
19258,
19264,
19270
],
"core.event_count": 19,
"core.first_event_number": 19162,
"core.last_event_number": 19270,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0168_df-s04-d0_dw_0_20260203T194558.hdf5"
}
]
} 