Jobsub ID 303652.154@dunegpschedd01.fnal.gov
| Jobsub ID | 303652.154@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_dissel_multicore |
| Last heartbeat | 2026-02-04 01:44:35 |
| From worker node | Hostname | wn-pijl-025.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:32:46 |
| Input files | vd-protodune:np02vd_raw_run042433_0215_df-s02-d0_dw_0_20260203T200349.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7758s) |
| CPU time | 1h (3653s = 47%) |
| Max RSS bytes | 3419140096 (3260 MiB) |
| Outputting started | 2026-02-04 01:42:05 |
| Output files | |
| Finished | 2026-02-04 01:44:35 |
| Saved logs | justin-logs:303652.154-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x6dee9610, 0x6deea1c0
Caught exception in looking up space point ptr... 0x7756eb20, 0x7756e8d0
Caught exception in looking up space point ptr... 0x7756e8d0, 0x7755f9b0
Caught exception in looking up space point ptr... 0x7b441620, 0x7b43bab0
Caught exception in looking up space point ptr... 0x7b440ac0, 0x7b441620
Caught exception in looking up space point ptr... 0x3b45d3c0, 0x3b456aa0
Caught exception in looking up space point ptr... 0x3b456aa0, 0xa2180a10
Caught exception in looking up space point ptr... 0x8d3e7960, 0x8d3e77d0
Caught exception in looking up space point ptr... 0x8d3e77d0, 0x8d3e7960
Caught exception in looking up space point ptr... 0x56a82d00, 0x56a846f0
Caught exception in looking up space point ptr... 0x56a846f0, 0x56a82d00
Caught exception in looking up space point ptr... 0x56a82d00, 0x56a83080
Caught exception in looking up space point ptr... 0x56a83080, 0x56a82d00
Caught exception in looking up space point ptr... 0x3b42e6d0, 0x3b435250
Caught exception in looking up space point ptr... 0x3b435250, 0x3b42e6d0
Caught exception in looking up space point ptr... 0x6be10dc0, 0x35d40f50
Caught exception in looking up space point ptr... 0x35d40f50, 0x8ae066e0
Caught exception in looking up space point ptr... 0x3ce96310, 0x65e28330
Caught exception in looking up space point ptr... 0x65e28330, 0x3ced6f30
Caught exception in looking up space point ptr... 0x61569960, 0x61569810
Caught exception in looking up space point ptr... 0x61569810, 0x61569960
Caught exception in looking up space point ptr... 0x56d6bd20, 0x56d6c060
Caught exception in looking up space point ptr... 0x56d6c060, 0x56d6bd20
Caught exception in looking up space point ptr... 0x56d6bd20, 0x56d6c1b0
Caught exception in looking up space point ptr... 0x56d6c1b0, 0x56d6bd20
Caught exception in looking up space point ptr... 0x5ef6b7f0, 0x829a35f0
Caught exception in looking up space point ptr... 0x829a35f0, 0x829a3d20
Caught exception in looking up space point ptr... 0x829a3d20, 0x5ef5e2a0
Caught exception in looking up space point ptr... 0x5ef5e2a0, 0x5ef6b7f0
Caught exception in looking up space point ptr... 0x6bbf5b70, 0x71a00f60
Caught exception in looking up space point ptr... 0x71a00f60, 0x5de35c70
Caught exception in looking up space point ptr... 0x5f5ff550, 0x7c6840e0
Caught exception in looking up space point ptr... 0x7c6840e0, 0x701edd00
Caught exception in looking up space point ptr... 0x7757a010, 0x77563e80
Caught exception in looking up space point ptr... 0x77563e80, 0x77564040
Caught exception in looking up space point ptr... 0x5d94ce50, 0x5d95a990
Caught exception in looking up space point ptr... 0x5d95a990, 0x5d94ce50
Caught exception in looking up space point ptr... 0x40692a10, 0x40693a50
Caught exception in looking up space point ptr... 0x40693a50, 0x40692a10
Caught exception in looking up space point ptr... 0x38a1a3e0, 0x38a1acb0
Caught exception in looking up space point ptr... 0x38a1acb0, 0x38a1aff0
Caught exception in looking up space point ptr... 0x77566350, 0x77566200
Caught exception in looking up space point ptr... 0x77566200, 0x77566350
Caught exception in looking up space point ptr... 0x3eb7f790, 0x5d973830
Caught exception in looking up space point ptr... 0x5d973830, 0x3eb7f790
Caught exception in looking up space point ptr... 0x39e6a980, 0x8a504940
Caught exception in looking up space point ptr... 0x8a504940, 0x39e6a980
Caught exception in looking up space point ptr... 0x5d97cd70, 0x5d97c680
Caught exception in looking up space point ptr... 0x5d97c680, 0x5d978c30
Caught exception in looking up space point ptr... 0x61568ca0, 0x61568df0
Caught exception in looking up space point ptr... 0x61568df0, 0x615690e0
Caught exception in looking up space point ptr... 0x2f4fae40, 0x2f4fac60
Caught exception in looking up space point ptr... 0x2f4fac60, 0x2f4fae40
Caught exception in looking up space point ptr... 0x8d2ff9a0, 0x8d2ff850
Caught exception in looking up space point ptr... 0x8d2ff850, 0x8d2ff9a0
Caught exception in looking up space point ptr... 0x61555190, 0x61554c90
Caught exception in looking up space point ptr... 0x61554c90, 0x61555190
Caught exception in looking up space point ptr... 0x61555190, 0x61555000
Caught exception in looking up space point ptr... 0x61555000, 0x61555190
Caught exception in looking up space point ptr... 0x75b0afa0, 0x594daba0
Caught exception in looking up space point ptr... 0x594daba0, 0x75b0afa0
Caught exception in looking up space point ptr... 0x3953d140, 0x3953cf20
Caught exception in looking up space point ptr... 0x3953cf20, 0x3953cff0
Caught exception in looking up space point ptr... 0x784ee390, 0x6bb4ba60
Caught exception in looking up space point ptr... 0x6bb4ba60, 0x784ee550
Caught exception in looking up space point ptr... 0x58f78770, 0x85563450
Caught exception in looking up space point ptr... 0x85563450, 0x58f78770
++++>>>> total num hits: 82197, num free: 78518
04-Feb-2026 02:41:54 CET Closed output file "np02vd_raw_run042433_0215_df-s02-d0_dw_0_20260203T200349_reco_stage0_20260204T014154_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 325.408 402.258 510.453 395.768 49.5235 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.5999e-05 0.000106747 0.000289857 9.2129e-05 4.52297e-05 19
produce:tpcrawdecoder:PDVDTPCReader 134.656 206.128 305.933 196.678 43.1719 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.62231 0.93333 1.46117 0.845054 0.215487 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0175732 0.024654 0.0698506 0.0179426 0.0122876 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.017583 0.0178573 0.0183862 0.0178549 0.000161011 19
produce:beamevent:BeamEvent 0.00012604 0.000205296 0.00121108 0.000150056 0.000237387 19
produce:pdvddaphne:DAPHNEReaderPDVD 12.0836 18.0717 25.264 17.867 3.5408 19
produce:ophit:OpHitFinder 0.0287633 0.0452665 0.0525563 0.0472165 0.00599174 19
produce:wclsdatavd:WireCellToolkit 120.682 140.586 160.621 140.934 7.73593 19
produce:gaushit:GausHitFinder 0.918124 1.79247 2.76024 1.72917 0.461559 19
produce:nhitsfilter:NumberOfHitsFilter 0.000299702 0.0004807 0.000956191 0.000445351 0.000145227 19
produce:reco3d:SpacePointSolver 13.4526 22.5775 34.8635 20.9567 5.35457 19
produce:hitpdune:DisambigFromSpacePoints 0.114557 0.294381 0.403117 0.277429 0.0681042 19
produce:cluster3d:Cluster3D 2.28733 4.26128 8.99431 3.64919 1.6427 19
[art]:TriggerResults:TriggerResultInserter 2.6971e-05 4.76555e-05 0.000107522 4.2154e-05 1.90109e-05 19
end_path:out1:RootOutput 4.376e-06 1.88773e-05 0.000228114 5.859e-06 4.9522e-05 19
end_path:out1:RootOutput(write) 6.17433 7.44176 8.35097 7.57895 0.582933 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5337.66 MB
Peak resident set size usage (VmHWM): 3419.14 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0215_df-s02-d0_dw_0_20260203T200349_reco_stage0_20260204T014154_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0215_df-s02-d0_dw_0_20260203T200349_reco_stage0_20260204T014154_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0215_df-s02-d0_dw_0_20260203T200349_reco_stage0_20260204T014154_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161583.0,
"core.end_time": 1770169316.0,
"core.events": [
24516,
24522,
24528,
24534,
24540,
24546,
24552,
24558,
24564,
24570,
24576,
24582,
24588,
24594,
24600,
24606,
24612,
24618,
24624
],
"core.event_count": 19,
"core.first_event_number": 24516,
"core.last_event_number": 24624,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0215_df-s02-d0_dw_0_20260203T200349.hdf5"
}
]
} 