Jobsub ID 297923.111@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.111@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:59:17 |
| From worker node | Hostname | wn-snel-013.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:03:19 |
| Input files | vd-protodune:np02vd_raw_run042433_0576_df-s03-d1_dw_0_20260203T222102.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6817s) |
| CPU time | 57m (3421s = 50%) |
| Max RSS bytes | 3371147264 (3214 MiB) |
| Outputting started | 2026-02-04 01:56:57 |
| Output files | |
| Finished | 2026-02-04 01:59:17 |
| Saved logs | justin-logs:297923.111-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x89d99690, 0x89d998f0
Caught exception in looking up space point ptr... 0x47c5fa20, 0x47c5f8f0
Caught exception in looking up space point ptr... 0x47c5ebe0, 0x47c5fa20
Caught exception in looking up space point ptr... 0x87ff8c20, 0x87ff8b20
Caught exception in looking up space point ptr... 0x87ffa030, 0x87ff8c20
Caught exception in looking up space point ptr... 0x93787200, 0x87f65be0
Caught exception in looking up space point ptr... 0x87f65be0, 0x4dbe3100
Caught exception in looking up space point ptr... 0x73519d30, 0x81bb6340
Caught exception in looking up space point ptr... 0x81bb6340, 0x8a120580
Caught exception in looking up space point ptr... 0x784dd1c0, 0x4aa6ce90
Caught exception in looking up space point ptr... 0x4e00eb90, 0x784dd1c0
Caught exception in looking up space point ptr... 0x700ebe20, 0xa83797b0
Caught exception in looking up space point ptr... 0xa83797b0, 0x700ebe20
Caught exception in looking up space point ptr... 0x66635bd0, 0x723e1f00
Caught exception in looking up space point ptr... 0x723e1f00, 0x66635bd0
Caught exception in looking up space point ptr... 0x69b51340, 0x69b51090
Caught exception in looking up space point ptr... 0x69b51090, 0x69b50f80
Caught exception in looking up space point ptr... 0xa8971710, 0xb0e0af90
Caught exception in looking up space point ptr... 0xb0e0af90, 0x4e81fbe0
Caught exception in looking up space point ptr... 0xa8710180, 0x70372a60
Caught exception in looking up space point ptr... 0x70372a60, 0x98eaddc0
Caught exception in looking up space point ptr... 0x7692c840, 0x7ce8d250
Caught exception in looking up space point ptr... 0x7ce8d250, 0x6ad0eba0
Caught exception in looking up space point ptr... 0x4a1b3e90, 0x95035c50
Caught exception in looking up space point ptr... 0x95035c50, 0x47c7cee0
Caught exception in looking up space point ptr... 0x4ece5d40, 0x4ece5ae0
Caught exception in looking up space point ptr... 0x4ece5ae0, 0x4ece5d40
Caught exception in looking up space point ptr... 0x4c33d910, 0x4c33b990
Caught exception in looking up space point ptr... 0x4c33b990, 0x4c33d910
Caught exception in looking up space point ptr... 0x67f08a80, 0x3d7dd280
Caught exception in looking up space point ptr... 0x3d7dd280, 0x3d7dd0f0
Caught exception in looking up space point ptr... 0x5f404a10, 0x7098d2e0
Caught exception in looking up space point ptr... 0x7098d2e0, 0x5f404a10
Caught exception in looking up space point ptr... 0x73210d80, 0x42460170
Caught exception in looking up space point ptr... 0x42460170, 0xb98e0c70
Caught exception in looking up space point ptr... 0xa926c870, 0xa926cc00
Caught exception in looking up space point ptr... 0xa926cc00, 0xa926c870
Caught exception in looking up space point ptr... 0x4f236f70, 0x4f236c50
Caught exception in looking up space point ptr... 0x4f236c50, 0x4f236de0
Caught exception in looking up space point ptr... 0x47e27e00, 0x784dbfb0
Caught exception in looking up space point ptr... 0x784dbfb0, 0x47e27e00
Caught exception in looking up space point ptr... 0x7682e1f0, 0x7682df40
Caught exception in looking up space point ptr... 0x7682df40, 0x7682e1f0
Caught exception in looking up space point ptr... 0x7abc8240, 0x9a7a1620
Caught exception in looking up space point ptr... 0x9a7a1620, 0x7abc8240
Caught exception in looking up space point ptr... 0x5f445140, 0x5f444ff0
Caught exception in looking up space point ptr... 0x5f444ff0, 0x5f445140
Caught exception in looking up space point ptr... 0x43358920, 0x899d2f00
Caught exception in looking up space point ptr... 0x899d2f00, 0x43358920
Caught exception in looking up space point ptr... 0x7ec44b50, 0x701f56f0
Caught exception in looking up space point ptr... 0x701f56f0, 0x7ec44b50
Caught exception in looking up space point ptr... 0x767f39c0, 0x767f3630
Caught exception in looking up space point ptr... 0x767f3630, 0x767f39c0
Caught exception in looking up space point ptr... 0x4a1b1ba0, 0x4a1b1a70
Caught exception in looking up space point ptr... 0x4a1b1a70, 0x4a1b1ba0
Caught exception in looking up space point ptr... 0xb9d9f5a0, 0x8a188850
Caught exception in looking up space point ptr... 0x8a188850, 0x6f41bff0
Caught exception in looking up space point ptr... 0x6f6d2110, 0x6f6d2280
Caught exception in looking up space point ptr... 0x6f6d2280, 0x6f6d2110
Caught exception in looking up space point ptr... 0x683002a0, 0x682ffbc0
Caught exception in looking up space point ptr... 0x682ffbc0, 0x683002a0
Caught exception in looking up space point ptr... 0x683002a0, 0x68300110
Caught exception in looking up space point ptr... 0x68300110, 0x683002a0
Caught exception in looking up space point ptr... 0x48c7ee20, 0xb9e58c20
Caught exception in looking up space point ptr... 0xb9e58c20, 0x48c7ee20
Caught exception in looking up space point ptr... 0xa6f75550, 0x6b8dc490
Caught exception in looking up space point ptr... 0x6b8dc490, 0xa6f75550
++++>>>> total num hits: 44552, num free: 42736
04-Feb-2026 02:56:47 CET Closed output file "np02vd_raw_run042433_0576_df-s03-d1_dw_0_20260203T222102_reco_stage0_20260204T015647_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 289.059 353.642 455.209 348.267 40.5925 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.4928e-05 0.000118132 0.000331853 0.000100909 5.27751e-05 19
produce:tpcrawdecoder:PDVDTPCReader 121.946 172.262 243.885 166.552 31.8903 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.629929 0.871871 1.3492 0.842725 0.183026 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0179132 0.0287386 0.0914677 0.0245077 0.0163134 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0174008 0.0180063 0.0215576 0.0178475 0.000869382 19
produce:beamevent:BeamEvent 9.9947e-05 0.000208133 0.00152884 0.000138159 0.000311974 19
produce:pdvddaphne:DAPHNEReaderPDVD 11.8641 15.547 20.9332 14.8525 2.60802 19
produce:ophit:OpHitFinder 0.028871 0.0428482 0.0527861 0.0448826 0.00631204 19
produce:wclsdatavd:WireCellToolkit 117.747 133.722 168.131 126.745 14.4245 19
produce:gaushit:GausHitFinder 0.932919 1.5027 2.14594 1.49295 0.353538 19
produce:nhitsfilter:NumberOfHitsFilter 0.00033573 0.000582829 0.00102769 0.000515687 0.000197346 19
produce:reco3d:SpacePointSolver 10.5928 17.4417 31.2956 16.0142 4.81485 19
produce:hitpdune:DisambigFromSpacePoints 0.127388 0.245947 0.439177 0.220915 0.0844179 19
produce:cluster3d:Cluster3D 1.79108 5.08017 37.4476 3.42412 7.69379 19
[art]:TriggerResults:TriggerResultInserter 2.3885e-05 3.82175e-05 0.000129553 3.0658e-05 2.44884e-05 19
end_path:out1:RootOutput 3.947e-06 2.21131e-05 0.000309561 4.619e-06 6.79717e-05 19
end_path:out1:RootOutput(write) 5.20252 6.80332 9.45622 6.6213 0.987659 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5439.05 MB
Peak resident set size usage (VmHWM): 3371.15 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0576_df-s03-d1_dw_0_20260203T222102_reco_stage0_20260204T015647_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0576_df-s03-d1_dw_0_20260203T222102_reco_stage0_20260204T015647_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0576_df-s03-d1_dw_0_20260203T222102_reco_stage0_20260204T015647_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163412.0,
"core.end_time": 1770170209.0,
"core.events": [
65673,
65679,
65685,
65691,
65697,
65703,
65709,
65715,
65721,
65727,
65733,
65739,
65745,
65751,
65757,
65763,
65769,
65775,
65781
],
"core.event_count": 19,
"core.first_event_number": 65673,
"core.last_event_number": 65781,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0576_df-s03-d1_dw_0_20260203T222102.hdf5"
}
]
} 