Jobsub ID 303651.122@dunegpschedd01.fnal.gov
| Jobsub ID | 303651.122@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:24 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:39:40 |
| From worker node | Hostname | wn-snel-015.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:22:15 |
| Input files | vd-protodune:np02vd_raw_run042421_0096_df-s02-d1_dw_0_20260203T142257.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8081s) |
| CPU time | 1h (4559s = 56%) |
| Max RSS bytes | 2741624832 (2614 MiB) |
| Outputting started | 2026-02-04 01:36:59 |
| Output files | |
| Finished | 2026-02-04 01:39:40 |
| Saved logs | justin-logs:303651.122-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0
Caught exception in looking up space point ptr... 0x2120e510, 0x2120e6f0
Caught exception in looking up space point ptr... 0x2120e6f0, 0x2120e1a0
Caught exception in looking up space point ptr... 0x34153ac0, 0x34141690
Caught exception in looking up space point ptr... 0x34141690, 0xec3dfa0
Caught exception in looking up space point ptr... 0x416f3c00, 0x416e1af0
Caught exception in looking up space point ptr... 0x4ea28e60, 0x416f3c00
Caught exception in looking up space point ptr... 0x298cbf10, 0x472e2e50
Caught exception in looking up space point ptr... 0x472e2e50, 0x298cbf10
Caught exception in looking up space point ptr... 0x298cbf10, 0x400d4cb0
Caught exception in looking up space point ptr... 0x400d4cb0, 0x298cbf10
Caught exception in looking up space point ptr... 0x23eef3e0, 0x23ede0e0
Caught exception in looking up space point ptr... 0x23ede0e0, 0x2f9d7650
Caught exception in looking up space point ptr... 0x44e0faf0, 0x44e02670
Caught exception in looking up space point ptr... 0x2a4cb3f0, 0x44e0faf0
Caught exception in looking up space point ptr... 0x1526fa10, 0x1526f830
Caught exception in looking up space point ptr... 0x1526f830, 0xd657ec0
Caught exception in looking up space point ptr... 0xa99d0a0, 0xa9aa6b0
Caught exception in looking up space point ptr... 0x4a80ec10, 0xa99d0a0
Caught exception in looking up space point ptr... 0x2467ccc0, 0x20ea8920
Caught exception in looking up space point ptr... 0x20ea8790, 0x2467ccc0
Caught exception in looking up space point ptr... 0x15758f10, 0x1326f560
Caught exception in looking up space point ptr... 0x1326f6f0, 0x15758f10
Caught exception in looking up space point ptr... 0x4a395af0, 0x21368c10
Caught exception in looking up space point ptr... 0x21368c10, 0x4a395cf0
Caught exception in looking up space point ptr... 0x416b0be0, 0x41cacfc0
Caught exception in looking up space point ptr... 0x41cacfc0, 0x8385d60
Caught exception in looking up space point ptr... 0x13271310, 0x1575acc0
Caught exception in looking up space point ptr... 0x1575acc0, 0x132714a0
Caught exception in looking up space point ptr... 0x5c6550f0, 0x5c643ad0
Caught exception in looking up space point ptr... 0x5c643ad0, 0x30afc990
Caught exception in looking up space point ptr... 0x56195ba0, 0x56195ec0
Caught exception in looking up space point ptr... 0x56195ec0, 0x56195ba0
Caught exception in looking up space point ptr... 0x3c252e60, 0x3c253060
Caught exception in looking up space point ptr... 0x3c253060, 0x3c252e60
Caught exception in looking up space point ptr... 0x561e55a0, 0x561e5280
Caught exception in looking up space point ptr... 0x561e5280, 0x561e55a0
Caught exception in looking up space point ptr... 0x3fe93cc0, 0x5a5eece0
Caught exception in looking up space point ptr... 0x5a5eece0, 0x3fe93cc0
Caught exception in looking up space point ptr... 0x5ae58a60, 0x41ff21f0
Caught exception in looking up space point ptr... 0x41ff21f0, 0x41ff23b0
Caught exception in looking up space point ptr... 0x52969860, 0x52969bd0
Caught exception in looking up space point ptr... 0x52969bd0, 0x52969860
Caught exception in looking up space point ptr... 0x24ba4ea0, 0x29180b00
Caught exception in looking up space point ptr... 0x29180b00, 0x5b0ce430
Caught exception in looking up space point ptr... 0x64430550, 0x59e18ae0
Caught exception in looking up space point ptr... 0x59e18ae0, 0x24ba4ea0
Caught exception in looking up space point ptr... 0x129f1780, 0x129f1910
Caught exception in looking up space point ptr... 0x129f1910, 0x129f1780
Caught exception in looking up space point ptr... 0x4a64d110, 0x4a64cf90
Caught exception in looking up space point ptr... 0x4a64cf90, 0x4a64d110
Caught exception in looking up space point ptr... 0x472e74a0, 0x2f17c760
Caught exception in looking up space point ptr... 0x2f17c760, 0x21264f70
Caught exception in looking up space point ptr... 0xa2eb220, 0xddac9b0
Caught exception in looking up space point ptr... 0xddac9b0, 0xa2eb220
Caught exception in looking up space point ptr... 0x2f8fe320, 0x2f8ff630
Caught exception in looking up space point ptr... 0x2f8ff630, 0x2f8fe320
Caught exception in looking up space point ptr... 0x62e519f0, 0x62e50d50
Caught exception in looking up space point ptr... 0x62e50d50, 0x62e4f6f0
Caught exception in looking up space point ptr... 0x10699400, 0x10699360
Caught exception in looking up space point ptr... 0x10699360, 0x10699400
Caught exception in looking up space point ptr... 0x2f07c840, 0x2f07cb60
Caught exception in looking up space point ptr... 0x2f07cb60, 0x2f07c840
Caught exception in looking up space point ptr... 0x29213850, 0x564802c0
Caught exception in looking up space point ptr... 0x564802c0, 0x6743a940
Caught exception in looking up space point ptr... 0x6743a940, 0x56480220
++++>>>> total num hits: 321993, num free: 314125
04-Feb-2026 02:36:49 CET Closed output file "np02vd_raw_run042421_0096_df-s02-d1_dw_0_20260203T142257_reco_stage0_20260204T013649_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 208.028 295.141 375.985 292.978 41.0295 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.6142e-05 0.000107715 0.000279423 9.7653e-05 3.90408e-05 27
produce:tpcrawdecoder:PDVDTPCReader 71.3326 121.518 179.564 115.99 27.1979 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.642867 0.786187 1.07238 0.746365 0.116194 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0177039 0.0264111 0.0591752 0.0249399 0.00960569 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0866401 0.0921679 0.112675 0.0875862 0.00804175 27
produce:beamevent:BeamEvent 0.000100137 0.000165283 0.00122854 0.000119163 0.000209465 27
produce:pdvddaphne:DAPHNEReaderPDVD 9.99823 15.5409 21.8924 15.7361 3.06693 27
produce:ophit:OpHitFinder 0.0328365 0.0448288 0.0571623 0.0456109 0.00552242 27
produce:wclsdatavd:WireCellToolkit 79.2568 94.5416 106.924 93.368 6.23306 27
produce:gaushit:GausHitFinder 0.93354 1.79348 2.95295 1.73073 0.484851 27
produce:nhitsfilter:NumberOfHitsFilter 0.000296676 0.000541151 0.000951512 0.000508012 0.000167331 27
produce:reco3d:SpacePointSolver 6.75669 11.5307 17.4267 11.6305 2.74173 27
produce:hitpdune:DisambigFromSpacePoints 0.083328 0.274111 0.510732 0.283704 0.123914 27
produce:cluster3d:Cluster3D 1.35837 42.4744 69.1009 55.3138 26.2719 27
[art]:TriggerResults:TriggerResultInserter 2.4887e-05 3.83738e-05 0.00012285 3.2691e-05 1.84944e-05 27
end_path:out1:RootOutput 3.988e-06 5.9423e-06 2.8053e-05 4.649e-06 4.68415e-06 27
end_path:out1:RootOutput(write) 5.30561 6.47745 7.34207 6.69074 0.617764 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4688.19 MB
Peak resident set size usage (VmHWM): 2741.62 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0096_df-s02-d1_dw_0_20260203T142257_reco_stage0_20260204T013649_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0096_df-s02-d1_dw_0_20260203T142257_reco_stage0_20260204T013649_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0096_df-s02-d1_dw_0_20260203T142257_reco_stage0_20260204T013649_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160950.0,
"core.end_time": 1770169011.0,
"core.events": [
15613,
15619,
15625,
15631,
15637,
15643,
15649,
15655,
15661,
15667,
15673,
15679,
15685,
15691,
15697,
15703,
15709,
15715,
15721,
15727,
15733,
15739,
15745,
15751,
15757,
15763,
15769
],
"core.event_count": 27,
"core.first_event_number": 15613,
"core.last_event_number": 15769,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0096_df-s02-d1_dw_0_20260203T142257.hdf5"
}
]
} 