Jobsub ID 303650.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 01:01:38 |
| From worker node | Hostname | wn-lot-032.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:12:40 |
| Input files | vd-protodune:np02vd_raw_run042433_0472_df-s03-d1_dw_0_20260203T214130.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6406s) |
| CPU time | 48m (2939s = 45%) |
| Max RSS bytes | 3411476480 (3253 MiB) |
| Outputting started | 2026-02-04 00:59:28 |
| Output files | |
| Finished | 2026-02-04 01:01:38 |
| Saved logs | justin-logs:303650.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x6b0b37c0, 0x8ea99780
Caught exception in looking up space point ptr... 0x6c735d60, 0x6b0b37c0
Caught exception in looking up space point ptr... 0x72117e90, 0x66712690
Caught exception in looking up space point ptr... 0x66712690, 0x721169d0
Caught exception in looking up space point ptr... 0x7ad5dc90, 0xa51ee780
Caught exception in looking up space point ptr... 0xa51ee780, 0x7ad5dc90
Caught exception in looking up space point ptr... 0x874514e0, 0x874512e0
Caught exception in looking up space point ptr... 0x87452df0, 0x87452fc0
Caught exception in looking up space point ptr... 0x87452fc0, 0x87453190
Caught exception in looking up space point ptr... 0x87453190, 0x874514e0
Caught exception in looking up space point ptr... 0x83d2dc60, 0x8f7d9660
Caught exception in looking up space point ptr... 0x8f7d9660, 0x7e95d7a0
Caught exception in looking up space point ptr... 0x6a609760, 0x6a6098f0
Caught exception in looking up space point ptr... 0x6a6098f0, 0xbceba380
Caught exception in looking up space point ptr... 0x7687e5f0, 0x7ee1b890
Caught exception in looking up space point ptr... 0x7ee1b890, 0x7687e4a0
Caught exception in looking up space point ptr... 0x460bf200, 0x460bf300
Caught exception in looking up space point ptr... 0x460bf300, 0x460bf450
Caught exception in looking up space point ptr... 0x54108570, 0x541083e0
Caught exception in looking up space point ptr... 0x541028d0, 0x54108570
Caught exception in looking up space point ptr... 0x4f755cd0, 0x4f757df0
Caught exception in looking up space point ptr... 0x4f757df0, 0x4f7580e0
Caught exception in looking up space point ptr... 0x4f7580e0, 0x4f757240
Caught exception in looking up space point ptr... 0x54c04b00, 0x8c08a2e0
Caught exception in looking up space point ptr... 0x845d3a80, 0x54c04b00
Caught exception in looking up space point ptr... 0x462e1550, 0xa51f04b0
Caught exception in looking up space point ptr... 0xa51f04b0, 0x462e1400
Caught exception in looking up space point ptr... 0x9ab312b0, 0x9ab31510
Caught exception in looking up space point ptr... 0x9ab31510, 0x9ab31180
Caught exception in looking up space point ptr... 0x473cb440, 0x744ab940
Caught exception in looking up space point ptr... 0x744ab940, 0x8e867b20
Caught exception in looking up space point ptr... 0x49123690, 0x7f68fa00
Caught exception in looking up space point ptr... 0x7f68fa00, 0x7f68feb0
Caught exception in looking up space point ptr... 0xa51efdd0, 0x7ad47a50
Caught exception in looking up space point ptr... 0x7ad47a50, 0xa51efdd0
Caught exception in looking up space point ptr... 0xb5d35930, 0xb5d35dd0
Caught exception in looking up space point ptr... 0xb5d35dd0, 0xb5d36020
Caught exception in looking up space point ptr... 0x5050d940, 0x5050dfd0
Caught exception in looking up space point ptr... 0x5050dfd0, 0x5050dd30
Caught exception in looking up space point ptr... 0x455bacb0, 0x4ac52210
Caught exception in looking up space point ptr... 0x74159430, 0x455bacb0
Caught exception in looking up space point ptr... 0x77eaf350, 0x706f3910
Caught exception in looking up space point ptr... 0x706f3910, 0x75265210
Caught exception in looking up space point ptr... 0x73e2cf40, 0x54bd0060
Caught exception in looking up space point ptr... 0x54bd0060, 0x73e2ccb0
Caught exception in looking up space point ptr... 0x4609b9b0, 0x7a2f5000
Caught exception in looking up space point ptr... 0x7a2f5000, 0x4609b9b0
Caught exception in looking up space point ptr... 0x76b535e0, 0x751bc580
Caught exception in looking up space point ptr... 0x751bc580, 0x76b535e0
Caught exception in looking up space point ptr... 0x7eae85c0, 0x51a34880
Caught exception in looking up space point ptr... 0x51a34880, 0x6fbc9f70
Caught exception in looking up space point ptr... 0xb1952eb0, 0xb194d690
Caught exception in looking up space point ptr... 0xb194d690, 0xb1952eb0
Caught exception in looking up space point ptr... 0xb1952eb0, 0xb193b340
Caught exception in looking up space point ptr... 0xb193b340, 0xb1952eb0
Caught exception in looking up space point ptr... 0x7f68ccd0, 0x7f68c960
Caught exception in looking up space point ptr... 0x7f68c960, 0x7f68ccd0
Caught exception in looking up space point ptr... 0x7887a120, 0x78879fd0
Caught exception in looking up space point ptr... 0x78879fd0, 0x7887a120
Caught exception in looking up space point ptr... 0x55552bd0, 0x7969ab30
Caught exception in looking up space point ptr... 0x7969ab30, 0x55552bd0
Caught exception in looking up space point ptr... 0x6a740cf0, 0x8caccd70
Caught exception in looking up space point ptr... 0x8caccd70, 0x6a740cf0
Caught exception in looking up space point ptr... 0x53f4be90, 0x53f4d150
Caught exception in looking up space point ptr... 0x53f4d150, 0x53f4be90
Caught exception in looking up space point ptr... 0xa2dc3c20, 0x738d28e0
Caught exception in looking up space point ptr... 0x738d28e0, 0xa2dc3c20
++++>>>> total num hits: 66992, num free: 65063
04-Feb-2026 01:59:17 CET Closed output file "np02vd_raw_run042433_0472_df-s03-d1_dw_0_20260203T214130_reco_stage0_20260204T005917_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 260.193 332.687 404.599 325.302 41.8493 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.5049e-05 0.000107936 0.000254708 9.8865e-05 3.53639e-05 19
produce:tpcrawdecoder:PDVDTPCReader 110.565 175.734 249.129 164.638 39.6215 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.613924 0.933169 1.23858 0.940635 0.185914 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0171904 0.0233249 0.0542653 0.0190785 0.00933833 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0171012 0.0197728 0.0583602 0.0176625 0.0090999 19
produce:beamevent:BeamEvent 9.1872e-05 0.000173449 0.00116432 0.000122149 0.000234303 19
produce:pdvddaphne:DAPHNEReaderPDVD 8.54295 15.8461 22.7241 15.6966 3.24779 19
produce:ophit:OpHitFinder 0.0324286 0.0541331 0.0715064 0.0552134 0.0103366 19
produce:wclsdatavd:WireCellToolkit 103.115 112.186 122.173 111.448 5.50062 19
produce:gaushit:GausHitFinder 0.954028 1.2744 1.65666 1.27183 0.203431 19
produce:nhitsfilter:NumberOfHitsFilter 0.000405771 0.000641249 0.00139866 0.000495008 0.000291182 19
produce:reco3d:SpacePointSolver 10.796 16.2533 24.5019 16.1775 3.67221 19
produce:hitpdune:DisambigFromSpacePoints 0.114703 0.197414 0.265955 0.196958 0.0419881 19
produce:cluster3d:Cluster3D 1.24605 2.13136 3.53896 1.99406 0.646022 19
[art]:TriggerResults:TriggerResultInserter 2.3554e-05 3.08858e-05 9.9076e-05 2.6089e-05 1.64773e-05 19
end_path:out1:RootOutput 3.777e-06 6.20111e-06 2.5838e-05 4.539e-06 5.11984e-06 19
end_path:out1:RootOutput(write) 6.87065 7.97887 9.06615 8.0631 0.666711 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5337.39 MB
Peak resident set size usage (VmHWM): 3411.48 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0472_df-s03-d1_dw_0_20260203T214130_reco_stage0_20260204T005917_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0472_df-s03-d1_dw_0_20260203T214130_reco_stage0_20260204T005917_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0472_df-s03-d1_dw_0_20260203T214130_reco_stage0_20260204T005917_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160370.0,
"core.end_time": 1770166760.0,
"core.events": [
53817,
53823,
53829,
53835,
53841,
53847,
53853,
53859,
53865,
53871,
53877,
53883,
53889,
53895,
53901,
53907,
53913,
53919,
53925
],
"core.event_count": 19,
"core.first_event_number": 53817,
"core.last_event_number": 53925,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0472_df-s03-d1_dw_0_20260203T214130.hdf5"
}
]
} 