Jobsub ID 297916.157@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.157@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:29:33 |
| From worker node | Hostname | wn-sate-013.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7551P 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:07:39 |
| Input files | vd-protodune:np02vd_raw_run042422_0029_df-s03-d1_dw_0_20260203T153027.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8366s) |
| CPU time | 1h (3969s = 47%) |
| Max RSS bytes | 2733113344 (2606 MiB) |
| Outputting started | 2026-02-04 01:27:06 |
| Output files | |
| Finished | 2026-02-04 01:29:33 |
| Saved logs | justin-logs:297916.157-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
6304db10, 0x6304d980
Caught exception in looking up space point ptr... 0x6304d980, 0x7d118e00
Caught exception in looking up space point ptr... 0x66b3be70, 0x66b32da0
Caught exception in looking up space point ptr... 0x66b32da0, 0x70e66c90
Caught exception in looking up space point ptr... 0x3f6d9080, 0x6ce7f430
Caught exception in looking up space point ptr... 0x3f6d9210, 0x3f6d9080
Caught exception in looking up space point ptr... 0x64f24650, 0x64f244c0
Caught exception in looking up space point ptr... 0x64f244c0, 0x654b6580
Caught exception in looking up space point ptr... 0x7ac0d720, 0x7ac0da40
Caught exception in looking up space point ptr... 0x7ac0da40, 0x7ac0d720
Caught exception in looking up space point ptr... 0x592f4370, 0x592f40d0
Caught exception in looking up space point ptr... 0x592f40d0, 0x59267810
Caught exception in looking up space point ptr... 0x847ec830, 0x847ec6e0
Caught exception in looking up space point ptr... 0x632e83d0, 0x847ec830
Caught exception in looking up space point ptr... 0x57e07800, 0x57df6cd0
Caught exception in looking up space point ptr... 0x715443b0, 0x57e07800
Caught exception in looking up space point ptr... 0x811f8310, 0x5f1b9370
Caught exception in looking up space point ptr... 0x5f1b9370, 0x5f1a70d0
Caught exception in looking up space point ptr... 0x70bf5360, 0x82a93460
Caught exception in looking up space point ptr... 0x82a93460, 0x70bf54f0
Caught exception in looking up space point ptr... 0x7b458830, 0x7b4586a0
Caught exception in looking up space point ptr... 0x7b4586a0, 0x7b458830
Caught exception in looking up space point ptr... 0x70bcfd60, 0x8d704760
Caught exception in looking up space point ptr... 0x8d704760, 0x3f407c70
Caught exception in looking up space point ptr... 0x665be1c0, 0x665be550
Caught exception in looking up space point ptr... 0x665be550, 0x665be1c0
Caught exception in looking up space point ptr... 0x62f53af0, 0x62f56110
Caught exception in looking up space point ptr... 0x62f56110, 0x62f53af0
Caught exception in looking up space point ptr... 0x396af540, 0x396af220
Caught exception in looking up space point ptr... 0x396af220, 0x396af540
Caught exception in looking up space point ptr... 0x84aa97d0, 0x8d73a750
Caught exception in looking up space point ptr... 0x4e08e900, 0x84aa97d0
Caught exception in looking up space point ptr... 0x723fbba0, 0x7f57ffa0
Caught exception in looking up space point ptr... 0x7f57ffa0, 0x52ff0a30
Caught exception in looking up space point ptr... 0x8af80370, 0x5c5f47b0
Caught exception in looking up space point ptr... 0x5c5f47b0, 0x7ee17950
Caught exception in looking up space point ptr... 0x8326bfe0, 0x8326c490
Caught exception in looking up space point ptr... 0x8326c490, 0x8326c300
Caught exception in looking up space point ptr... 0x62f538c0, 0x5c4d0480
Caught exception in looking up space point ptr... 0x5c4d0480, 0x62f538c0
Caught exception in looking up space point ptr... 0x569f9570, 0x59c005c0
Caught exception in looking up space point ptr... 0x59c005c0, 0x569f9570
Caught exception in looking up space point ptr... 0x55ab5220, 0x3f7e2dc0
Caught exception in looking up space point ptr... 0x3f7e2f30, 0x55ab5220
Caught exception in looking up space point ptr... 0x800bdf10, 0x800bc400
Caught exception in looking up space point ptr... 0x800bc400, 0x800beb60
Caught exception in looking up space point ptr... 0x3b0d0c10, 0x3b0d0da0
Caught exception in looking up space point ptr... 0x5695f8e0, 0x3b0d0c10
Caught exception in looking up space point ptr... 0x52e64cf0, 0x7c4a0d60
Caught exception in looking up space point ptr... 0x7c4a0d60, 0x7c4a0bd0
Caught exception in looking up space point ptr... 0x8463a740, 0x84639050
Caught exception in looking up space point ptr... 0x84639050, 0x8463a610
Caught exception in looking up space point ptr... 0x37602560, 0x376021e0
Caught exception in looking up space point ptr... 0x376021e0, 0x65369f10
Caught exception in looking up space point ptr... 0x64bde0c0, 0x5ec4bcf0
Caught exception in looking up space point ptr... 0x8d8c8840, 0x64bde0c0
Caught exception in looking up space point ptr... 0x690d5890, 0x690d5700
Caught exception in looking up space point ptr... 0x690d5700, 0x690d5890
Caught exception in looking up space point ptr... 0x62a7baf0, 0x62a79da0
Caught exception in looking up space point ptr... 0x62a79da0, 0x62a7b1e0
Caught exception in looking up space point ptr... 0x61613450, 0x616135e0
Caught exception in looking up space point ptr... 0x616135e0, 0x61613450
Caught exception in looking up space point ptr... 0x827cff20, 0x827cfc40
Caught exception in looking up space point ptr... 0x827cfc40, 0x827cfb40
Caught exception in looking up space point ptr... 0x382757b0, 0x38278410
Caught exception in looking up space point ptr... 0x38278410, 0x382791f0
++++>>>> total num hits: 348088, num free: 340664
04-Feb-2026 02:26:58 CET Closed output file "np02vd_raw_run042422_0029_df-s03-d1_dw_0_20260203T153027_reco_stage0_20260204T012658_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 229.805 305.498 362.719 307.332 35.7287 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.0204e-05 0.000101599 0.000243697 8.9188e-05 3.97503e-05 27
produce:tpcrawdecoder:PDVDTPCReader 101.225 149.314 225.96 141.843 31.728 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.560104 0.887155 1.80633 0.830114 0.252175 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0173342 0.0327117 0.105752 0.0225789 0.0235545 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.084696 0.0943284 0.306777 0.0862535 0.041669 27
produce:beamevent:BeamEvent 9.4127e-05 0.000183002 0.00106739 0.000147247 0.00017705 27
produce:pdvddaphne:DAPHNEReaderPDVD 12.9488 18.4556 29.6942 18.2343 3.97121 27
produce:ophit:OpHitFinder 0.0291185 0.0423262 0.0530462 0.0429841 0.00497284 27
produce:wclsdatavd:WireCellToolkit 82.3193 86.5855 90.5023 87.4862 1.94698 27
produce:gaushit:GausHitFinder 0.910483 1.55397 2.06823 1.64544 0.323582 27
produce:nhitsfilter:NumberOfHitsFilter 0.000267642 0.000383992 0.000516229 0.000384092 6.31531e-05 27
produce:reco3d:SpacePointSolver 5.90624 9.57207 18.7612 8.79547 2.63092 27
produce:hitpdune:DisambigFromSpacePoints 0.0857669 0.236203 0.373864 0.263735 0.0926789 27
produce:cluster3d:Cluster3D 1.09123 33.2615 50.3335 45.0705 20.4827 27
[art]:TriggerResults:TriggerResultInserter 2.3534e-05 3.93529e-05 9.7834e-05 3.3022e-05 1.70396e-05 27
end_path:out1:RootOutput 5.641e-06 8.10374e-06 2.5729e-05 7.013e-06 3.80775e-06 27
end_path:out1:RootOutput(write) 4.25944 5.42772 6.22046 5.70516 0.663845 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4651.41 MB
Peak resident set size usage (VmHWM): 2733.11 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0029_df-s03-d1_dw_0_20260203T153027_reco_stage0_20260204T012658_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0029_df-s03-d1_dw_0_20260203T153027_reco_stage0_20260204T012658_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0029_df-s03-d1_dw_0_20260203T153027_reco_stage0_20260204T012658_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160080.0,
"core.end_time": 1770168420.0,
"core.events": [
4701,
4707,
4713,
4719,
4725,
4731,
4737,
4743,
4749,
4755,
4761,
4767,
4773,
4779,
4785,
4791,
4797,
4803,
4809,
4815,
4821,
4827,
4833,
4839,
4845,
4851,
4857
],
"core.event_count": 27,
"core.first_event_number": 4701,
"core.last_event_number": 4857,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0029_df-s03-d1_dw_0_20260203T153027.hdf5"
}
]
} 