Jobsub ID 303653.170@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.170@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 00:51:02 |
| From worker node | Hostname | wn-pijl-027.farm.nikhef.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:28 |
| Input files | vd-protodune:np02vd_raw_run042421_0101_df-s02-d0_dw_0_20260203T142540.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3600s) |
| CPU time | 54m (3281s = 91%) |
| Max RSS bytes | 2599550976 (2479 MiB) |
| Outputting started | 2026-02-04 00:48:30 |
| Output files | |
| Finished | 2026-02-04 00:51:02 |
| Saved logs | justin-logs:303653.170-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x7147f290, 0x3e5e3a10
Caught exception in looking up space point ptr... 0x466e8a60, 0x71497720
Caught exception in looking up space point ptr... 0x71497720, 0x71495d60
Caught exception in looking up space point ptr... 0x43c0f850, 0x2bf62d60
Caught exception in looking up space point ptr... 0x2bf62d60, 0x2f2ddc00
Caught exception in looking up space point ptr... 0x7ddbb1d0, 0x49dc07c0
Caught exception in looking up space point ptr... 0x7ddbbaf0, 0x7ddbb1d0
Caught exception in looking up space point ptr... 0x46b63b40, 0x58bf72c0
Caught exception in looking up space point ptr... 0x58bf72c0, 0x58bf7120
Caught exception in looking up space point ptr... 0x58bf7120, 0x58bf6f80
Caught exception in looking up space point ptr... 0x58bf6f80, 0x45e795a0
Caught exception in looking up space point ptr... 0x31237270, 0x312374c0
Caught exception in looking up space point ptr... 0x312374c0, 0x2c004830
Caught exception in looking up space point ptr... 0x2c004830, 0x2c0045e0
Caught exception in looking up space point ptr... 0x2c0045e0, 0x31237270
Caught exception in looking up space point ptr... 0x715d1d90, 0x70b4bcb0
Caught exception in looking up space point ptr... 0x70b4bcb0, 0x4e246360
Caught exception in looking up space point ptr... 0x74325540, 0x5117cd60
Caught exception in looking up space point ptr... 0x5117cd60, 0x5117e090
Caught exception in looking up space point ptr... 0x31fb6fc0, 0x31fb6e70
Caught exception in looking up space point ptr... 0x31fb6e70, 0x31fb6fc0
Caught exception in looking up space point ptr... 0x5e6f7970, 0x5e6f7410
Caught exception in looking up space point ptr... 0x5e6f7720, 0x5e6f7970
Caught exception in looking up space point ptr... 0x7083cc60, 0x55eb93f0
Caught exception in looking up space point ptr... 0x55eb93f0, 0x7083cb60
Caught exception in looking up space point ptr... 0x6167ae90, 0x6167a9e0
Caught exception in looking up space point ptr... 0x6167a9e0, 0x6167ae90
Caught exception in looking up space point ptr... 0x2509bda0, 0x7e16b180
Caught exception in looking up space point ptr... 0x5f87e8c0, 0x2509bda0
Caught exception in looking up space point ptr... 0x5115ae60, 0x5118e1e0
Caught exception in looking up space point ptr... 0x5118e1e0, 0x5118d800
Caught exception in looking up space point ptr... 0x47770cd0, 0x47770ff0
Caught exception in looking up space point ptr... 0x47770ff0, 0x477711d0
Caught exception in looking up space point ptr... 0x3057cad0, 0x6d02a8e0
Caught exception in looking up space point ptr... 0x3057c8d0, 0x3057cad0
Caught exception in looking up space point ptr... 0x30db96c0, 0x30db8da0
Caught exception in looking up space point ptr... 0x30db8da0, 0x30db96c0
Caught exception in looking up space point ptr... 0x578cb2d0, 0x55fac680
Caught exception in looking up space point ptr... 0x59c678e0, 0x578cb2d0
Caught exception in looking up space point ptr... 0x4dce4950, 0x5efd6890
Caught exception in looking up space point ptr... 0x5efd6890, 0x4dce4950
Caught exception in looking up space point ptr... 0x669382d0, 0x59cae270
Caught exception in looking up space point ptr... 0x59cae270, 0x6d1bbdd0
Caught exception in looking up space point ptr... 0x61422490, 0x55ec1650
Caught exception in looking up space point ptr... 0x55ec1650, 0x3e094010
Caught exception in looking up space point ptr... 0x4f0b9060, 0x43aea010
Caught exception in looking up space point ptr... 0x43aea010, 0x58d6e210
Caught exception in looking up space point ptr... 0x58d6e210, 0x296e75e0
Caught exception in looking up space point ptr... 0x296e75e0, 0x6a4bc1e0
Caught exception in looking up space point ptr... 0x2cb2b460, 0x46e0b5e0
Caught exception in looking up space point ptr... 0x46e0b5e0, 0x2cb2b460
Caught exception in looking up space point ptr... 0x2cb2b460, 0x410fff30
Caught exception in looking up space point ptr... 0x410fff30, 0x2cb2b460
Caught exception in looking up space point ptr... 0x5c7fce40, 0x2deefe10
Caught exception in looking up space point ptr... 0x2deefe10, 0x2deefff0
Caught exception in looking up space point ptr... 0x6c14ea40, 0x6c14c3c0
Caught exception in looking up space point ptr... 0x6c14c3c0, 0x6c14ea40
Caught exception in looking up space point ptr... 0x41cf5da0, 0x41cf60c0
Caught exception in looking up space point ptr... 0x41cf60c0, 0x41cf5da0
Caught exception in looking up space point ptr... 0x5c84d390, 0x5c84d490
Caught exception in looking up space point ptr... 0x5c84d490, 0x5c84d390
Caught exception in looking up space point ptr... 0x31faeec0, 0x31faf120
Caught exception in looking up space point ptr... 0x31faf120, 0x31faad60
Caught exception in looking up space point ptr... 0x6dba06c0, 0x6dba0350
Caught exception in looking up space point ptr... 0x6dba0350, 0x6dba06c0
++++>>>> total num hits: 54205, num free: 51765
04-Feb-2026 01:48:18 CET Closed output file "np02vd_raw_run042421_0101_df-s02-d0_dw_0_20260203T142540_reco_stage0_20260204T004818_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 114.296 128.244 145.02 127.564 7.50981 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.7773e-05 0.00013222 0.000328636 0.000115595 5.27502e-05 27
produce:tpcrawdecoder:PDVDTPCReader 12.0032 12.8776 15.9936 12.4984 1.03376 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.526099 0.554985 0.636883 0.549216 0.0253716 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.017796 0.0181567 0.0189099 0.0180643 0.000262589 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0875384 0.093296 0.106891 0.0889685 0.00745199 27
produce:beamevent:BeamEvent 0.000122354 0.000229482 0.00155588 0.000173412 0.000262232 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.43024 4.06892 4.87258 4.06408 0.301186 27
produce:ophit:OpHitFinder 0.0352619 0.0515354 0.093379 0.0505629 0.0108716 27
produce:wclsdatavd:WireCellToolkit 79.355 87.9826 95.2463 88.289 4.16734 27
produce:gaushit:GausHitFinder 0.802019 1.29017 2.00044 1.32855 0.30305 27
produce:nhitsfilter:NumberOfHitsFilter 0.000493245 0.00119003 0.00220771 0.00110514 0.000497468 27
produce:reco3d:SpacePointSolver 6.13591 12.8899 22.3958 12.1524 3.47348 27
produce:hitpdune:DisambigFromSpacePoints 0.0946034 0.151341 0.245062 0.156539 0.0378753 27
produce:cluster3d:Cluster3D 1.26236 2.82552 4.8872 2.9036 0.917946 27
[art]:TriggerResults:TriggerResultInserter 2.694e-05 4.54433e-05 0.000107963 4.2124e-05 1.49415e-05 27
end_path:out1:RootOutput 5.138e-06 8.29107e-06 2.5648e-05 7.892e-06 3.71458e-06 27
end_path:out1:RootOutput(write) 4.2669 5.37582 6.17992 5.38566 0.420535 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4499.14 MB
Peak resident set size usage (VmHWM): 2599.55 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0101_df-s02-d0_dw_0_20260203T142540_reco_stage0_20260204T004818_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0101_df-s02-d0_dw_0_20260203T142540_reco_stage0_20260204T004818_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0101_df-s02-d0_dw_0_20260203T142540_reco_stage0_20260204T004818_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162530.0,
"core.end_time": 1770166100.0,
"core.events": [
16428,
16434,
16440,
16446,
16452,
16458,
16464,
16470,
16476,
16482,
16488,
16494,
16500,
16506,
16512,
16518,
16524,
16530,
16536,
16542,
16548,
16554,
16560,
16566,
16572,
16578,
16584
],
"core.event_count": 27,
"core.first_event_number": 16428,
"core.last_event_number": 16584,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0101_df-s02-d0_dw_0_20260203T142540.hdf5"
}
]
} 