Jobsub ID 303650.72@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.72@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_dissel_multicore |
| Last heartbeat | 2026-02-04 00:21:23 |
| From worker node | Hostname | wn-lot-032.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:14:42 |
| Input files | vd-protodune:np02vd_raw_run042433_0284_df-s04-d0_dw_0_20260203T203003.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3853s) |
| CPU time | 1h (3620s = 93%) |
| Max RSS bytes | 3630542848 (3462 MiB) |
| Outputting started | 2026-02-04 00:18:56 |
| Output files | |
| Finished | 2026-02-04 00:21:23 |
| Saved logs | justin-logs:303650.72-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ace point ptr... 0x4dcd13b0, 0x4dcd07d0
Caught exception in looking up space point ptr... 0x2de4d630, 0x168c04a0
Caught exception in looking up space point ptr... 0x168c04a0, 0x2de03d90
Caught exception in looking up space point ptr... 0x2de03d90, 0x2de03b40
Caught exception in looking up space point ptr... 0x2de03b40, 0x2de4d630
Caught exception in looking up space point ptr... 0x3a24af80, 0x3a24ad30
Caught exception in looking up space point ptr... 0x3a24ad30, 0x104a7cf0
Caught exception in looking up space point ptr... 0x196baae0, 0x7bf62470
Caught exception in looking up space point ptr... 0x7bf62470, 0x3a23e050
Caught exception in looking up space point ptr... 0x12b82cb0, 0x12b881f0
Caught exception in looking up space point ptr... 0x12b881f0, 0x12b86fa0
Caught exception in looking up space point ptr... 0x151b04e0, 0x151b0580
Caught exception in looking up space point ptr... 0x151b0580, 0x151b2bb0
Caught exception in looking up space point ptr... 0x74b498e0, 0x37fbe860
Caught exception in looking up space point ptr... 0x37fbe9f0, 0x74b498e0
Caught exception in looking up space point ptr... 0x19313700, 0x7b3f87b0
Caught exception in looking up space point ptr... 0x7b3f87b0, 0x19313700
Caught exception in looking up space point ptr... 0x42ff5450, 0x113b0a70
Caught exception in looking up space point ptr... 0x39739630, 0x42ff5450
Caught exception in looking up space point ptr... 0x5bf22dc0, 0x65dce530
Caught exception in looking up space point ptr... 0x65dce530, 0x3b9496f0
Caught exception in looking up space point ptr... 0x4aaf80f0, 0x91ff5e0
Caught exception in looking up space point ptr... 0x91ff5e0, 0x65de0b60
Caught exception in looking up space point ptr... 0x93d3bb0, 0x91ff5e0
Caught exception in looking up space point ptr... 0x91ff5e0, 0x4aaba1f0
Caught exception in looking up space point ptr... 0xfb40ea0, 0xfb41040
Caught exception in looking up space point ptr... 0xfb41040, 0xfb41480
Caught exception in looking up space point ptr... 0x4a703690, 0x4a7037f0
Caught exception in looking up space point ptr... 0x4a703920, 0x4a703690
Caught exception in looking up space point ptr... 0x64cae3a0, 0x44e53ca0
Caught exception in looking up space point ptr... 0x44e53ca0, 0xdbdfc60
Caught exception in looking up space point ptr... 0x44e55680, 0x7a098e00
Caught exception in looking up space point ptr... 0x7a098e00, 0x7a092870
Caught exception in looking up space point ptr... 0x4ea83510, 0x4ea83640
Caught exception in looking up space point ptr... 0x4ea83640, 0x4ea83510
Caught exception in looking up space point ptr... 0x4ea83510, 0x8f412a00
Caught exception in looking up space point ptr... 0x8f412a00, 0x4ea83510
Caught exception in looking up space point ptr... 0x4ae0c9f0, 0x325bb7f0
Caught exception in looking up space point ptr... 0x325bb7f0, 0x3aecf970
Caught exception in looking up space point ptr... 0x6eaf0f40, 0x6eaf1790
Caught exception in looking up space point ptr... 0x6eaf1790, 0x6eaefa10
Caught exception in looking up space point ptr... 0x12b9db50, 0x12ba1920
Caught exception in looking up space point ptr... 0x12ba1920, 0x12ba22e0
Caught exception in looking up space point ptr... 0x7b1ca410, 0x6e6da940
Caught exception in looking up space point ptr... 0x6e6da940, 0x3a1f34c0
Caught exception in looking up space point ptr... 0x64cb0830, 0x64cb0eb0
Caught exception in looking up space point ptr... 0x64cb0eb0, 0x64cbe100
Caught exception in looking up space point ptr... 0x4f192170, 0x4f191ed0
Caught exception in looking up space point ptr... 0x4f191ed0, 0x4f192170
Caught exception in looking up space point ptr... 0x4ab01fe0, 0x4aafea30
Caught exception in looking up space point ptr... 0x4ab05a40, 0x4ab01fe0
Caught exception in looking up space point ptr... 0x5fccc250, 0x5fccc3a0
Caught exception in looking up space point ptr... 0x5fccc3a0, 0x5fcd4ca0
Caught exception in looking up space point ptr... 0x7a0818e0, 0x1bd59320
Caught exception in looking up space point ptr... 0x1bd59320, 0x7a0818e0
Caught exception in looking up space point ptr... 0xeec4130, 0x6e48a540
Caught exception in looking up space point ptr... 0x6e48a540, 0x31b50c50
Caught exception in looking up space point ptr... 0x3ce40cb0, 0x5c063f40
Caught exception in looking up space point ptr... 0x5c063f40, 0x3ce40cb0
Caught exception in looking up space point ptr... 0x6e6d8bf0, 0x34381db0
Caught exception in looking up space point ptr... 0x34381db0, 0x4466c1e0
Caught exception in looking up space point ptr... 0x5a9cb1a0, 0x5a9cb490
Caught exception in looking up space point ptr... 0x5a9cb490, 0x5a9cb9d0
Caught exception in looking up space point ptr... 0xde0bd30, 0xde082c0
Caught exception in looking up space point ptr... 0xde08060, 0xde0bd30
Caught exception in looking up space point ptr... 0x9aede40, 0x5f804a70
Caught exception in looking up space point ptr... 0x5f804a70, 0x9aede40
++++>>>> total num hits: 107554, num free: 104070
04-Feb-2026 01:18:48 CET Closed output file "np02vd_raw_run042433_0284_df-s04-d0_dw_0_20260203T203003_reco_stage0_20260204T001848_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 154.63 198.646 238.021 209.28 33.164 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.5809e-05 0.000113685 0.000284302 0.000102212 4.14278e-05 19
produce:tpcrawdecoder:PDVDTPCReader 15.7105 16.4176 17.0979 16.4086 0.325105 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.515166 0.529903 0.551546 0.527238 0.0102452 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0172102 0.0175966 0.0179123 0.0176547 0.000210767 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0171989 0.0175837 0.0179036 0.0176145 0.000197486 19
produce:beamevent:BeamEvent 8.4318e-05 0.00016177 0.00106577 0.000107912 0.000213816 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.34516 4.29211 4.99497 4.30252 0.446428 19
produce:ophit:OpHitFinder 0.0245091 0.043853 0.0671419 0.0426749 0.00987362 19
produce:wclsdatavd:WireCellToolkit 100.318 114.007 122.208 115.024 6.26543 19
produce:gaushit:GausHitFinder 0.979602 1.80069 2.72208 1.6968 0.605015 19
produce:nhitsfilter:NumberOfHitsFilter 0.000487303 0.000894295 0.00123197 0.00104831 0.000266742 19
produce:reco3d:SpacePointSolver 14.2023 20.6498 25.9771 20.9647 3.29638 19
produce:hitpdune:DisambigFromSpacePoints 0.172822 0.290628 0.58612 0.285387 0.11384 19
produce:cluster3d:Cluster3D 1.84303 31.6466 61.8573 53.2991 27.9346 19
[art]:TriggerResults:TriggerResultInserter 2.3714e-05 3.16582e-05 9.9035e-05 2.8053e-05 1.60495e-05 19
end_path:out1:RootOutput 4.127e-06 5.85926e-06 2.5568e-05 4.869e-06 4.65504e-06 19
end_path:out1:RootOutput(write) 6.78713 8.88857 10.6023 9.13247 0.992508 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5555.82 MB
Peak resident set size usage (VmHWM): 3630.54 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0284_df-s04-d0_dw_0_20260203T203003_reco_stage0_20260204T001848_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0284_df-s04-d0_dw_0_20260203T203003_reco_stage0_20260204T001848_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0284_df-s04-d0_dw_0_20260203T203003_reco_stage0_20260204T001848_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160493.0,
"core.end_time": 1770164329.0,
"core.events": [
32386,
32392,
32398,
32404,
32410,
32416,
32422,
32428,
32434,
32440,
32446,
32452,
32458,
32464,
32470,
32476,
32482,
32488,
32494
],
"core.event_count": 19,
"core.first_event_number": 32386,
"core.last_event_number": 32494,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0284_df-s04-d0_dw_0_20260203T203003.hdf5"
}
]
} 