Jobsub ID 298087.1@dunegpschedd02.fnal.gov
| Jobsub ID | 298087.1@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 03:10:35 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 03:48:14 |
| From worker node | Hostname | td108.pic.es |
| cpuinfo | AMD EPYC 9825 144-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 03:11:08 |
| Input files | vd-protodune:np02vd_raw_run042421_0153_df-s02-d1_dw_0_20260203T145344.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 35m (2144s) |
| CPU time | 27m (1669s = 77%) |
| Max RSS bytes | 2570272768 (2451 MiB) |
| Outputting started | 2026-02-04 03:46:54 |
| Output files | |
| Finished | 2026-02-04 03:48:14 |
| Saved logs | justin-logs:298087.1-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
20
Caught exception in looking up space point ptr... 0x558f4420, 0x558f3f90
Caught exception in looking up space point ptr... 0x61fc9b20, 0x61fc9990
Caught exception in looking up space point ptr... 0x61fc9990, 0x61fd1eb0
Caught exception in looking up space point ptr... 0x2aba5280, 0x21eed0c0
Caught exception in looking up space point ptr... 0x21eed0c0, 0x21efb180
Caught exception in looking up space point ptr... 0x49cabc20, 0x49cac010
Caught exception in looking up space point ptr... 0x49cac010, 0x49cabc20
Caught exception in looking up space point ptr... 0x46a71d80, 0x46a71fe0
Caught exception in looking up space point ptr... 0x46a71fe0, 0x46a71d80
Caught exception in looking up space point ptr... 0x256c5930, 0x261c3690
Caught exception in looking up space point ptr... 0x261c3690, 0x256c5930
Caught exception in looking up space point ptr... 0x51c3faa0, 0x51c3fd40
Caught exception in looking up space point ptr... 0x51c3fd40, 0x51c40130
Caught exception in looking up space point ptr... 0x57c37fb0, 0x57c38140
Caught exception in looking up space point ptr... 0x57c38140, 0x57c37fb0
Caught exception in looking up space point ptr... 0x57c37fb0, 0x2c435640
Caught exception in looking up space point ptr... 0x2c435640, 0x57c37fb0
Caught exception in looking up space point ptr... 0x4702e620, 0x34fd9e00
Caught exception in looking up space point ptr... 0x34fd9e00, 0x4702e620
Caught exception in looking up space point ptr... 0x44b9d4a0, 0x44b9cff0
Caught exception in looking up space point ptr... 0x44b9cff0, 0x44b9d4a0
Caught exception in looking up space point ptr... 0x5f13bb40, 0x5f13b9b0
Caught exception in looking up space point ptr... 0x5f13b9b0, 0x5f13bb40
Caught exception in looking up space point ptr... 0x5f13bb40, 0x5f13b820
Caught exception in looking up space point ptr... 0x5f13b820, 0x5f13bb40
Caught exception in looking up space point ptr... 0x515a4980, 0x515a4c20
Caught exception in looking up space point ptr... 0x515a4c20, 0x515a4980
Caught exception in looking up space point ptr... 0x31ef6580, 0x31ef8b20
Caught exception in looking up space point ptr... 0x31ef8b20, 0x31ef6580
Caught exception in looking up space point ptr... 0x8070410, 0x806ff60
Caught exception in looking up space point ptr... 0x806ff60, 0x8070410
Caught exception in looking up space point ptr... 0x22221940, 0x22225360
Caught exception in looking up space point ptr... 0x22225360, 0x27e6c070
Caught exception in looking up space point ptr... 0x107238d0, 0x107204a0
Caught exception in looking up space point ptr... 0x107204a0, 0x107238d0
Caught exception in looking up space point ptr... 0x40e713a0, 0x40e71100
Caught exception in looking up space point ptr... 0x40e71100, 0x40e71250
Caught exception in looking up space point ptr... 0x38f4a180, 0x38f4a310
Caught exception in looking up space point ptr... 0x38f4a310, 0x38f4a180
Caught exception in looking up space point ptr... 0x3011d3d0, 0x3011c5d0
Caught exception in looking up space point ptr... 0x3011c5d0, 0x3011d630
Caught exception in looking up space point ptr... 0x3861f840, 0x3861f5f0
Caught exception in looking up space point ptr... 0x3861fd30, 0x3861f840
Caught exception in looking up space point ptr... 0xe1cfa90, 0x30aec060
Caught exception in looking up space point ptr... 0x30aec060, 0xe1cfa90
Caught exception in looking up space point ptr... 0x11636b60, 0x21bc9c20
Caught exception in looking up space point ptr... 0x5f13a8d0, 0x11636b60
Caught exception in looking up space point ptr... 0x548a88d0, 0x5f148810
Caught exception in looking up space point ptr... 0x5f148810, 0x548a88d0
Caught exception in looking up space point ptr... 0x51d9fbf0, 0x51d9fdb0
Caught exception in looking up space point ptr... 0x51d9fdb0, 0x51d9fbf0
Caught exception in looking up space point ptr... 0x58d8d5d0, 0x58d8d2e0
Caught exception in looking up space point ptr... 0x58d8d2e0, 0x58d8d5d0
Caught exception in looking up space point ptr... 0x853e6f0, 0x853e560
Caught exception in looking up space point ptr... 0x853e560, 0x3a199ce0
Caught exception in looking up space point ptr... 0x5eea12c0, 0x61fd7c60
Caught exception in looking up space point ptr... 0x61fd7c60, 0x5eea12c0
Caught exception in looking up space point ptr... 0x2223d3d0, 0x22238390
Caught exception in looking up space point ptr... 0x22238390, 0x22242410
Caught exception in looking up space point ptr... 0x451b9a70, 0x451b96b0
Caught exception in looking up space point ptr... 0x451b96b0, 0x451b9a70
Caught exception in looking up space point ptr... 0x41a0fd60, 0x41a0fc60
Caught exception in looking up space point ptr... 0x41a0fc60, 0x41a0fd60
Caught exception in looking up space point ptr... 0x1162ba90, 0x1162bdb0
Caught exception in looking up space point ptr... 0x1162bdb0, 0x1162bf40
++++>>>> total num hits: 80359, num free: 77025
04-Feb-2026 04:46:48 CET Closed output file "np02vd_raw_run042421_0153_df-s02-d1_dw_0_20260203T145344_reco_stage0_20260204T034648_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 71.4344 77.1161 89.2232 76.2679 3.96289 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.214e-05 9.55215e-05 0.000276341 8.458e-05 3.88113e-05 27
produce:tpcrawdecoder:PDVDTPCReader 15.8357 16.7783 22.0238 16.5391 1.08791 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.855098 0.902972 0.925881 0.913006 0.0177952 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0295064 0.0298432 0.0304253 0.0298077 0.000208612 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.147174 0.153124 0.177462 0.147823 0.0113792 27
produce:beamevent:BeamEvent 0.000103941 0.00017229 0.00104564 0.000142081 0.000172548 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.20724 2.48786 6.47558 2.32129 0.785479 27
produce:ophit:OpHitFinder 0.0188695 0.0297789 0.0368866 0.031091 0.00476124 27
produce:wclsdatavd:WireCellToolkit 43.4631 45.7478 48.3085 45.8722 1.00372 27
produce:gaushit:GausHitFinder 0.319129 0.605577 0.955988 0.567501 0.162608 27
produce:nhitsfilter:NumberOfHitsFilter 0.0001236 0.000178785 0.000444142 0.00016425 6.4523e-05 27
produce:reco3d:SpacePointSolver 2.86841 6.3749 13.7694 6.13883 2.2938 27
produce:hitpdune:DisambigFromSpacePoints 0.0333116 0.0620965 0.146936 0.0565362 0.0229827 27
produce:cluster3d:Cluster3D 0.532026 1.15845 3.02305 1.04192 0.546094 27
[art]:TriggerResults:TriggerResultInserter 2.34e-05 3.69773e-05 0.00011652 3.354e-05 1.66853e-05 27
end_path:out1:RootOutput 5.75e-06 8.62485e-06 3.034e-05 6.88e-06 4.66958e-06 27
end_path:out1:RootOutput(write) 2.54886 2.76112 3.25249 2.71702 0.168839 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4568.92 MB
Peak resident set size usage (VmHWM): 2570.27 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0153_df-s02-d1_dw_0_20260203T145344_reco_stage0_20260204T034648_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0153_df-s02-d1_dw_0_20260203T145344_reco_stage0_20260204T034648_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0153_df-s02-d1_dw_0_20260203T145344_reco_stage0_20260204T034648_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770174675.0,
"core.end_time": 1770176809.0,
"core.events": [
24853,
24859,
24865,
24871,
24877,
24883,
24889,
24895,
24901,
24907,
24913,
24919,
24925,
24931,
24937,
24943,
24949,
24955,
24961,
24967,
24973,
24979,
24985,
24991,
24997,
25003,
25009
],
"core.event_count": 27,
"core.first_event_number": 24853,
"core.last_event_number": 25009,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0153_df-s02-d1_dw_0_20260203T145344.hdf5"
}
]
} 