Jobsub ID 297916.2@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.2@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2026-02-03 23:49:14 |
| From worker node | Hostname | b9g24p4713.cern.ch |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:47:19 |
| Input files | vd-protodune:np02vd_raw_run042422_0094_df-s02-d1_dw_0_20260203T160535.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 58m (3523s) |
| CPU time | 56m (3405s = 96%) |
| Max RSS bytes | 2756505600 (2628 MiB) |
| Outputting started | 2026-02-03 23:46:04 |
| Output files | |
| Finished | 2026-02-03 23:49:14 |
| Saved logs | justin-logs:297916.2-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x571f8e20, 0x50217410
Caught exception in looking up space point ptr... 0x50217410, 0x50217280
Caught exception in looking up space point ptr... 0x59044350, 0x121d3bf0
Caught exception in looking up space point ptr... 0x5903ac30, 0x59044350
Caught exception in looking up space point ptr... 0x4ba72f50, 0x29ca3c60
Caught exception in looking up space point ptr... 0x29ca3c60, 0x4ac0dc10
Caught exception in looking up space point ptr... 0x467abd90, 0xfd40830
Caught exception in looking up space point ptr... 0x467bab60, 0x467abd90
Caught exception in looking up space point ptr... 0x3a2aaeb0, 0x47a583f0
Caught exception in looking up space point ptr... 0x47a583f0, 0x25bc47b0
Caught exception in looking up space point ptr... 0x38c4c140, 0x25332790
Caught exception in looking up space point ptr... 0x3da32120, 0x38c4c140
Caught exception in looking up space point ptr... 0x24fcc600, 0x5cc1f7e0
Caught exception in looking up space point ptr... 0x24fde8a0, 0x24fcc600
Caught exception in looking up space point ptr... 0x29cea510, 0x290e3a50
Caught exception in looking up space point ptr... 0x290e3a50, 0x389e6130
Caught exception in looking up space point ptr... 0x389e6130, 0x4ffc6fe0
Caught exception in looking up space point ptr... 0x4a1d3600, 0x4a1c11d0
Caught exception in looking up space point ptr... 0x4a1c11d0, 0x4a1d3470
Caught exception in looking up space point ptr... 0x33066fd0, 0x545c88f0
Caught exception in looking up space point ptr... 0x3306b690, 0x33066fd0
Caught exception in looking up space point ptr... 0x39be05b0, 0x417105d0
Caught exception in looking up space point ptr... 0x39bf2080, 0x39be05b0
Caught exception in looking up space point ptr... 0x3894a380, 0x3894a1f0
Caught exception in looking up space point ptr... 0x3894a1f0, 0x10f98a10
Caught exception in looking up space point ptr... 0x25287b90, 0x252877a0
Caught exception in looking up space point ptr... 0x252877a0, 0x25287260
Caught exception in looking up space point ptr... 0xa57aea0, 0xa56cbb0
Caught exception in looking up space point ptr... 0x42dfed80, 0xa57aea0
Caught exception in looking up space point ptr... 0x33700c50, 0x4d088070
Caught exception in looking up space point ptr... 0x4d088070, 0x4d077cd0
Caught exception in looking up space point ptr... 0x4d077cd0, 0x9edd530
Caught exception in looking up space point ptr... 0x6075e900, 0x6074c980
Caught exception in looking up space point ptr... 0x6074c980, 0x159bd5c0
Caught exception in looking up space point ptr... 0xdff6d00, 0x61b800d0
Caught exception in looking up space point ptr... 0x61b800d0, 0x61b80270
Caught exception in looking up space point ptr... 0x61b80270, 0x26520580
Caught exception in looking up space point ptr... 0x26520580, 0x265204e0
Caught exception in looking up space point ptr... 0x265204e0, 0x265207c0
Caught exception in looking up space point ptr... 0x26520860, 0x26520900
Caught exception in looking up space point ptr... 0x26520900, 0xdff6d00
Caught exception in looking up space point ptr... 0x38fe4e50, 0x38fe4f50
Caught exception in looking up space point ptr... 0x38fe4f50, 0x38fe4e50
Caught exception in looking up space point ptr... 0x602eb0c0, 0x2cb62880
Caught exception in looking up space point ptr... 0x2cb62880, 0x4d2c0710
Caught exception in looking up space point ptr... 0x30465950, 0x2b0ad960
Caught exception in looking up space point ptr... 0x4b0373c0, 0x30465950
Caught exception in looking up space point ptr... 0x59169ab0, 0x59169db0
Caught exception in looking up space point ptr... 0x59169db0, 0x5916a010
Caught exception in looking up space point ptr... 0x46134ae0, 0x4fbcb570
Caught exception in looking up space point ptr... 0x4fbcb570, 0x2b27ae50
Caught exception in looking up space point ptr... 0x4c1f6f20, 0x4c1f6fc0
Caught exception in looking up space point ptr... 0x4c1f6fc0, 0x4c1f6f20
Caught exception in looking up space point ptr... 0x29cea920, 0x576cc910
Caught exception in looking up space point ptr... 0x576cc910, 0x29cea810
Caught exception in looking up space point ptr... 0x463cf890, 0x4bdf6540
Caught exception in looking up space point ptr... 0x4bdf6540, 0x2467f6a0
Caught exception in looking up space point ptr... 0x4adb1d80, 0x463fb9e0
Caught exception in looking up space point ptr... 0x463fb9e0, 0x4adb1d80
Caught exception in looking up space point ptr... 0x20c53a60, 0x20c537d0
Caught exception in looking up space point ptr... 0x20c537d0, 0x20c53500
Caught exception in looking up space point ptr... 0x3d0ff250, 0x377278b0
Caught exception in looking up space point ptr... 0x377278b0, 0x3d0ff250
Caught exception in looking up space point ptr... 0xd8546e0, 0x4d9eb6a0
Caught exception in looking up space point ptr... 0x4d9eb6a0, 0x58b38150
++++>>>> total num hits: 269230, num free: 262861
04-Feb-2026 00:45:55 CET Closed output file "np02vd_raw_run042422_0094_df-s02-d1_dw_0_20260203T160535_reco_stage0_20260203T234555_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 83.4342 127.8 156.283 128.27 20.7297 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.1861e-05 0.000108353 0.000327846 0.000105262 5.82045e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.03137 4.71472 5.10329 4.73329 0.2441 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00984654 0.0126444 0.0313552 0.011847 0.0038847 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000385728 0.000610972 0.00124927 0.000568801 0.000208784 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00146848 0.00182816 0.00291177 0.00175308 0.000326461 27
produce:beamevent:BeamEvent 5.3521e-05 0.000142609 0.00107197 9.2482e-05 0.000185934 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.28862 2.66328 3.1922 2.66679 0.238213 27
produce:ophit:OpHitFinder 0.0280887 0.0353234 0.0432511 0.0342095 0.00435134 27
produce:wclsdatavd:WireCellToolkit 63.5535 72.9029 83.3207 72.2721 5.57812 27
produce:gaushit:GausHitFinder 0.679156 1.29052 1.8716 1.26805 0.304544 27
produce:nhitsfilter:NumberOfHitsFilter 0.000223004 0.000385388 0.000684443 0.000379387 0.000100839 27
produce:reco3d:SpacePointSolver 5.01155 9.13391 18.7986 8.46566 3.91254 27
produce:hitpdune:DisambigFromSpacePoints 0.0685673 0.221549 0.464219 0.219736 0.0940276 27
produce:cluster3d:Cluster3D 0.799438 32.1949 56.9711 39.2698 16.7546 27
[art]:TriggerResults:TriggerResultInserter 2.2281e-05 3.19063e-05 0.000112682 2.7e-05 1.67537e-05 27
end_path:out1:RootOutput 6.86e-06 1.23686e-05 3.394e-05 1.137e-05 5.57035e-06 27
end_path:out1:RootOutput(write) 3.14051 4.60077 5.73744 4.51429 0.642898 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4696.72 MB
Peak resident set size usage (VmHWM): 2756.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0094_df-s02-d1_dw_0_20260203T160535_reco_stage0_20260203T234555_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0094_df-s02-d1_dw_0_20260203T160535_reco_stage0_20260203T234555_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0094_df-s02-d1_dw_0_20260203T160535_reco_stage0_20260203T234555_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158851.0,
"core.end_time": 1770162357.0,
"core.events": [
15241,
15247,
15253,
15259,
15265,
15271,
15277,
15283,
15289,
15295,
15301,
15307,
15313,
15319,
15325,
15331,
15337,
15343,
15349,
15355,
15361,
15367,
15373,
15379,
15385,
15391,
15397
],
"core.event_count": 27,
"core.first_event_number": 15241,
"core.last_event_number": 15397,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0094_df-s02-d1_dw_0_20260203T160535.hdf5"
}
]
} 