Jobsub ID 297950.2@dunegpschedd02.fnal.gov
| Jobsub ID | 297950.2@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:50:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce510 |
| Last heartbeat | 2026-02-04 01:09:44 |
| From worker node | Hostname | b9p09p3861.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:13:52 |
| Input files | vd-protodune:np02vd_raw_run042422_0026_df-s04-d0_dw_0_20260203T152852.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 53m (3189s) |
| CPU time | 51m (3070s = 96%) |
| Max RSS bytes | 2731778048 (2605 MiB) |
| Outputting started | 2026-02-04 01:07:04 |
| Output files | |
| Finished | 2026-02-04 01:09:44 |
| Saved logs | justin-logs:297950.2-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
.. 0x1440eca0, 0x20c96550
Caught exception in looking up space point ptr... 0x20c96550, 0x11474be0
Caught exception in looking up space point ptr... 0x440af440, 0x4e5ffb10
Caught exception in looking up space point ptr... 0x440c1870, 0x440af440
Caught exception in looking up space point ptr... 0x5d72bb30, 0x39561ee0
Caught exception in looking up space point ptr... 0x3954ff60, 0x5d72bb30
Caught exception in looking up space point ptr... 0x22e73550, 0x22e60e00
Caught exception in looking up space point ptr... 0x22e736e0, 0x22e73550
Caught exception in looking up space point ptr... 0x306250e0, 0x1450afa0
Caught exception in looking up space point ptr... 0x1450afa0, 0x20f51890
Caught exception in looking up space point ptr... 0x49d119c0, 0x49d11b50
Caught exception in looking up space point ptr... 0x46599c10, 0x49d119c0
Caught exception in looking up space point ptr... 0x10a42320, 0x109dce80
Caught exception in looking up space point ptr... 0x109dce80, 0x451d6580
Caught exception in looking up space point ptr... 0x2da56710, 0x4665cdf0
Caught exception in looking up space point ptr... 0x53f17990, 0x2da56710
Caught exception in looking up space point ptr... 0xdd8fdf0, 0x54444680
Caught exception in looking up space point ptr... 0x54444680, 0x544444f0
Caught exception in looking up space point ptr... 0x28a2e280, 0x30a1c4e0
Caught exception in looking up space point ptr... 0x4cfe0630, 0x28a2e280
Caught exception in looking up space point ptr... 0x40c543f0, 0x36311c40
Caught exception in looking up space point ptr... 0x36311c40, 0xdd18de0
Caught exception in looking up space point ptr... 0x4657dec0, 0x46590480
Caught exception in looking up space point ptr... 0x7d200d0, 0x4657dec0
Caught exception in looking up space point ptr... 0x3e3239d0, 0x26043400
Caught exception in looking up space point ptr... 0x26043400, 0x26043590
Caught exception in looking up space point ptr... 0x28c055b0, 0x4958d730
Caught exception in looking up space point ptr... 0x4958d730, 0x28c055b0
Caught exception in looking up space point ptr... 0x4656efe0, 0x892f7d0
Caught exception in looking up space point ptr... 0x2d89ab90, 0x4656efe0
Caught exception in looking up space point ptr... 0x8e7b360, 0x3768b780
Caught exception in looking up space point ptr... 0x3768b780, 0x14530fd0
Caught exception in looking up space point ptr... 0x116789c0, 0x1168b110
Caught exception in looking up space point ptr... 0x1168af80, 0x116789c0
Caught exception in looking up space point ptr... 0x1167db00, 0x2d333a50
Caught exception in looking up space point ptr... 0x2d3338c0, 0x1167db00
Caught exception in looking up space point ptr... 0x2d335030, 0x1167f0e0
Caught exception in looking up space point ptr... 0x1167f0e0, 0x2d334ea0
Caught exception in looking up space point ptr... 0x41569c30, 0x65755370
Caught exception in looking up space point ptr... 0x4157bd40, 0x41569c30
Caught exception in looking up space point ptr... 0x10d61a20, 0x10d53150
Caught exception in looking up space point ptr... 0x10d53150, 0x268bf760
Caught exception in looking up space point ptr... 0x10d56e40, 0x268c35e0
Caught exception in looking up space point ptr... 0x268c35e0, 0x268b4b80
Caught exception in looking up space point ptr... 0x2605f370, 0x4fcd9ce0
Caught exception in looking up space point ptr... 0x4fcd9ce0, 0x4fcc7590
Caught exception in looking up space point ptr... 0x658b64f0, 0x658a43e0
Caught exception in looking up space point ptr... 0x658a43e0, 0x65892460
Caught exception in looking up space point ptr... 0x25920050, 0x2591ff50
Caught exception in looking up space point ptr... 0x2591ff50, 0x25920050
Caught exception in looking up space point ptr... 0x2e8f5450, 0x2e8f5550
Caught exception in looking up space point ptr... 0x2e8f5550, 0x2e8f5350
Caught exception in looking up space point ptr... 0x2ed243a0, 0x2ed29690
Caught exception in looking up space point ptr... 0x2ed29690, 0x2ed243a0
Caught exception in looking up space point ptr... 0x64844cf0, 0x65672580
Caught exception in looking up space point ptr... 0x65672580, 0x64844cf0
Caught exception in looking up space point ptr... 0x364f5190, 0x364f54b0
Caught exception in looking up space point ptr... 0x364f54b0, 0x364f5190
Caught exception in looking up space point ptr... 0x4fbf2640, 0x4fbf24e0
Caught exception in looking up space point ptr... 0x4fbf24e0, 0x4fbf2640
Caught exception in looking up space point ptr... 0x5519f0f0, 0x5519ec30
Caught exception in looking up space point ptr... 0x5519ec30, 0x5519edd0
Caught exception in looking up space point ptr... 0x4daedd50, 0x4daee070
Caught exception in looking up space point ptr... 0x4daee070, 0x4daedd50
Caught exception in looking up space point ptr... 0x3279d350, 0x293e1730
Caught exception in looking up space point ptr... 0x293e1730, 0x116556c0
++++>>>> total num hits: 344114, num free: 337334
04-Feb-2026 02:06:53 CET Closed output file "np02vd_raw_run042422_0026_df-s04-d0_dw_0_20260203T152852_reco_stage0_20260204T010653_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 79.0329 115.569 149.221 121.303 19.8685 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.1121e-05 8.97555e-05 0.000240284 7.3792e-05 4.16968e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.93521 4.56394 5.86444 4.50897 0.397527 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0097023 0.0171209 0.0399601 0.0128441 0.00884896 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000354976 0.000580411 0.00141489 0.000503858 0.000244399 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00143168 0.00217102 0.00607734 0.00187129 0.0010066 27
produce:beamevent:BeamEvent 6.5741e-05 0.000149323 0.00127008 0.000100342 0.000221373 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.25842 2.90657 3.43866 2.9308 0.282999 27
produce:ophit:OpHitFinder 0.0231439 0.0383339 0.0469813 0.0403279 0.00652065 27
produce:wclsdatavd:WireCellToolkit 56.9247 67.9772 87.3295 65.6729 8.29999 27
produce:gaushit:GausHitFinder 0.577903 1.25281 1.91575 1.18003 0.341494 27
produce:nhitsfilter:NumberOfHitsFilter 0.000159333 0.000308782 0.00057319 0.000281455 0.000100391 27
produce:reco3d:SpacePointSolver 4.77475 9.54958 13.257 9.57192 2.39485 27
produce:hitpdune:DisambigFromSpacePoints 0.0449738 0.186352 0.351031 0.180112 0.0816274 27
produce:cluster3d:Cluster3D 0.968424 24.8869 42.7814 29.6412 14.299 27
[art]:TriggerResults:TriggerResultInserter 1.787e-05 3.43397e-05 0.000113282 2.8e-05 1.86812e-05 27
end_path:out1:RootOutput 2.991e-06 1.51207e-05 0.000199433 6.731e-06 3.65253e-05 27
end_path:out1:RootOutput(write) 2.85122 4.16511 6.29904 4.10259 0.752862 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4719.76 MB
Peak resident set size usage (VmHWM): 2731.78 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0026_df-s04-d0_dw_0_20260203T152852_reco_stage0_20260204T010653_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0026_df-s04-d0_dw_0_20260203T152852_reco_stage0_20260204T010653_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0026_df-s04-d0_dw_0_20260203T152852_reco_stage0_20260204T010653_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164045.0,
"core.end_time": 1770167215.0,
"core.events": [
4216,
4222,
4228,
4234,
4240,
4246,
4252,
4258,
4264,
4270,
4276,
4282,
4288,
4294,
4300,
4306,
4312,
4318,
4324,
4330,
4336,
4342,
4348,
4354,
4360,
4366,
4372
],
"core.event_count": 27,
"core.first_event_number": 4216,
"core.last_event_number": 4372,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0026_df-s04-d0_dw_0_20260203T152852.hdf5"
}
]
} 