Jobsub ID 301494.1@dunegpschedd01.fnal.gov
| Jobsub ID | 301494.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12428 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2026-01-27 13:43:27 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce507 |
| Last heartbeat | 2026-01-27 14:59:06 |
| From worker node | Hostname | b9p11p6894.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-01-27 13:44:48 |
| Input files | vd-protodune:np02vd_raw_run039636_0029_df-s04-d2_dw_0_20250925T190953.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4295s) |
| CPU time | 1h (4157s = 96%) |
| Max RSS bytes | 2949885952 (2813 MiB) |
| Outputting started | 2026-01-27 14:56:26 |
| Output files | |
| Finished | 2026-01-27 14:59:06 |
| Saved logs | justin-logs:301494.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
906c20, 0x2e850740
Caught exception in looking up space point ptr... 0x362adc60, 0x362addf0
Caught exception in looking up space point ptr... 0x105f0630, 0x362adc60
Caught exception in looking up space point ptr... 0x362adf80, 0x362ae110
Caught exception in looking up space point ptr... 0x105f1440, 0x362adf80
Caught exception in looking up space point ptr... 0x362ae2a0, 0x362ae430
Caught exception in looking up space point ptr... 0x105f2890, 0x362ae2a0
Caught exception in looking up space point ptr... 0x9a0db50, 0x9a0d9c0
Caught exception in looking up space point ptr... 0x9a0d9c0, 0x9a0d6a0
Caught exception in looking up space point ptr... 0x9a0e640, 0x9a0e7d0
Caught exception in looking up space point ptr... 0x9a0e7d0, 0x9a0e640
Caught exception in looking up space point ptr... 0x31f6e8f0, 0x31f6ec10
Caught exception in looking up space point ptr... 0x31f6ec10, 0x31f6eda0
Caught exception in looking up space point ptr... 0x47348e80, 0x47349010
Caught exception in looking up space point ptr... 0x47349010, 0x47348e80
Caught exception in looking up space point ptr... 0x1e429b20, 0x473494c0
Caught exception in looking up space point ptr... 0x473494c0, 0x47349330
Caught exception in looking up space point ptr... 0xfaa5020, 0x121f8b60
Caught exception in looking up space point ptr... 0x121f8b60, 0x121f89d0
Caught exception in looking up space point ptr... 0xe0bf4d0, 0xe408500
Caught exception in looking up space point ptr... 0xe408500, 0xe408370
Caught exception in looking up space point ptr... 0x29d16930, 0x2ab99a10
Caught exception in looking up space point ptr... 0x2ab99a10, 0x2ab99880
Caught exception in looking up space point ptr... 0x2c904ff0, 0x2ab932f0
Caught exception in looking up space point ptr... 0x2ab932f0, 0x2ab93160
Caught exception in looking up space point ptr... 0x27a52340, 0x2ab961d0
Caught exception in looking up space point ptr... 0x2ab961d0, 0x2ab96040
Caught exception in looking up space point ptr... 0x2c906a80, 0x2ab93610
Caught exception in looking up space point ptr... 0x2ab93610, 0x2ab93480
Caught exception in looking up space point ptr... 0x2c900fe0, 0x2ab92cb0
Caught exception in looking up space point ptr... 0x2ab92cb0, 0x2ab92b20
Caught exception in looking up space point ptr... 0x2ab91220, 0xf94f450
Caught exception in looking up space point ptr... 0x2ab91090, 0x2ab91220
Caught exception in looking up space point ptr... 0x273c1b70, 0xe403230
Caught exception in looking up space point ptr... 0xe403230, 0xe4030a0
Caught exception in looking up space point ptr... 0xf94fc20, 0x2ab91540
Caught exception in looking up space point ptr... 0x2ab91540, 0x2ab913b0
Caught exception in looking up space point ptr... 0xf94ec80, 0x2ab90f00
Caught exception in looking up space point ptr... 0x2ab90f00, 0x2ab90d70
Caught exception in looking up space point ptr... 0xf953910, 0x2ab91ea0
Caught exception in looking up space point ptr... 0x2ab91ea0, 0x2ab91d10
Caught exception in looking up space point ptr... 0x2c902f20, 0x2ab92fd0
Caught exception in looking up space point ptr... 0x2ab92fd0, 0x2ab92e40
Caught exception in looking up space point ptr... 0x115e2150, 0x2aba02c0
Caught exception in looking up space point ptr... 0x2aba02c0, 0x2aba0130
Caught exception in looking up space point ptr... 0x301dff50, 0x2ab99d30
Caught exception in looking up space point ptr... 0x2ab99d30, 0x2ab99ba0
Caught exception in looking up space point ptr... 0x36a7e160, 0x36a7e2f0
Caught exception in looking up space point ptr... 0x36a7e2f0, 0x27a4d6b0
Caught exception in looking up space point ptr... 0x29d0cb60, 0x36a82490
Caught exception in looking up space point ptr... 0x36a82490, 0x36a82300
Caught exception in looking up space point ptr... 0x9a15080, 0x9a153a0
Caught exception in looking up space point ptr... 0x9a153a0, 0x9a15080
Caught exception in looking up space point ptr... 0x9a13aa0, 0x9a13dc0
Caught exception in looking up space point ptr... 0x9a13dc0, 0x9a13aa0
Caught exception in looking up space point ptr... 0x238a0a10, 0x238a0d30
Caught exception in looking up space point ptr... 0x238a0d30, 0x238a0a10
Caught exception in looking up space point ptr... 0x3118b000, 0x28518d40
Caught exception in looking up space point ptr... 0x28518d40, 0x285190d0
Caught exception in looking up space point ptr... 0x49d0a1f0, 0xff9c6f0
Caught exception in looking up space point ptr... 0xff9c6f0, 0x49d0a1f0
Caught exception in looking up space point ptr... 0x3e7bd9a0, 0xff9a7b0
Caught exception in looking up space point ptr... 0xff9a7b0, 0x3e7bdb30
++++>>>> total num hits: 146096, num free: 139475
27-Jan-2026 15:56:15 CET Closed output file "np02vd_raw_run039636_0029_df-s04-d2_dw_0_20250925T190953_reco_stage0_20260127T145615_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 53.8985 87.9831 193.464 75.044 32.0049 48
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.184e-05 8.75004e-05 0.000261514 7.2106e-05 4.86236e-05 48
produce:tpcrawdecoder:PDVDTPCReader 1.57482 2.10218 3.44866 2.02154 0.367201 48
produce:triggerrawdecoder:PDVDTriggerReader4 0.00546847 0.0100081 0.0595958 0.00834285 0.00797635 48
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000354575 0.00050887 0.00113211 0.000472887 0.0001392 48
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0014525 0.00187013 0.00382226 0.00182524 0.000366259 48
produce:beamevent:BeamEvent 4.8781e-05 0.00011771 0.000920504 8.86065e-05 0.000124211 48
produce:pdvddaphne:DAPHNEReaderPDVD 0.000174762 0.000277814 0.000651279 0.00027813 7.8959e-05 48
produce:ophit:OpHitFinder 4.7381e-05 0.000103765 0.00064047 8.9396e-05 8.34313e-05 48
produce:wclsdatavd:WireCellToolkit 43.6495 55.3076 77.0315 50.3551 10.5559 48
produce:gaushit:GausHitFinder 0.256005 2.22703 5.67181 2.19135 1.29299 48
produce:nhitsfilter:NumberOfHitsFilter 8.2781e-05 0.000242414 0.000506547 0.000228918 9.26538e-05 48
produce:reco3d:SpacePointSolver 1.6998 5.97135 36.2271 4.24228 5.63633 48
produce:hitpdune:DisambigFromSpacePoints 0.0159288 0.373229 0.968387 0.311693 0.245258 48
produce:cluster3d:Cluster3D 0.448366 19.35 103.132 10.0781 23.8711 48
[art]:TriggerResults:TriggerResultInserter 1.654e-05 2.88706e-05 7.1181e-05 2.65305e-05 9.37283e-06 48
end_path:out1:RootOutput 3.29e-06 5.82712e-06 2.094e-05 5.895e-06 2.61649e-06 48
end_path:out1:RootOutput(write) 1.85565 2.62424 4.89869 2.33996 0.683353 48
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4961.25 MB
Peak resident set size usage (VmHWM): 2949.89 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run039636_0029_df-s04-d2_dw_0_20250925T190953_reco_stage0_20260127T145615_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run039636_0029_df-s04-d2_dw_0_20250925T190953_reco_stage0_20260127T145615_offline.root
Ran successfully
{
"name": "np02vd_raw_run039636_0029_df-s04-d2_dw_0_20250925T190953_reco_stage0_20260127T145615_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_neutrino.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1769521502.0,
"core.end_time": 1769525776.0,
"core.events": [
5554,
5558,
5562,
5566,
5570,
5574,
5578,
5582,
5586,
5590,
5594,
5598,
5602,
5606,
5610,
5614,
5618,
5622,
5626,
5630,
5634,
5638,
5642,
5646,
5650,
5654,
5658,
5662,
5666,
5670,
5674,
5678,
5682,
5686,
5690,
5694,
5698,
5702,
5706,
5710,
5714,
5718,
5722,
5726,
5730,
5734,
5738,
5742
],
"core.event_count": 48,
"core.first_event_number": 5554,
"core.last_event_number": 5742,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
39636
],
"core.runs_subruns": [
3963600001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run039636_0029_df-s04-d2_dw_0_20250925T190953.hdf5"
}
]
} 