Jobsub ID 303653.11@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.11@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 01:54:13 |
| From worker node | Hostname | b9p34p1022.cern.ch |
| cpuinfo | AMD EPYC 9655 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:36:42 |
| Input files | vd-protodune:np02vd_raw_run042421_0095_df-s02-d1_dw_0_20260203T142221.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8015s) |
| CPU time | 2h (7860s = 98%) |
| Max RSS bytes | 12789043200 (12196 MiB) |
| Outputting started | 2026-02-04 01:50:20 |
| Output files | |
| Finished | 2026-02-04 01:54:13 |
| Saved logs | justin-logs:303653.11-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
n in looking up space point ptr... 0x4a16b790, 0x71dedc10
Caught exception in looking up space point ptr... 0x28e18e00, 0x28e18f90
Caught exception in looking up space point ptr... 0x28e18f90, 0x430ef100
Caught exception in looking up space point ptr... 0x3a674a80, 0x13f74ccd0
Caught exception in looking up space point ptr... 0x13f74ccd0, 0x3a674a80
Caught exception in looking up space point ptr... 0x13dd5b000, 0x83056c60
Caught exception in looking up space point ptr... 0x17206d180, 0x13dd5b000
Caught exception in looking up space point ptr... 0x55513980, 0x28ef4d90
Caught exception in looking up space point ptr... 0x28ef4d90, 0x55513980
Caught exception in looking up space point ptr... 0x285a35d0, 0x2e97ad00
Caught exception in looking up space point ptr... 0x2e97ad00, 0x689b2c90
Caught exception in looking up space point ptr... 0x46e18620, 0x2fca47c0
Caught exception in looking up space point ptr... 0x2fca47c0, 0x46e18620
Caught exception in looking up space point ptr... 0x7225a810, 0x68b1f280
Caught exception in looking up space point ptr... 0x68b1f280, 0x3bec3020
Caught exception in looking up space point ptr... 0x3bec3020, 0x2ce69700
Caught exception in looking up space point ptr... 0x2ce69700, 0x21ffbe00
Caught exception in looking up space point ptr... 0x21ffbe00, 0x7225a810
Caught exception in looking up space point ptr... 0x429b7b80, 0x2f732450
Caught exception in looking up space point ptr... 0x2f732450, 0x429b8550
Caught exception in looking up space point ptr... 0x4ff8d840, 0x4ff8db80
Caught exception in looking up space point ptr... 0x4ff8db80, 0x4ff8d6a0
Caught exception in looking up space point ptr... 0x168092e0, 0xf81f8180
Caught exception in looking up space point ptr... 0x2bc58ab0, 0x168092e0
Caught exception in looking up space point ptr... 0x2db414d0, 0x689d8a90
Caught exception in looking up space point ptr... 0x689d8a90, 0x2db414d0
Caught exception in looking up space point ptr... 0x16b80a00, 0xb39e680
Caught exception in looking up space point ptr... 0xb39e680, 0xb39da70
Caught exception in looking up space point ptr... 0xb39da70, 0x7d9f0990
Caught exception in looking up space point ptr... 0x2e9768a0, 0x70b78170
Caught exception in looking up space point ptr... 0x70b78170, 0x2e9768a0
Caught exception in looking up space point ptr... 0x2e9768a0, 0x46fd53b0
Caught exception in looking up space point ptr... 0x46fd53b0, 0x2e9768a0
Caught exception in looking up space point ptr... 0x54637d50, 0x54637ee0
Caught exception in looking up space point ptr... 0x54637ee0, 0x54637bc0
Caught exception in looking up space point ptr... 0x2be44670, 0x821ce630
Caught exception in looking up space point ptr... 0x821ce630, 0x2be44530
Caught exception in looking up space point ptr... 0x5acb6f70, 0x5acb6d60
Caught exception in looking up space point ptr... 0x5acb6d60, 0x319f2e30
Caught exception in looking up space point ptr... 0x319f2e30, 0x5acb6d60
Caught exception in looking up space point ptr... 0x5acb6d60, 0x46f154f0
Caught exception in looking up space point ptr... 0x3a262550, 0x2eacc390
Caught exception in looking up space point ptr... 0x2eacc390, 0x3a262550
Caught exception in looking up space point ptr... 0x88e39450, 0x88e394f0
Caught exception in looking up space point ptr... 0x88e394f0, 0x88e396b0
Caught exception in looking up space point ptr... 0x28ce0a30, 0x28ce00b0
Caught exception in looking up space point ptr... 0x28ce00b0, 0x28ce01e0
Caught exception in looking up space point ptr... 0x47200e50, 0x5948b900
Caught exception in looking up space point ptr... 0x5948b900, 0x47200e50
Caught exception in looking up space point ptr... 0x3db772c0, 0x2513b680
Caught exception in looking up space point ptr... 0x2513b680, 0x3db772c0
Caught exception in looking up space point ptr... 0x2ccf34c0, 0x2ccf3260
Caught exception in looking up space point ptr... 0x2ccf3260, 0x2ccf3390
Caught exception in looking up space point ptr... 0x22ba64a0, 0x58e9eda0
Caught exception in looking up space point ptr... 0x58e9eda0, 0x615ecec0
Caught exception in looking up space point ptr... 0x2ea11d90, 0xf18ba510
Caught exception in looking up space point ptr... 0xf18ba510, 0x1469cfd90
Caught exception in looking up space point ptr... 0x61635610, 0x470a9180
Caught exception in looking up space point ptr... 0x470a9180, 0x61635610
Caught exception in looking up space point ptr... 0x5f201a40, 0xe001450
Caught exception in looking up space point ptr... 0xe001450, 0x5f201a40
Caught exception in looking up space point ptr... 0x2f92b430, 0xc2634710
Caught exception in looking up space point ptr... 0xc2634710, 0x2f92b430
Caught exception in looking up space point ptr... 0xdb26230, 0x6acbb580
Caught exception in looking up space point ptr... 0x6acbb580, 0xdb26230
++++>>>> total num hits: 45596, num free: 44131
04-Feb-2026 02:50:11 CET Closed output file "np02vd_raw_run042421_0095_df-s02-d1_dw_0_20260203T142221_reco_stage0_20260204T015011_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 55.5962 284.215 1035.22 69.8262 305.574 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 6.5107e-05 9.32391e-05 0.000193149 8.53675e-05 2.82645e-05 28
produce:tpcrawdecoder:PDVDTPCReader 2.94764 3.67679 4.4328 3.63514 0.321639 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.00842021 0.0162222 0.0828801 0.0116802 0.0141956 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000371406 0.000684686 0.00150751 0.00058751 0.000286765 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00125634 0.00171403 0.00297023 0.00167915 0.000339827 28
produce:beamevent:BeamEvent 7.5993e-05 0.000142986 0.000878174 0.000114426 0.00014325 28
produce:pdvddaphne:DAPHNEReaderPDVD 1.88194 2.13278 2.54587 2.09322 0.182169 28
produce:ophit:OpHitFinder 0.0246486 0.0324822 0.0378429 0.0328736 0.00323986 28
produce:wclsdatavd:WireCellToolkit 39.0976 48.0916 62.1381 48.5338 5.9402 28
produce:gaushit:GausHitFinder 0.396197 2.93628 13.9044 0.814844 3.47223 28
produce:nhitsfilter:NumberOfHitsFilter 0.000129133 0.000344586 0.000876812 0.000206314 0.000221068 28
produce:reco3d:SpacePointSolver 4.59904 29.5922 89.4359 9.69638 29.5807 28
produce:hitpdune:DisambigFromSpacePoints 0.0428394 1.28482 6.1674 0.0991888 1.80947 28
produce:cluster3d:Cluster3D 0.609429 189.445 850.46 1.746 262.778 28
[art]:TriggerResults:TriggerResultInserter 2.4797e-05 4.44421e-05 8.016e-05 4.45615e-05 1.45424e-05 28
end_path:out1:RootOutput 6.39e-06 9.87943e-06 2.4807e-05 8.553e-06 4.53713e-06 28
end_path:out1:RootOutput(write) 2.47827 6.93052 17.7615 3.60647 5.17353 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 15025.1 MB
Peak resident set size usage (VmHWM): 12789 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0095_df-s02-d1_dw_0_20260203T142221_reco_stage0_20260204T015011_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0095_df-s02-d1_dw_0_20260203T142221_reco_stage0_20260204T015011_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0095_df-s02-d1_dw_0_20260203T142221_reco_stage0_20260204T015011_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161809.0,
"core.end_time": 1770169812.0,
"core.events": [
15445,
15451,
15457,
15463,
15469,
15475,
15481,
15487,
15493,
15499,
15505,
15511,
15517,
15523,
15529,
15535,
15541,
15547,
15553,
15559,
15565,
15571,
15577,
15583,
15589,
15595,
15601,
15607
],
"core.event_count": 28,
"core.first_event_number": 15445,
"core.last_event_number": 15607,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0095_df-s02-d1_dw_0_20260203T142221.hdf5"
}
]
} 