Jobsub ID 303656.0@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.0@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2026-02-04 01:01:37 |
| From worker node | Hostname | b9p10p5730.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:10:52 |
| Input files | vd-protodune:np02vd_raw_run042421_0006_df-s04-d1_dw_0_20260203T133408.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 47m (2879s) |
| CPU time | 46m (2760s = 95%) |
| Max RSS bytes | 2862723072 (2730 MiB) |
| Outputting started | 2026-02-04 00:58:53 |
| Output files | |
| Finished | 2026-02-04 01:01:37 |
| Saved logs | justin-logs:303656.0-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e7310, 0x2d7e4500
Caught exception in looking up space point ptr... 0x314b20b0, 0x34da7ac0
Caught exception in looking up space point ptr... 0x34da7ac0, 0x3ff7b380
Caught exception in looking up space point ptr... 0x399225a0, 0x39923330
Caught exception in looking up space point ptr... 0x39923330, 0x399225a0
Caught exception in looking up space point ptr... 0x39920580, 0x39920870
Caught exception in looking up space point ptr... 0x39920870, 0x39920580
Caught exception in looking up space point ptr... 0x60043160, 0x60044bb0
Caught exception in looking up space point ptr... 0x60044bb0, 0x60043160
Caught exception in looking up space point ptr... 0x42633270, 0x4db59020
Caught exception in looking up space point ptr... 0x4db59020, 0x42633120
Caught exception in looking up space point ptr... 0x42633120, 0x4db5f9f0
Caught exception in looking up space point ptr... 0x39916400, 0x3a036870
Caught exception in looking up space point ptr... 0x3a036870, 0x39916400
Caught exception in looking up space point ptr... 0x9db0b70, 0x9db0650
Caught exception in looking up space point ptr... 0x9db0650, 0x9db0570
Caught exception in looking up space point ptr... 0x5ffc6730, 0x5ffc2c90
Caught exception in looking up space point ptr... 0x5ffc2c90, 0x5ffc6730
Caught exception in looking up space point ptr... 0x5ffc6730, 0x5ffc5190
Caught exception in looking up space point ptr... 0x5ffc5190, 0x5ffc6730
Caught exception in looking up space point ptr... 0x5ffc6730, 0x5ffc6600
Caught exception in looking up space point ptr... 0x5ffc6600, 0x5ffc6730
Caught exception in looking up space point ptr... 0x559a8210, 0x5f3edb00
Caught exception in looking up space point ptr... 0x15a97740, 0x559a8210
Caught exception in looking up space point ptr... 0x3c776440, 0x50547980
Caught exception in looking up space point ptr... 0x51573400, 0x3c776440
Caught exception in looking up space point ptr... 0x59a17940, 0x3e3b7930
Caught exception in looking up space point ptr... 0x3e3b7930, 0x61469900
Caught exception in looking up space point ptr... 0x55ac6510, 0x55aafad0
Caught exception in looking up space point ptr... 0x55aafad0, 0x55aafc00
Caught exception in looking up space point ptr... 0x55aafc00, 0x55ac6740
Caught exception in looking up space point ptr... 0x55ac6650, 0x55ac6510
Caught exception in looking up space point ptr... 0x35f722d0, 0x35982ab0
Caught exception in looking up space point ptr... 0x35982ab0, 0x35f722d0
Caught exception in looking up space point ptr... 0x513b7550, 0x513bf230
Caught exception in looking up space point ptr... 0x513bf230, 0x2bfdf5f0
Caught exception in looking up space point ptr... 0x2bfdf5f0, 0x513b71e0
Caught exception in looking up space point ptr... 0x513b71e0, 0x513b5e30
Caught exception in looking up space point ptr... 0x5eea3230, 0x5eea33c0
Caught exception in looking up space point ptr... 0x5eea33c0, 0x5eea3230
Caught exception in looking up space point ptr... 0x2aafa370, 0x221ed530
Caught exception in looking up space point ptr... 0x221ed530, 0x2aafa370
Caught exception in looking up space point ptr... 0x4a636d00, 0x4a636c00
Caught exception in looking up space point ptr... 0x4a636c00, 0x4a62f620
Caught exception in looking up space point ptr... 0x2b499d50, 0x2b49a200
Caught exception in looking up space point ptr... 0x2b49a200, 0x2b499d50
Caught exception in looking up space point ptr... 0x2aae3b30, 0x2aae4660
Caught exception in looking up space point ptr... 0x2aae4660, 0x2aae5ef0
Caught exception in looking up space point ptr... 0x3e2e8a70, 0x15d4e2f0
Caught exception in looking up space point ptr... 0x15d4e2f0, 0x3e2e8a70
Caught exception in looking up space point ptr... 0x428a1c30, 0x50bcb1b0
Caught exception in looking up space point ptr... 0x50bcb1b0, 0x428a0f40
Caught exception in looking up space point ptr... 0x3ff79590, 0x3ff75e30
Caught exception in looking up space point ptr... 0x3ff75e30, 0x3ff78060
Caught exception in looking up space point ptr... 0x2aae3950, 0x2aae5e00
Caught exception in looking up space point ptr... 0x2aae36b0, 0x2aae3950
Caught exception in looking up space point ptr... 0x3ff78470, 0x34c45960
Caught exception in looking up space point ptr... 0x34c45960, 0x3ff78470
Caught exception in looking up space point ptr... 0x3e2d6110, 0x3e2d5fe0
Caught exception in looking up space point ptr... 0x3e2d5fe0, 0x3e2d6110
Caught exception in looking up space point ptr... 0x513be130, 0x5267d750
Caught exception in looking up space point ptr... 0x5267d750, 0x22530320
Caught exception in looking up space point ptr... 0x26b3c920, 0x36735720
Caught exception in looking up space point ptr... 0x36735720, 0x26b3c920
Caught exception in looking up space point ptr... 0x2ac7b170, 0x2ac7aed0
Caught exception in looking up space point ptr... 0x2ac7aed0, 0x2ac7b170
++++>>>> total num hits: 151733, num free: 145841
04-Feb-2026 01:58:43 CET Closed output file "np02vd_raw_run042421_0006_df-s04-d1_dw_0_20260203T133408_reco_stage0_20260204T005843_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 79.2415 100.771 131.457 102.005 15.5377 28
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.0381e-05 8.37978e-05 0.000273133 7.18305e-05 4.68252e-05 28
produce:tpcrawdecoder:PDVDTPCReader 3.61859 4.64058 11.3832 4.27208 1.3865 28
produce:triggerrawdecoder:PDVDTriggerReader4 0.0104926 0.016503 0.0471595 0.012965 0.0085125 28
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000381035 0.000568416 0.00183194 0.000482151 0.000283436 28
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00161258 0.00193287 0.00275349 0.001875 0.000262777 28
produce:beamevent:BeamEvent 5.9031e-05 0.000126668 0.00108077 8.5671e-05 0.000184948 28
produce:pdvddaphne:DAPHNEReaderPDVD 1.9879 2.68716 3.34878 2.64115 0.362878 28
produce:ophit:OpHitFinder 0.0270908 0.0345794 0.04246 0.0344706 0.00494505 28
produce:wclsdatavd:WireCellToolkit 53.7629 62.4216 72.1993 62.7739 4.69294 28
produce:gaushit:GausHitFinder 0.76582 2.11871 10.0713 1.24422 2.16385 28
produce:nhitsfilter:NumberOfHitsFilter 0.000185633 0.000514624 0.00207478 0.000336699 0.000481419 28
produce:reco3d:SpacePointSolver 4.44968 8.13078 16.8599 7.48403 3.17844 23
produce:hitpdune:DisambigFromSpacePoints 0.0600788 0.150388 0.287849 0.141435 0.0648521 23
produce:cluster3d:Cluster3D 1.19481 21.7768 40.4625 29.0786 13.5438 23
[art]:TriggerResults:TriggerResultInserter 2.252e-05 3.18912e-05 8.4581e-05 2.7955e-05 1.18561e-05 28
end_path:out1:RootOutput 3.85e-06 1.26941e-05 0.000147022 6.56e-06 2.63024e-05 28
end_path:out1:RootOutput(write) 3.13879 4.13979 6.50916 4.01224 0.710685 28
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4853.59 MB
Peak resident set size usage (VmHWM): 2862.72 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0006_df-s04-d1_dw_0_20260203T133408_reco_stage0_20260204T005843_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0006_df-s04-d1_dw_0_20260203T133408_reco_stage0_20260204T005843_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0006_df-s04-d1_dw_0_20260203T133408_reco_stage0_20260204T005843_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163861.0,
"core.end_time": 1770166725.0,
"core.events": [
977,
983,
989,
995,
1001,
1007,
1013,
1019,
1025,
1031,
1037,
1043,
1049,
1055,
1061,
1067,
1073,
1079,
1085,
1091,
1097,
1103,
1109,
1115,
1121,
1127,
1133,
1139
],
"core.event_count": 28,
"core.first_event_number": 977,
"core.last_event_number": 1139,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0006_df-s04-d1_dw_0_20260203T133408.hdf5"
}
]
} 