Jobsub ID 297920.157@dunegpschedd02.fnal.gov
| Jobsub ID | 297920.157@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:27 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce511 |
| Last heartbeat | 2026-02-04 00:31:15 |
| From worker node | Hostname | b9p02p3983.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:43:08 |
| Input files | vd-protodune:np02vd_raw_run042433_0153_df-s02-d0_dw_0_20260203T194015.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 45m (2751s) |
| CPU time | 43m (2636s = 95%) |
| Max RSS bytes | 3395444736 (3238 MiB) |
| Outputting started | 2026-02-04 00:29:00 |
| Output files | |
| Finished | 2026-02-04 00:31:15 |
| Saved logs | justin-logs:297920.157-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
p space point ptr... 0x63bcf010, 0x63bceb60
Caught exception in looking up space point ptr... 0x63bceb60, 0x63bcf010
Caught exception in looking up space point ptr... 0xb06aca0, 0xb06dac0
Caught exception in looking up space point ptr... 0xb06dac0, 0xb06aca0
Caught exception in looking up space point ptr... 0x36d520a0, 0x36d51c50
Caught exception in looking up space point ptr... 0x36d51c50, 0x36d520a0
Caught exception in looking up space point ptr... 0x191a1050, 0x9814e80
Caught exception in looking up space point ptr... 0x9814e80, 0x191a1050
Caught exception in looking up space point ptr... 0x2d28c0f0, 0x50efaed0
Caught exception in looking up space point ptr... 0x50efaed0, 0x41503d90
Caught exception in looking up space point ptr... 0x2fe81800, 0x33971820
Caught exception in looking up space point ptr... 0x39008420, 0x2fe81800
Caught exception in looking up space point ptr... 0x18abe1f0, 0x35623e60
Caught exception in looking up space point ptr... 0x35623e60, 0x3af69cd0
Caught exception in looking up space point ptr... 0x3b407370, 0x1a687a80
Caught exception in looking up space point ptr... 0x1a687a80, 0x3b407370
Caught exception in looking up space point ptr... 0x3b407370, 0x52404470
Caught exception in looking up space point ptr... 0x52404470, 0x3b407370
Caught exception in looking up space point ptr... 0x37eb8660, 0x4cfa2e40
Caught exception in looking up space point ptr... 0x4cfa2e40, 0x88344c0
Caught exception in looking up space point ptr... 0x6f96e350, 0x6f96dae0
Caught exception in looking up space point ptr... 0x6f96dae0, 0x381282e0
Caught exception in looking up space point ptr... 0x381282e0, 0x38128090
Caught exception in looking up space point ptr... 0x59b509a0, 0x59b50680
Caught exception in looking up space point ptr... 0x59b50680, 0x59b509a0
Caught exception in looking up space point ptr... 0x59b509a0, 0x59b4cdd0
Caught exception in looking up space point ptr... 0x59b4cdd0, 0x59b509a0
Caught exception in looking up space point ptr... 0x6afe6c50, 0x39208ef0
Caught exception in looking up space point ptr... 0x39209140, 0x6afe6c50
Caught exception in looking up space point ptr... 0x3a9ca850, 0x3a9ca460
Caught exception in looking up space point ptr... 0x3a9ca460, 0x3a9ca700
Caught exception in looking up space point ptr... 0xe7f3400, 0xe7f3270
Caught exception in looking up space point ptr... 0xe7f3270, 0xe7f3400
Caught exception in looking up space point ptr... 0x633f5ab0, 0x5f426520
Caught exception in looking up space point ptr... 0x5f426520, 0x6afe6fd0
Caught exception in looking up space point ptr... 0x49ed6290, 0xdae64b0
Caught exception in looking up space point ptr... 0xdae64b0, 0x35926250
Caught exception in looking up space point ptr... 0x39a37da0, 0x6ebf82b0
Caught exception in looking up space point ptr... 0x6ebf82b0, 0x3affd370
Caught exception in looking up space point ptr... 0x3affd370, 0x3affd4c0
Caught exception in looking up space point ptr... 0x3affd4c0, 0x3affdfb0
Caught exception in looking up space point ptr... 0x61b9f7a0, 0x42d541e0
Caught exception in looking up space point ptr... 0x42d541e0, 0x61b9f7a0
Caught exception in looking up space point ptr... 0x4e942c00, 0x5eca5760
Caught exception in looking up space point ptr... 0x5eca5760, 0xa3edf80
Caught exception in looking up space point ptr... 0xd669100, 0x6eea0590
Caught exception in looking up space point ptr... 0x6eea0590, 0xd669100
Caught exception in looking up space point ptr... 0x6208a910, 0x6208a780
Caught exception in looking up space point ptr... 0x6208a780, 0x6208a910
Caught exception in looking up space point ptr... 0x1a8517d0, 0x38d02cf0
Caught exception in looking up space point ptr... 0x38d02cf0, 0x62dd38f0
Caught exception in looking up space point ptr... 0x3af1bf40, 0x1593ba60
Caught exception in looking up space point ptr... 0x1593ba60, 0x3c1f4630
Caught exception in looking up space point ptr... 0x59b4e220, 0x59b4e380
Caught exception in looking up space point ptr... 0x59b4e380, 0x59b4e220
Caught exception in looking up space point ptr... 0x4d31f9a0, 0x57068410
Caught exception in looking up space point ptr... 0x57068410, 0x4d31e510
Caught exception in looking up space point ptr... 0x6285c630, 0x6285c930
Caught exception in looking up space point ptr... 0x6285c930, 0x52d75580
Caught exception in looking up space point ptr... 0x38bff780, 0x38bfef60
Caught exception in looking up space point ptr... 0x38bfef60, 0x38bff780
Caught exception in looking up space point ptr... 0x35ea0eb0, 0x52dd6ce0
Caught exception in looking up space point ptr... 0x52dd6ce0, 0x35ea0eb0
Caught exception in looking up space point ptr... 0xb190940, 0x378942b0
Caught exception in looking up space point ptr... 0x378942b0, 0x679869e0
Caught exception in looking up space point ptr... 0xee43c50, 0x47d08d30
Caught exception in looking up space point ptr... 0x47d08d30, 0x3b435900
++++>>>> total num hits: 56769, num free: 54606
04-Feb-2026 01:28:51 CET Closed output file "np02vd_raw_run042433_0153_df-s02-d0_dw_0_20260203T194015_reco_stage0_20260204T002851_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 123.562 141.914 158.332 143.692 9.21213 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.869e-05 0.000115122 0.000376711 8.181e-05 8.21031e-05 19
produce:tpcrawdecoder:PDVDTPCReader 4.22236 7.56114 19.5149 7.29332 3.21888 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0127977 0.0608048 0.678345 0.017094 0.148681 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000434292 0.000607817 0.000822421 0.000603951 9.32603e-05 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000423941 0.000590729 0.000920302 0.00057611 0.000109143 19
produce:beamevent:BeamEvent 6.38e-05 0.000153524 0.000973444 0.00011125 0.000195315 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.3629 2.76649 3.13627 2.68271 0.207982 19
produce:ophit:OpHitFinder 0.0252026 0.0361349 0.0445226 0.0361956 0.0051087 19
produce:wclsdatavd:WireCellToolkit 95.9874 107.974 124.636 108.62 7.55911 19
produce:gaushit:GausHitFinder 0.733685 1.12897 1.70511 1.0629 0.290484 19
produce:nhitsfilter:NumberOfHitsFilter 0.000190771 0.000323156 0.000665702 0.00029324 0.000102576 19
produce:reco3d:SpacePointSolver 6.98636 14.6027 26.2617 14.4964 4.25568 19
produce:hitpdune:DisambigFromSpacePoints 0.0737713 0.153748 0.233822 0.15795 0.0416967 19
produce:cluster3d:Cluster3D 1.1215 2.26372 3.75426 2.34073 0.733177 19
[art]:TriggerResults:TriggerResultInserter 2.223e-05 3.66933e-05 0.00010435 3.257e-05 1.66614e-05 19
end_path:out1:RootOutput 3.63e-06 7.18105e-06 2.551e-05 6.54e-06 4.63348e-06 19
end_path:out1:RootOutput(write) 4.36822 5.32868 6.65549 5.25723 0.586092 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5377.8 MB
Peak resident set size usage (VmHWM): 3395.44 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0153_df-s02-d0_dw_0_20260203T194015_reco_stage0_20260204T002851_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0153_df-s02-d0_dw_0_20260203T194015_reco_stage0_20260204T002851_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0153_df-s02-d0_dw_0_20260203T194015_reco_stage0_20260204T002851_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162197.0,
"core.end_time": 1770164933.0,
"core.events": [
17448,
17454,
17460,
17466,
17472,
17478,
17484,
17490,
17496,
17502,
17508,
17514,
17520,
17526,
17532,
17538,
17544,
17550,
17556
],
"core.event_count": 19,
"core.first_event_number": 17448,
"core.last_event_number": 17556,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0153_df-s02-d0_dw_0_20260203T194015.hdf5"
}
]
} 