Jobsub ID 303653.25@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.25@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce509 |
| Last heartbeat | 2026-02-04 00:49:38 |
| From worker node | Hostname | b9p04p3844.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:37:25 |
| Input files | vd-protodune:np02vd_raw_run042421_0069_df-s02-d0_dw_0_20260203T140821.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4183s) |
| CPU time | 1h (3969s = 94%) |
| Max RSS bytes | 2618650624 (2497 MiB) |
| Outputting started | 2026-02-04 00:47:11 |
| Output files | |
| Finished | 2026-02-04 00:49:38 |
| Saved logs | justin-logs:303653.25-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
68f34a0
Caught exception in looking up space point ptr... 0x268f34a0, 0x564b22b0
Caught exception in looking up space point ptr... 0x2af56560, 0x3d90ea90
Caught exception in looking up space point ptr... 0x3d90ea90, 0x3d90eb30
Caught exception in looking up space point ptr... 0x3d90eb30, 0x34dac6c0
Caught exception in looking up space point ptr... 0x34dac6c0, 0x22096100
Caught exception in looking up space point ptr... 0x34fcab40, 0x34fc7780
Caught exception in looking up space point ptr... 0x34fca520, 0x34fcab40
Caught exception in looking up space point ptr... 0x2c0cbf90, 0x3ebe2de0
Caught exception in looking up space point ptr... 0x3ebe2de0, 0x514c2000
Caught exception in looking up space point ptr... 0x15080b10, 0x519fd910
Caught exception in looking up space point ptr... 0x519fd910, 0xd43b460
Caught exception in looking up space point ptr... 0x2ae7c3f0, 0x3c47b730
Caught exception in looking up space point ptr... 0x3c47b730, 0x2ae7c3f0
Caught exception in looking up space point ptr... 0x339b4e80, 0x3e8e3530
Caught exception in looking up space point ptr... 0x3e8e3530, 0x64ecc3c0
Caught exception in looking up space point ptr... 0x3bf2dae0, 0x3bf265c0
Caught exception in looking up space point ptr... 0x3bf265c0, 0x3bf2dae0
Caught exception in looking up space point ptr... 0x21e727a0, 0x15e31b20
Caught exception in looking up space point ptr... 0x15e31b20, 0x21e727a0
Caught exception in looking up space point ptr... 0x28da67e0, 0x10c412c0
Caught exception in looking up space point ptr... 0x10c412c0, 0x54f71a50
Caught exception in looking up space point ptr... 0x42e134f0, 0x42e13360
Caught exception in looking up space point ptr... 0x42e131d0, 0x42e134f0
Caught exception in looking up space point ptr... 0x30427ec0, 0x21ba0040
Caught exception in looking up space point ptr... 0x35944810, 0x30427ec0
Caught exception in looking up space point ptr... 0xf438580, 0xf4383f0
Caught exception in looking up space point ptr... 0x2d3a2920, 0xf438580
Caught exception in looking up space point ptr... 0x592c62c0, 0x300fcf00
Caught exception in looking up space point ptr... 0x300fcf00, 0x2a6d5810
Caught exception in looking up space point ptr... 0x21fef690, 0x249ea410
Caught exception in looking up space point ptr... 0x249ea410, 0x5475b2b0
Caught exception in looking up space point ptr... 0x5475b2b0, 0x3c562560
Caught exception in looking up space point ptr... 0x3c562560, 0x21fef690
Caught exception in looking up space point ptr... 0x5e6823f0, 0x126e30a0
Caught exception in looking up space point ptr... 0x126e30a0, 0x5e6823f0
Caught exception in looking up space point ptr... 0x46590480, 0x14cfea10
Caught exception in looking up space point ptr... 0x14cfea10, 0x46590480
Caught exception in looking up space point ptr... 0x22d65a20, 0x4d5fbfd0
Caught exception in looking up space point ptr... 0x4d5fbfd0, 0x6091f2e0
Caught exception in looking up space point ptr... 0x15a37420, 0x15a32de0
Caught exception in looking up space point ptr... 0x15a32de0, 0x15a360e0
Caught exception in looking up space point ptr... 0x465b1590, 0x4d3b08d0
Caught exception in looking up space point ptr... 0x4d3b08d0, 0x465b1590
Caught exception in looking up space point ptr... 0xd384b80, 0x3a4cee00
Caught exception in looking up space point ptr... 0x3a4cee00, 0xd384b80
Caught exception in looking up space point ptr... 0x1538f560, 0x386979f0
Caught exception in looking up space point ptr... 0x386979f0, 0x2c0fab30
Caught exception in looking up space point ptr... 0x64df4930, 0x2a7a6310
Caught exception in looking up space point ptr... 0x2a7a6310, 0x64df4930
Caught exception in looking up space point ptr... 0x3cab5ca0, 0x21689460
Caught exception in looking up space point ptr... 0x3771f030, 0x3cab5ca0
Caught exception in looking up space point ptr... 0x43e9a060, 0x43e99ee0
Caught exception in looking up space point ptr... 0x43e99ee0, 0x43e9a2c0
Caught exception in looking up space point ptr... 0xa75d5e0, 0xa756a90
Caught exception in looking up space point ptr... 0xa756a90, 0xa755940
Caught exception in looking up space point ptr... 0x29711580, 0x35644230
Caught exception in looking up space point ptr... 0x35644230, 0x29711580
Caught exception in looking up space point ptr... 0xa5b13a0, 0xa5b1290
Caught exception in looking up space point ptr... 0xa5b1290, 0xa5b13a0
Caught exception in looking up space point ptr... 0x5924b740, 0x590f35b0
Caught exception in looking up space point ptr... 0x590f35b0, 0x5924b740
Caught exception in looking up space point ptr... 0x5924b740, 0x4d5fa950
Caught exception in looking up space point ptr... 0x4d5fa950, 0x5924b740
Caught exception in looking up space point ptr... 0x50039b30, 0x28e8e6a0
Caught exception in looking up space point ptr... 0x28e8e6a0, 0x50039b30
++++>>>> total num hits: 42168, num free: 40875
04-Feb-2026 01:46:59 CET Closed output file "np02vd_raw_run042421_0069_df-s02-d0_dw_0_20260203T140821_reco_stage0_20260204T004659_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 114.724 151.561 179.402 152.573 16.9542 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.745e-05 0.000104424 0.000352635 8.6031e-05 6.00649e-05 27
produce:tpcrawdecoder:PDVDTPCReader 5.03674 7.3572 9.44231 7.41497 1.17532 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.011946 0.0264152 0.0635761 0.0213408 0.0141775 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000518148 0.000873601 0.00254678 0.000739011 0.000425345 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00180638 0.00338079 0.00697738 0.00304464 0.00111338 27
produce:beamevent:BeamEvent 7.8291e-05 0.000204852 0.00192596 0.000118731 0.000343281 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.1213 4.62297 6.09246 4.60484 0.733634 27
produce:ophit:OpHitFinder 0.0362735 0.0811244 0.283366 0.0595309 0.0508832 27
produce:wclsdatavd:WireCellToolkit 78.6589 107.917 130.812 109.902 12.7905 27
produce:gaushit:GausHitFinder 0.862913 1.68853 3.04506 1.59692 0.561045 27
produce:nhitsfilter:NumberOfHitsFilter 0.000209474 0.000340892 0.000723371 0.000319005 0.000116343 27
produce:reco3d:SpacePointSolver 8.83482 18.9644 30.8897 18.4608 5.23446 27
produce:hitpdune:DisambigFromSpacePoints 0.0693182 0.21074 0.693283 0.162882 0.15331 27
produce:cluster3d:Cluster3D 1.09406 3.99948 20.7047 2.96242 3.59445 27
[art]:TriggerResults:TriggerResultInserter 2.2441e-05 3.99091e-05 0.000155452 3.4231e-05 2.45073e-05 27
end_path:out1:RootOutput 4.43e-06 9.52137e-06 4.748e-05 7.3e-06 7.78303e-06 27
end_path:out1:RootOutput(write) 4.66394 6.65346 9.05542 6.55925 1.0353 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4665.32 MB
Peak resident set size usage (VmHWM): 2618.65 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0069_df-s02-d0_dw_0_20260203T140821_reco_stage0_20260204T004659_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0069_df-s02-d0_dw_0_20260203T140821_reco_stage0_20260204T004659_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0069_df-s02-d0_dw_0_20260203T140821_reco_stage0_20260204T004659_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161857.0,
"core.end_time": 1770166022.0,
"core.events": [
11238,
11244,
11250,
11256,
11262,
11268,
11274,
11280,
11286,
11292,
11298,
11304,
11310,
11316,
11322,
11328,
11334,
11340,
11346,
11352,
11358,
11364,
11370,
11376,
11382,
11388,
11394
],
"core.event_count": 27,
"core.first_event_number": 11238,
"core.last_event_number": 11394,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0069_df-s02-d0_dw_0_20260203T140821.hdf5"
}
]
} 