Jobsub ID 297921.103@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.103@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce507 |
| Last heartbeat | 2026-02-04 00:41:26 |
| From worker node | Hostname | b9p35p0005.cern.ch |
| cpuinfo | AMD EPYC 9655P 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:55:25 |
| Input files | vd-protodune:np02vd_raw_run042433_0590_df-s02-d0_dw_0_20260203T222622.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 43m (2630s) |
| CPU time | 42m (2534s = 96%) |
| Max RSS bytes | 4688044032 (4470 MiB) |
| Outputting started | 2026-02-04 00:39:17 |
| Output files | |
| Finished | 2026-02-04 00:41:26 |
| Saved logs | justin-logs:297921.103-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
up space point ptr... 0x393d97f0, 0x393d94d0
Caught exception in looking up space point ptr... 0x644ea860, 0x644ec370
Caught exception in looking up space point ptr... 0x644ec370, 0x644ea860
Caught exception in looking up space point ptr... 0x45285ee0, 0x38ce12b0
Caught exception in looking up space point ptr... 0x38ce12b0, 0x18a1a190
Caught exception in looking up space point ptr... 0x4d206290, 0x4d206420
Caught exception in looking up space point ptr... 0x4d206420, 0x4d206290
Caught exception in looking up space point ptr... 0x6629a430, 0x6629a600
Caught exception in looking up space point ptr... 0x662997f0, 0x658b8a70
Caught exception in looking up space point ptr... 0x658b8a70, 0x658b8cc0
Caught exception in looking up space point ptr... 0x658b8cc0, 0x662987c0
Caught exception in looking up space point ptr... 0x662987c0, 0x6629a430
Caught exception in looking up space point ptr... 0x86d8f40, 0x86d8520
Caught exception in looking up space point ptr... 0x86d8520, 0x86d86b0
Caught exception in looking up space point ptr... 0x65a11910, 0x9c495e0
Caught exception in looking up space point ptr... 0x7bdbf80, 0x65a11910
Caught exception in looking up space point ptr... 0x97f6bb0, 0x60d21980
Caught exception in looking up space point ptr... 0x60d21980, 0x60d1f7f0
Caught exception in looking up space point ptr... 0x65095790, 0x3e1c3be0
Caught exception in looking up space point ptr... 0x3e1c3be0, 0x3e1c3f00
Caught exception in looking up space point ptr... 0x752e820, 0x5c169bd0
Caught exception in looking up space point ptr... 0x5c169bd0, 0x483fff50
Caught exception in looking up space point ptr... 0x648975e0, 0x79c6e830
Caught exception in looking up space point ptr... 0x79c6e830, 0x7f92790
Caught exception in looking up space point ptr... 0x7f92790, 0x71fe840
Caught exception in looking up space point ptr... 0x436979d0, 0x4e053c0
Caught exception in looking up space point ptr... 0x4e053c0, 0x228d9660
Caught exception in looking up space point ptr... 0x3a328200, 0x3a328550
Caught exception in looking up space point ptr... 0x3a328550, 0x3a328200
Caught exception in looking up space point ptr... 0x44e100e0, 0x471c4d20
Caught exception in looking up space point ptr... 0x471c4d20, 0x74e9c4c0
Caught exception in looking up space point ptr... 0x3a4bcb40, 0x70581c20
Caught exception in looking up space point ptr... 0x70581c20, 0x3a4bcb40
Caught exception in looking up space point ptr... 0x38f94af0, 0x93d7360
Caught exception in looking up space point ptr... 0x93d7360, 0x38f94af0
Caught exception in looking up space point ptr... 0x65a29c80, 0x65a29db0
Caught exception in looking up space point ptr... 0x65a29db0, 0x65a2a990
Caught exception in looking up space point ptr... 0x5ccb1c90, 0x443d0580
Caught exception in looking up space point ptr... 0x443d0580, 0x5ccb1c90
Caught exception in looking up space point ptr... 0x63f88fd0, 0x63f89160
Caught exception in looking up space point ptr... 0x63f89160, 0x63f88fd0
Caught exception in looking up space point ptr... 0x64d41300, 0x4bd86590
Caught exception in looking up space point ptr... 0x4bd86590, 0x64d41300
Caught exception in looking up space point ptr... 0x470aa380, 0x9ff1670
Caught exception in looking up space point ptr... 0x9ff1670, 0x470aa380
Caught exception in looking up space point ptr... 0x44d292a0, 0x44d29470
Caught exception in looking up space point ptr... 0x44d29470, 0x44d29a20
Caught exception in looking up space point ptr... 0x37257140, 0x38c65390
Caught exception in looking up space point ptr... 0x38c65390, 0x640b2d40
Caught exception in looking up space point ptr... 0x65d5c030, 0x64c28280
Caught exception in looking up space point ptr... 0x64c28280, 0x65d5c030
Caught exception in looking up space point ptr... 0xd4a85d0, 0x79705a70
Caught exception in looking up space point ptr... 0x79705a70, 0xd4a7f20
Caught exception in looking up space point ptr... 0x38f08730, 0x660105d0
Caught exception in looking up space point ptr... 0x660105d0, 0x12ca5030
Caught exception in looking up space point ptr... 0x63649100, 0x3957aa00
Caught exception in looking up space point ptr... 0x3957aa00, 0x63649100
Caught exception in looking up space point ptr... 0x3f2f43f0, 0x77312160
Caught exception in looking up space point ptr... 0x77312160, 0x3f2f43f0
Caught exception in looking up space point ptr... 0x4527ff40, 0x4527fb00
Caught exception in looking up space point ptr... 0x4527fb00, 0x4527fca0
Caught exception in looking up space point ptr... 0x5c5a69d0, 0xd364ef0
Caught exception in looking up space point ptr... 0xd364ef0, 0x5c5a69d0
Caught exception in looking up space point ptr... 0x3722d9e0, 0x38638bd0
Caught exception in looking up space point ptr... 0x38638bd0, 0x65769170
Caught exception in looking up space point ptr... 0x5d7719b0, 0x41bd4f30
Caught exception in looking up space point ptr... 0x41bd4f30, 0x5d7719b0
++++>>>> total num hits: 87484, num free: 84681
04-Feb-2026 01:39:11 CET Closed output file "np02vd_raw_run042433_0590_df-s02-d0_dw_0_20260203T222622_reco_stage0_20260204T003911_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 94.3711 135.792 350.919 115.182 61.3207 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.784e-05 7.35174e-05 0.0001411 7.085e-05 1.74821e-05 19
produce:tpcrawdecoder:PDVDTPCReader 6.15549 7.09088 9.49794 7.02167 0.682793 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.00793128 0.0280486 0.0766731 0.0196909 0.0186156 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000305011 0.00210555 0.00938876 0.000628721 0.00282541 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00027438 0.00125136 0.0109147 0.000498871 0.00244418 19
produce:beamevent:BeamEvent 5.445e-05 0.000114224 0.000782851 7.605e-05 0.00015803 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.69472 2.13226 2.77873 2.1467 0.219982 19
produce:ophit:OpHitFinder 0.0238468 0.0332068 0.0418894 0.0341301 0.00500456 19
produce:wclsdatavd:WireCellToolkit 71.3571 80.2006 88.7095 79.7755 5.04692 19
produce:gaushit:GausHitFinder 0.605278 1.57629 8.81172 0.952997 1.84635 19
produce:nhitsfilter:NumberOfHitsFilter 0.00017158 0.000256884 0.00065187 0.00021546 0.000111212 19
produce:reco3d:SpacePointSolver 8.89344 17.7379 37.8834 15.6774 6.6145 19
produce:hitpdune:DisambigFromSpacePoints 0.0631242 0.198749 0.627901 0.159901 0.151623 19
produce:cluster3d:Cluster3D 0.804541 21.4879 202.881 1.82758 50.3944 19
[art]:TriggerResults:TriggerResultInserter 2.698e-05 3.38716e-05 8.754e-05 3.006e-05 1.30581e-05 19
end_path:out1:RootOutput 4.64e-06 6.86053e-06 1.891e-05 5.59e-06 3.83902e-06 19
end_path:out1:RootOutput(write) 3.51665 5.26218 10.4923 4.63885 1.92672 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6808.24 MB
Peak resident set size usage (VmHWM): 4688.04 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0590_df-s02-d0_dw_0_20260203T222622_reco_stage0_20260204T003911_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0590_df-s02-d0_dw_0_20260203T222622_reco_stage0_20260204T003911_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0590_df-s02-d0_dw_0_20260203T222622_reco_stage0_20260204T003911_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162933.0,
"core.end_time": 1770165552.0,
"core.events": [
67266,
67272,
67278,
67284,
67290,
67296,
67302,
67308,
67314,
67320,
67326,
67332,
67338,
67344,
67350,
67356,
67362,
67368,
67374
],
"core.event_count": 19,
"core.first_event_number": 67266,
"core.last_event_number": 67374,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0590_df-s02-d0_dw_0_20260203T222622.hdf5"
}
]
} 