Jobsub ID 303651.139@dunegpschedd01.fnal.gov
| Jobsub ID | 303651.139@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:50:24 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:58:24 |
| From worker node | Hostname | dune002-1602648.0-lcg2557.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:23:22 |
| Input files | vd-protodune:np02vd_raw_run042421_0007_df-s02-d1_dw_0_20260203T133442.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (9087s) |
| CPU time | 2h (8546s = 94%) |
| Max RSS bytes | 9910759424 (9451 MiB) |
| Outputting started | 2026-02-04 01:55:01 |
| Output files | |
| Finished | 2026-02-04 01:58:24 |
| Saved logs | justin-logs:303651.139-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e5740, 0x926a4870
Caught exception in looking up space point ptr... 0xf42ebca0, 0x5e2f7f00
Caught exception in looking up space point ptr... 0xf65be890, 0x3d0c7f20
Caught exception in looking up space point ptr... 0x3d0c7f20, 0x3d2a22d0
Caught exception in looking up space point ptr... 0x3d2a22d0, 0x3d0c7a00
Caught exception in looking up space point ptr... 0x3d0c7a00, 0x3d0c7c90
Caught exception in looking up space point ptr... 0xb11e90d0, 0xb1213350
Caught exception in looking up space point ptr... 0xb1213350, 0xb12135e0
Caught exception in looking up space point ptr... 0x1e765720, 0xdfb7a800
Caught exception in looking up space point ptr... 0x1e7381d0, 0x1e765720
Caught exception in looking up space point ptr... 0x42dddb40, 0x42dddd90
Caught exception in looking up space point ptr... 0x42ddd8f0, 0x42dddb40
Caught exception in looking up space point ptr... 0x6cda7320, 0x6cda7570
Caught exception in looking up space point ptr... 0x1151e7480, 0x6cda7320
Caught exception in looking up space point ptr... 0x600c4fc0, 0x47852e30
Caught exception in looking up space point ptr... 0x47852e30, 0x478530c0
Caught exception in looking up space point ptr... 0xe28be6f0, 0xe280bf80
Caught exception in looking up space point ptr... 0xe280bf80, 0xe28be6f0
Caught exception in looking up space point ptr... 0xe28d3f20, 0xe28076d0
Caught exception in looking up space point ptr... 0xe28076d0, 0xe28d3f20
Caught exception in looking up space point ptr... 0x3ccb5a80, 0xdfb02b50
Caught exception in looking up space point ptr... 0xdfb02b50, 0xdfad1d80
Caught exception in looking up space point ptr... 0x29cceca0, 0x42009db0
Caught exception in looking up space point ptr... 0xe24a8460, 0x29cceca0
Caught exception in looking up space point ptr... 0xf6451700, 0xf648c780
Caught exception in looking up space point ptr... 0xf647efa0, 0xf6451700
Caught exception in looking up space point ptr... 0x31389ec0, 0x5da518b0
Caught exception in looking up space point ptr... 0x5da518b0, 0x5da487b0
Caught exception in looking up space point ptr... 0x5da487b0, 0x5da35bd0
Caught exception in looking up space point ptr... 0xb431c5d0, 0xb431caf0
Caught exception in looking up space point ptr... 0xb431caf0, 0xb431c860
Caught exception in looking up space point ptr... 0x5fb0e9d0, 0x18e7d0d0
Caught exception in looking up space point ptr... 0x18e7d0d0, 0x5fb0ec60
Caught exception in looking up space point ptr... 0x3c45e870, 0x3c45e350
Caught exception in looking up space point ptr... 0x3c45e070, 0x3c45e870
Caught exception in looking up space point ptr... 0x708eb970, 0x7096d1f0
Caught exception in looking up space point ptr... 0x7096d1f0, 0x7089e420
Caught exception in looking up space point ptr... 0x308bff90, 0x3031adb0
Caught exception in looking up space point ptr... 0x3031adb0, 0x3ec66db0
Caught exception in looking up space point ptr... 0x68b4e9a0, 0x30808870
Caught exception in looking up space point ptr... 0x30808870, 0x308f6f40
Caught exception in looking up space point ptr... 0xb4264780, 0xb43b6e00
Caught exception in looking up space point ptr... 0xb43b6e00, 0xb43ba730
Caught exception in looking up space point ptr... 0xceccb670, 0x6f307810
Caught exception in looking up space point ptr... 0x6f307810, 0x6f6dfa90
Caught exception in looking up space point ptr... 0x59a75940, 0x59a6fa10
Caught exception in looking up space point ptr... 0x59a6fa10, 0x59a75940
Caught exception in looking up space point ptr... 0xac281570, 0xac281050
Caught exception in looking up space point ptr... 0xac280d70, 0xac281570
Caught exception in looking up space point ptr... 0xac28e170, 0xac28dc50
Caught exception in looking up space point ptr... 0xac28d970, 0xac28e170
Caught exception in looking up space point ptr... 0xc1d5f980, 0x6f35d5f0
Caught exception in looking up space point ptr... 0x6f35d5f0, 0x70041d00
Caught exception in looking up space point ptr... 0x70041d00, 0x30107130
Caught exception in looking up space point ptr... 0x2c3d18c0, 0x2c359de0
Caught exception in looking up space point ptr... 0x2c359b40, 0x2c3d18c0
Caught exception in looking up space point ptr... 0xac2531d0, 0xac252f40
Caught exception in looking up space point ptr... 0xac252f40, 0xac253460
Caught exception in looking up space point ptr... 0x1f242840, 0x1f243ac0
Caught exception in looking up space point ptr... 0x1f243180, 0x1f242840
Caught exception in looking up space point ptr... 0x2eacee40, 0x2eacf110
Caught exception in looking up space point ptr... 0x2eacf110, 0x41aeb060
Caught exception in looking up space point ptr... 0x59a711f0, 0x59a71010
Caught exception in looking up space point ptr... 0x59a71010, 0x59a71380
Caught exception in looking up space point ptr... 0x2e999040, 0x2e998da0
Caught exception in looking up space point ptr... 0x2e998da0, 0x2e998ca0
++++>>>> total num hits: 2340351, num free: 2256004
04-Feb-2026 01:54:36 UTC Closed output file "np02vd_raw_run042421_0007_df-s02-d1_dw_0_20260203T133442_reco_stage0_20260204T015436_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 145.141 331.438 1855.11 156.921 441.766 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8631e-05 0.000147396 0.000402135 0.000121222 6.38627e-05 27
produce:tpcrawdecoder:PDVDTPCReader 14.5741 15.3826 16.1448 15.3668 0.409912 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.686157 0.706627 0.721712 0.711581 0.0116028 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229749 0.0233563 0.0244632 0.0232962 0.000253486 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.114139 0.117625 0.137734 0.114789 0.00701454 27
produce:beamevent:BeamEvent 0.000153142 0.000274761 0.00210926 0.000198162 0.000362196 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.9083 4.42899 5.56321 4.33373 0.396658 27
produce:ophit:OpHitFinder 0.0377933 0.0541027 0.0662611 0.0560786 0.00768295 27
produce:wclsdatavd:WireCellToolkit 103.432 111.319 129.982 110.211 6.08717 27
produce:gaushit:GausHitFinder 0.954493 3.71301 22.7144 1.54666 5.57302 27
produce:nhitsfilter:NumberOfHitsFilter 0.000287993 0.000668636 0.00192121 0.000488155 0.000439084 27
produce:reco3d:SpacePointSolver 9.02724 28.449 127.284 16.274 33.3841 27
produce:hitpdune:DisambigFromSpacePoints 0.10473 1.04448 8.35992 0.160195 2.08687 27
produce:cluster3d:Cluster3D 1.23404 157.071 1565.94 2.73969 393.929 27
[art]:TriggerResults:TriggerResultInserter 2.972e-05 7.26911e-05 0.000581717 4.0581e-05 0.000102977 27
end_path:out1:RootOutput 5.23e-06 2.92399e-05 0.000447745 1.135e-05 8.24307e-05 27
end_path:out1:RootOutput(write) 4.82954 9.06987 31.7338 5.93943 7.52059 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 12589.7 MB
Peak resident set size usage (VmHWM): 9910.76 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0007_df-s02-d1_dw_0_20260203T133442_reco_stage0_20260204T015436_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0007_df-s02-d1_dw_0_20260203T133442_reco_stage0_20260204T015436_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0007_df-s02-d1_dw_0_20260203T133442_reco_stage0_20260204T015436_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161020.0,
"core.end_time": 1770170080.0,
"core.events": [
1141,
1147,
1153,
1159,
1165,
1171,
1177,
1183,
1189,
1195,
1201,
1207,
1213,
1219,
1225,
1231,
1237,
1243,
1249,
1255,
1261,
1267,
1273,
1279,
1285,
1291,
1297
],
"core.event_count": 27,
"core.first_event_number": 1141,
"core.last_event_number": 1297,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0007_df-s02-d1_dw_0_20260203T133442.hdf5"
}
]
} 