Jobsub ID 297923.109@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.109@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_QMUL |
| Entry | DUNE_UK_London_QMUL_arcce03 |
| Last heartbeat | 2026-02-04 02:21:21 |
| From worker node | Hostname | cn541.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:02:44 |
| Input files | vd-protodune:np02vd_raw_run042433_0460_df-s03-d1_dw_0_20260203T213657.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8178s) |
| CPU time | 1h (4215s = 51%) |
| Max RSS bytes | 3335401472 (3180 MiB) |
| Outputting started | 2026-02-04 02:19:04 |
| Output files | |
| Finished | 2026-02-04 02:21:21 |
| Saved logs | justin-logs:297923.109-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ptr... 0x3815b7d0, 0x3815b5f0
Caught exception in looking up space point ptr... 0x3815b5f0, 0x3815b7d0
Caught exception in looking up space point ptr... 0x7202d240, 0x6c43f380
Caught exception in looking up space point ptr... 0x6c43f380, 0x7202d240
Caught exception in looking up space point ptr... 0x63f8c120, 0x63f88dd0
Caught exception in looking up space point ptr... 0x63f88dd0, 0x6401f7c0
Caught exception in looking up space point ptr... 0x43a14b40, 0x3db87c80
Caught exception in looking up space point ptr... 0x3db87c80, 0x59bc3430
Caught exception in looking up space point ptr... 0x29fe2870, 0x29fe0760
Caught exception in looking up space point ptr... 0x29fdfc70, 0x29fe2870
Caught exception in looking up space point ptr... 0x28f7c410, 0x28f7c540
Caught exception in looking up space point ptr... 0x28f7c540, 0x28f7c410
Caught exception in looking up space point ptr... 0x36601c50, 0x4d08d290
Caught exception in looking up space point ptr... 0x4d08d290, 0x36601c50
Caught exception in looking up space point ptr... 0x306fbb80, 0x306fb980
Caught exception in looking up space point ptr... 0x306fb980, 0x306fbb80
Caught exception in looking up space point ptr... 0x29fbf7f0, 0x29fbf6c0
Caught exception in looking up space point ptr... 0x29fc1860, 0x29fbf7f0
Caught exception in looking up space point ptr... 0x19ab0df0, 0x542d6df0
Caught exception in looking up space point ptr... 0x542dd4e0, 0x19ab0df0
Caught exception in looking up space point ptr... 0x4797ae10, 0x1572f2a0
Caught exception in looking up space point ptr... 0x3aabe210, 0x4797ae10
Caught exception in looking up space point ptr... 0x167331d0, 0xd8e64b0
Caught exception in looking up space point ptr... 0xd8e64b0, 0x167331d0
Caught exception in looking up space point ptr... 0x118aa6f0, 0x118aa880
Caught exception in looking up space point ptr... 0x118aa880, 0x118aaa10
Caught exception in looking up space point ptr... 0x118aaa10, 0x118b3fb0
Caught exception in looking up space point ptr... 0x118b3fb0, 0x118b3e20
Caught exception in looking up space point ptr... 0x118b3e20, 0x118b3c90
Caught exception in looking up space point ptr... 0x53d86ac0, 0x3d907710
Caught exception in looking up space point ptr... 0x3d907710, 0x18b2df20
Caught exception in looking up space point ptr... 0x13d30220, 0x16e50d10
Caught exception in looking up space point ptr... 0x16e50d10, 0x13d30220
Caught exception in looking up space point ptr... 0x56e4e000, 0xd8e2510
Caught exception in looking up space point ptr... 0xd8e2510, 0x47854520
Caught exception in looking up space point ptr... 0x80315880, 0x4d3f3640
Caught exception in looking up space point ptr... 0x5852ada0, 0x80315880
Caught exception in looking up space point ptr... 0x30537c70, 0x63f33ac0
Caught exception in looking up space point ptr... 0x30536140, 0x30537c70
Caught exception in looking up space point ptr... 0x10878d00, 0x108788c0
Caught exception in looking up space point ptr... 0x108788c0, 0x10878d00
Caught exception in looking up space point ptr... 0x775ab350, 0x38d224d0
Caught exception in looking up space point ptr... 0x38d224d0, 0x35cf17d0
Caught exception in looking up space point ptr... 0x13d26ab0, 0x13d267c0
Caught exception in looking up space point ptr... 0x13d267c0, 0x13d26ab0
Caught exception in looking up space point ptr... 0x63f69540, 0x3814b7b0
Caught exception in looking up space point ptr... 0x3814b7b0, 0x3081ff20
Caught exception in looking up space point ptr... 0x7c9c7f40, 0x7c9c80d0
Caught exception in looking up space point ptr... 0x7c9c80d0, 0x7c9c8260
Caught exception in looking up space point ptr... 0x11894ea0, 0x11895230
Caught exception in looking up space point ptr... 0x11895230, 0x11894ea0
Caught exception in looking up space point ptr... 0x11894ea0, 0x11894fd0
Caught exception in looking up space point ptr... 0x11894fd0, 0x11894ea0
Caught exception in looking up space point ptr... 0x53b99bd0, 0x58538130
Caught exception in looking up space point ptr... 0x58538130, 0x58537b90
Caught exception in looking up space point ptr... 0x16737cd0, 0x30539540
Caught exception in looking up space point ptr... 0x30539540, 0x6c484430
Caught exception in looking up space point ptr... 0x17f4dce0, 0x17f4dbf0
Caught exception in looking up space point ptr... 0x17f4dbf0, 0x17f4dce0
Caught exception in looking up space point ptr... 0x16152390, 0x16151a80
Caught exception in looking up space point ptr... 0x16151a80, 0x16152390
Caught exception in looking up space point ptr... 0x120d11d0, 0x7c9afc00
Caught exception in looking up space point ptr... 0x7c9afc00, 0x4d7ba190
Caught exception in looking up space point ptr... 0x306ff4a0, 0x306ff310
Caught exception in looking up space point ptr... 0x306ff310, 0x306feff0
Caught exception in looking up space point ptr... 0x188e0740, 0x69247d60
Caught exception in looking up space point ptr... 0x69247d60, 0x3ad5a630
++++>>>> total num hits: 87445, num free: 84488
04-Feb-2026 02:18:53 GMT Closed output file "np02vd_raw_run042433_0460_df-s03-d1_dw_0_20260203T213657_reco_stage0_20260204T021853_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 351.767 424.468 548.438 419.682 45.3892 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8305e-05 0.000144477 0.000271276 0.000122877 5.65467e-05 19
produce:tpcrawdecoder:PDVDTPCReader 138.969 199.892 270.49 207.391 34.2504 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.591707 1.03046 1.62323 0.938863 0.311313 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0166566 0.0286951 0.0669451 0.0212066 0.0143991 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0165206 0.0176295 0.032912 0.0167486 0.00360772 19
produce:beamevent:BeamEvent 0.000106439 0.000206954 0.00109816 0.000164455 0.000213016 19
produce:pdvddaphne:DAPHNEReaderPDVD 15.8517 20.5461 24.4855 20.0001 2.49189 19
produce:ophit:OpHitFinder 0.0405376 0.0651089 0.0809394 0.0654112 0.0119102 19
produce:wclsdatavd:WireCellToolkit 136.007 172.817 227.226 166.748 27.0594 19
produce:gaushit:GausHitFinder 1.25776 1.75935 2.66512 1.78548 0.327556 19
produce:nhitsfilter:NumberOfHitsFilter 0.000434256 0.000583288 0.000813972 0.000556288 0.000101909 19
produce:reco3d:SpacePointSolver 12.2037 18.9594 28.0965 18.6076 4.34446 19
produce:hitpdune:DisambigFromSpacePoints 0.137327 0.278997 0.534974 0.252657 0.106155 19
produce:cluster3d:Cluster3D 1.21212 2.58488 4.82369 2.45417 0.868221 19
[art]:TriggerResults:TriggerResultInserter 2.6379e-05 3.70989e-05 0.00010927 3.2532e-05 1.74607e-05 19
end_path:out1:RootOutput 5.034e-06 9.83242e-06 3.1974e-05 8.349e-06 5.99292e-06 19
end_path:out1:RootOutput(write) 5.08856 6.4437 9.89245 5.6642 1.47317 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5286.59 MB
Peak resident set size usage (VmHWM): 3335.4 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0460_df-s03-d1_dw_0_20260203T213657_reco_stage0_20260204T021853_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0460_df-s03-d1_dw_0_20260203T213657_reco_stage0_20260204T021853_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0460_df-s03-d1_dw_0_20260203T213657_reco_stage0_20260204T021853_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163379.0,
"core.end_time": 1770171536.0,
"core.events": [
52449,
52455,
52461,
52467,
52473,
52479,
52485,
52491,
52497,
52503,
52509,
52515,
52521,
52527,
52533,
52539,
52545,
52551,
52557
],
"core.event_count": 19,
"core.first_event_number": 52449,
"core.last_event_number": 52557,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0460_df-s03-d1_dw_0_20260203T213657.hdf5"
}
]
} 