Jobsub ID 303656.56@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.56@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 01:20:47 |
| From worker node | Hostname | dune001-1516961.0-lcg2493.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:49 |
| Input files | vd-protodune:np02vd_raw_run042421_0053_df-s03-d0_dw_0_20260203T135942.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4022s) |
| CPU time | 59m (3557s = 88%) |
| Max RSS bytes | 2569416704 (2450 MiB) |
| Outputting started | 2026-02-04 01:18:52 |
| Output files | |
| Finished | 2026-02-04 01:20:47 |
| Saved logs | justin-logs:303656.56-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x4aca65e0, 0x4aca6890
Caught exception in looking up space point ptr... 0x4aca6890, 0x71539530
Caught exception in looking up space point ptr... 0x71539530, 0x47f9f5d0
Caught exception in looking up space point ptr... 0x4c8b7700, 0x4a283510
Caught exception in looking up space point ptr... 0x4a283510, 0x3aecbf30
Caught exception in looking up space point ptr... 0x3aecbf30, 0x65066630
Caught exception in looking up space point ptr... 0x65066630, 0x5cef4670
Caught exception in looking up space point ptr... 0x74fa3ce0, 0x74fa5d10
Caught exception in looking up space point ptr... 0x74fa46e0, 0x44e681b0
Caught exception in looking up space point ptr... 0x44e681b0, 0x74fa3ce0
Caught exception in looking up space point ptr... 0x4617e470, 0x405c0530
Caught exception in looking up space point ptr... 0x405c0530, 0x3ea774c0
Caught exception in looking up space point ptr... 0x3ea774c0, 0x35818ee0
Caught exception in looking up space point ptr... 0x35818ee0, 0x43f2a8b0
Caught exception in looking up space point ptr... 0x43f2a8b0, 0x43f2aba0
Caught exception in looking up space point ptr... 0x43f2aba0, 0x4617c5c0
Caught exception in looking up space point ptr... 0x4617c5c0, 0x4617e470
Caught exception in looking up space point ptr... 0x42c3c1e0, 0x5d186a50
Caught exception in looking up space point ptr... 0x5d186a50, 0x1d386e10
Caught exception in looking up space point ptr... 0x1da0a7c0, 0x1da09970
Caught exception in looking up space point ptr... 0x1da09970, 0x1da09480
Caught exception in looking up space point ptr... 0x1da0aa10, 0x1da0a7c0
Caught exception in looking up space point ptr... 0x6dc84c80, 0x6dc84b80
Caught exception in looking up space point ptr... 0x6dc84b80, 0x6dc84880
Caught exception in looking up space point ptr... 0x41f28fd0, 0x29f2bff0
Caught exception in looking up space point ptr... 0x29f2bff0, 0x47fdce70
Caught exception in looking up space point ptr... 0x4125c880, 0x6acb2b80
Caught exception in looking up space point ptr... 0x6acb2b80, 0x4125c880
Caught exception in looking up space point ptr... 0x4cddb980, 0x2a100910
Caught exception in looking up space point ptr... 0x4cddb4c0, 0x4cddb980
Caught exception in looking up space point ptr... 0x2a47cc50, 0x256d7310
Caught exception in looking up space point ptr... 0x256d7310, 0x256d74a0
Caught exception in looking up space point ptr... 0x6e6448d0, 0x3ac78d60
Caught exception in looking up space point ptr... 0x3ac78d60, 0x2a47cc50
Caught exception in looking up space point ptr... 0x5fe3dc50, 0x5fe3dbb0
Caught exception in looking up space point ptr... 0x5fe3dbb0, 0x5fe3d7c0
Caught exception in looking up space point ptr... 0x3ae42d80, 0x3ae41cd0
Caught exception in looking up space point ptr... 0x3ae41cd0, 0x3ae42d80
Caught exception in looking up space point ptr... 0x3ae42d80, 0x3ae42b20
Caught exception in looking up space point ptr... 0x3ae42b20, 0x3ae42d80
Caught exception in looking up space point ptr... 0x5cf561d0, 0x4cc52c40
Caught exception in looking up space point ptr... 0x4cc52c40, 0x5cf54e50
Caught exception in looking up space point ptr... 0x1af668c0, 0x2291d000
Caught exception in looking up space point ptr... 0x5cfc2b20, 0x1af668c0
Caught exception in looking up space point ptr... 0x3ef6e080, 0x3ae89330
Caught exception in looking up space point ptr... 0x3ae89330, 0x3ef6e080
Caught exception in looking up space point ptr... 0x3fafcb30, 0x43b62ca0
Caught exception in looking up space point ptr... 0x43b62ca0, 0x4617c130
Caught exception in looking up space point ptr... 0x3fd54500, 0x3fd54360
Caught exception in looking up space point ptr... 0x3fd54360, 0x3fd54500
Caught exception in looking up space point ptr... 0x24263850, 0x75983170
Caught exception in looking up space point ptr... 0x75983170, 0x40780cc0
Caught exception in looking up space point ptr... 0x6ec723c0, 0x6862ed00
Caught exception in looking up space point ptr... 0x6862ed00, 0x6862ebe0
Caught exception in looking up space point ptr... 0x54c60180, 0x54c606e0
Caught exception in looking up space point ptr... 0x54c606e0, 0x71a8e500
Caught exception in looking up space point ptr... 0x2689e890, 0x43f03450
Caught exception in looking up space point ptr... 0x43f03450, 0x2689e890
Caught exception in looking up space point ptr... 0x5cf4e5f0, 0x5cf4e4f0
Caught exception in looking up space point ptr... 0x5cf4e4f0, 0x5cf4e5f0
Caught exception in looking up space point ptr... 0x74c0c7e0, 0x74c0c910
Caught exception in looking up space point ptr... 0x74c0c910, 0x74c0c660
Caught exception in looking up space point ptr... 0x4e016500, 0x41fd2090
Caught exception in looking up space point ptr... 0x41fd2090, 0x4e016500
Caught exception in looking up space point ptr... 0x60321b40, 0x223762a0
Caught exception in looking up space point ptr... 0x223762a0, 0x60321b40
++++>>>> total num hits: 39943, num free: 38396
04-Feb-2026 01:18:39 UTC Closed output file "np02vd_raw_run042421_0053_df-s03-d0_dw_0_20260203T135942_reco_stage0_20260204T011839_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 127.802 144.474 160.305 144.464 7.66485 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000101881 0.000155372 0.000364476 0.000128372 7.19556e-05 27
produce:tpcrawdecoder:PDVDTPCReader 15.236 17.476 21.1373 17.2111 1.81469 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.693007 0.710332 0.743107 0.712592 0.0117913 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229531 0.0239196 0.035658 0.0234484 0.00230951 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.114473 0.118532 0.151795 0.115583 0.0089634 27
produce:beamevent:BeamEvent 0.000104412 0.000276299 0.00194177 0.000212743 0.000331293 27
produce:pdvddaphne:DAPHNEReaderPDVD 4.31285 4.88699 5.83346 4.89261 0.314462 27
produce:ophit:OpHitFinder 0.0408571 0.053333 0.0647182 0.0542431 0.00610768 27
produce:wclsdatavd:WireCellToolkit 79.8679 97.5587 105.123 99.2307 5.34896 27
produce:gaushit:GausHitFinder 0.721438 1.6152 2.67824 1.58177 0.497021 27
produce:nhitsfilter:NumberOfHitsFilter 0.000242914 0.000450336 0.000933874 0.000438226 0.000145004 27
produce:reco3d:SpacePointSolver 7.33828 13.4038 23.4994 13.5963 4.05209 27
produce:hitpdune:DisambigFromSpacePoints 0.0887982 0.164171 0.309838 0.150431 0.0523477 27
produce:cluster3d:Cluster3D 1.28482 2.76714 6.57218 2.48336 1.28936 27
[art]:TriggerResults:TriggerResultInserter 3.0381e-05 4.99983e-05 0.000164583 4.0771e-05 3.01592e-05 27
end_path:out1:RootOutput 4.75e-06 2.51298e-05 0.000413757 9.801e-06 7.65538e-05 27
end_path:out1:RootOutput(write) 4.09763 5.65055 6.45903 5.76648 0.53204 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4747.4 MB
Peak resident set size usage (VmHWM): 2569.42 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0053_df-s03-d0_dw_0_20260203T135942_reco_stage0_20260204T011839_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0053_df-s03-d0_dw_0_20260203T135942_reco_stage0_20260204T011839_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0053_df-s03-d0_dw_0_20260203T135942_reco_stage0_20260204T011839_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163925.0,
"core.end_time": 1770167922.0,
"core.events": [
8648,
8654,
8660,
8666,
8672,
8678,
8684,
8690,
8696,
8702,
8708,
8714,
8720,
8726,
8732,
8738,
8744,
8750,
8756,
8762,
8768,
8774,
8780,
8786,
8792,
8798,
8804
],
"core.event_count": 27,
"core.first_event_number": 8648,
"core.last_event_number": 8804,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0053_df-s03-d0_dw_0_20260203T135942.hdf5"
}
]
} 