Jobsub ID 297921.47@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.47@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 00:45:05 |
| From worker node | Hostname | dune001-1520288.0-lcg2713.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:48:45 |
| Input files | vd-protodune:np02vd_raw_run042433_0371_df-s04-d0_dw_0_20260203T210309.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 54m (3278s) |
| CPU time | 48m (2891s = 88%) |
| Max RSS bytes | 3426258944 (3267 MiB) |
| Outputting started | 2026-02-04 00:43:25 |
| Output files | |
| Finished | 2026-02-04 00:45:05 |
| Saved logs | justin-logs:297921.47-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x53c73e10, 0x53c990a0
Caught exception in looking up space point ptr... 0x53c990a0, 0x53c73f10
Caught exception in looking up space point ptr... 0x4d218ec0, 0x4d2151f0
Caught exception in looking up space point ptr... 0x4d2151f0, 0x4d218ec0
Caught exception in looking up space point ptr... 0x8acd96e0, 0x8acd52f0
Caught exception in looking up space point ptr... 0x8acd52f0, 0x8acd5480
Caught exception in looking up space point ptr... 0x4df2bf10, 0x4df2bbf0
Caught exception in looking up space point ptr... 0x4df2bbf0, 0x4df2bf10
Caught exception in looking up space point ptr... 0x4df2bf10, 0x4df2bd80
Caught exception in looking up space point ptr... 0x4df2bd80, 0x4df2bf10
Caught exception in looking up space point ptr... 0x4d28c4f0, 0x4d287540
Caught exception in looking up space point ptr... 0x4d287540, 0x4d28c4f0
Caught exception in looking up space point ptr... 0x816b2ab0, 0x29bde250
Caught exception in looking up space point ptr... 0x29bde250, 0x2be53490
Caught exception in looking up space point ptr... 0x72f37010, 0x72f359b0
Caught exception in looking up space point ptr... 0x72f359b0, 0x72f37010
Caught exception in looking up space point ptr... 0x45e9e230, 0x45e9e3c0
Caught exception in looking up space point ptr... 0x45e9e3c0, 0x45ea2950
Caught exception in looking up space point ptr... 0x45ea2950, 0x45ea25e0
Caught exception in looking up space point ptr... 0x45ea25e0, 0x45e9e230
Caught exception in looking up space point ptr... 0x2c25d730, 0x927d48d0
Caught exception in looking up space point ptr... 0x927d48d0, 0x2c25c3d0
Caught exception in looking up space point ptr... 0x5b44ce00, 0x6574ed90
Caught exception in looking up space point ptr... 0x6574ed90, 0x5b44ce00
Caught exception in looking up space point ptr... 0x4ea23f60, 0x4ea22e20
Caught exception in looking up space point ptr... 0x4ea23ce0, 0x4ea23f60
Caught exception in looking up space point ptr... 0x78725a90, 0x787257f0
Caught exception in looking up space point ptr... 0x787257f0, 0x78725550
Caught exception in looking up space point ptr... 0x4d23a500, 0x4d23be30
Caught exception in looking up space point ptr... 0x4d23be30, 0x4d23f800
Caught exception in looking up space point ptr... 0x4d23f800, 0x4d23a240
Caught exception in looking up space point ptr... 0x4d23a240, 0x4d23a500
Caught exception in looking up space point ptr... 0x74fc40e0, 0x7f2c0b80
Caught exception in looking up space point ptr... 0x7f2c0b80, 0x74fc40e0
Caught exception in looking up space point ptr... 0x25dbd920, 0x25dbde20
Caught exception in looking up space point ptr... 0x25dbde20, 0x25dbd920
Caught exception in looking up space point ptr... 0x25dbd920, 0x25dbdb00
Caught exception in looking up space point ptr... 0x25dbdb00, 0x25dbd920
Caught exception in looking up space point ptr... 0x53d847a0, 0x53d84650
Caught exception in looking up space point ptr... 0x53d84650, 0x53d84060
Caught exception in looking up space point ptr... 0x294de400, 0x70c97ff0
Caught exception in looking up space point ptr... 0x70c97ff0, 0x294de400
Caught exception in looking up space point ptr... 0x6aef1280, 0x6aef16b0
Caught exception in looking up space point ptr... 0x6aef16b0, 0x6aef1280
Caught exception in looking up space point ptr... 0x3c54e0e0, 0x3c54e280
Caught exception in looking up space point ptr... 0x3c54e280, 0x3c54e570
Caught exception in looking up space point ptr... 0x80394b50, 0x3ce0b750
Caught exception in looking up space point ptr... 0x3ce0b750, 0x80394c50
Caught exception in looking up space point ptr... 0x80394c50, 0x583dba10
Caught exception in looking up space point ptr... 0x74ff9ea0, 0x5a189920
Caught exception in looking up space point ptr... 0x5a189920, 0x4a7ac810
Caught exception in looking up space point ptr... 0x889b4470, 0x581499d0
Caught exception in looking up space point ptr... 0x581499d0, 0x5a189480
Caught exception in looking up space point ptr... 0x7338bcd0, 0x73383380
Caught exception in looking up space point ptr... 0x73383380, 0x73383120
Caught exception in looking up space point ptr... 0x62284b10, 0x62284dc0
Caught exception in looking up space point ptr... 0x62284dc0, 0x62284b10
Caught exception in looking up space point ptr... 0x78724d70, 0x78725160
Caught exception in looking up space point ptr... 0x78725160, 0x78724d70
Caught exception in looking up space point ptr... 0x5a31c550, 0x41b37510
Caught exception in looking up space point ptr... 0x41b37510, 0x5a31c650
Caught exception in looking up space point ptr... 0x5b4fb900, 0x5b4fba00
Caught exception in looking up space point ptr... 0x5b4fba00, 0x5b4fb900
Caught exception in looking up space point ptr... 0x56bcc320, 0x727d3e90
Caught exception in looking up space point ptr... 0x727d3e90, 0x56bcc320
Caught exception in looking up space point ptr... 0x2a442c30, 0x4cae3960
Caught exception in looking up space point ptr... 0x4cae3960, 0x2a442c30
++++>>>> total num hits: 154581, num free: 148879
04-Feb-2026 00:43:17 UTC Closed output file "np02vd_raw_run042433_0371_df-s04-d0_dw_0_20260203T210309_reco_stage0_20260204T004317_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 151.397 167.639 182.195 167.623 9.58321 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9815e-05 0.000219019 0.00115592 0.000103616 0.000244969 19
produce:tpcrawdecoder:PDVDTPCReader 19.1705 19.9909 22.1263 19.655 0.809057 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.685619 0.706935 0.753363 0.697917 0.0192636 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229796 0.0233614 0.0246309 0.0232724 0.000352878 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229817 0.0238502 0.0358592 0.0231715 0.00283501 19
produce:beamevent:BeamEvent 0.00013961 0.000240722 0.00109071 0.000191508 0.00020187 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.22271 3.66024 4.08462 3.71395 0.214112 19
produce:ophit:OpHitFinder 0.0317236 0.0412951 0.051338 0.0403553 0.00416506 19
produce:wclsdatavd:WireCellToolkit 93.2189 113.348 123.541 115.006 7.13504 19
produce:gaushit:GausHitFinder 0.84538 1.57723 2.24626 1.53831 0.381798 19
produce:nhitsfilter:NumberOfHitsFilter 0.000206771 0.000363492 0.000873233 0.000356105 0.000134173 19
produce:reco3d:SpacePointSolver 10.8871 18.3717 26.0922 17.1946 4.63857 19
produce:hitpdune:DisambigFromSpacePoints 0.131798 0.255088 0.422155 0.247274 0.0716774 19
produce:cluster3d:Cluster3D 1.41614 3.87131 11.5622 3.23604 2.39079 19
[art]:TriggerResults:TriggerResultInserter 2.8132e-05 4.32382e-05 0.000125289 3.8458e-05 2.07982e-05 19
end_path:out1:RootOutput 4.287e-06 1.01368e-05 3.364e-05 9.324e-06 5.89984e-06 19
end_path:out1:RootOutput(write) 4.56389 5.71706 6.53444 5.83819 0.526752 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5613.78 MB
Peak resident set size usage (VmHWM): 3426.26 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0371_df-s04-d0_dw_0_20260203T210309_reco_stage0_20260204T004317_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0371_df-s04-d0_dw_0_20260203T210309_reco_stage0_20260204T004317_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0371_df-s04-d0_dw_0_20260203T210309_reco_stage0_20260204T004317_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162540.0,
"core.end_time": 1770165798.0,
"core.events": [
42304,
42310,
42316,
42322,
42328,
42334,
42340,
42346,
42352,
42358,
42364,
42370,
42376,
42382,
42388,
42394,
42400,
42406,
42412
],
"core.event_count": 19,
"core.first_event_number": 42304,
"core.last_event_number": 42412,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0371_df-s04-d0_dw_0_20260203T210309.hdf5"
}
]
} 