Jobsub ID 297923.106@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.106@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 01:09:27 |
| From worker node | Hostname | dune002-1603824.0-lcg2705.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:02:50 |
| Input files | vd-protodune:np02vd_raw_run042433_0559_df-s03-d1_dw_0_20260203T221440.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3883s) |
| CPU time | 58m (3503s = 90%) |
| Max RSS bytes | 3594858496 (3428 MiB) |
| Outputting started | 2026-02-04 01:07:36 |
| Output files | |
| Finished | 2026-02-04 01:09:27 |
| Saved logs | justin-logs:297923.106-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
. 0x7602c5f0, 0x7602c490
Caught exception in looking up space point ptr... 0x760321a0, 0x7602c5f0
Caught exception in looking up space point ptr... 0x4b9043c0, 0x4b9024c0
Caught exception in looking up space point ptr... 0x4b904610, 0x4b9043c0
Caught exception in looking up space point ptr... 0x7167f820, 0xb6674a30
Caught exception in looking up space point ptr... 0xb6674a30, 0x8d603700
Caught exception in looking up space point ptr... 0xba9475d0, 0xba947040
Caught exception in looking up space point ptr... 0xba947040, 0xba9475d0
Caught exception in looking up space point ptr... 0xba95c850, 0xba95af40
Caught exception in looking up space point ptr... 0xba95af40, 0xba95b4f0
Caught exception in looking up space point ptr... 0x6b34da80, 0x79350c50
Caught exception in looking up space point ptr... 0x79350c50, 0x7934d5e0
Caught exception in looking up space point ptr... 0x9c8555d0, 0x79865500
Caught exception in looking up space point ptr... 0x79865500, 0x79862fe0
Caught exception in looking up space point ptr... 0x7423a020, 0x40698ca0
Caught exception in looking up space point ptr... 0x40698ca0, 0x7423a020
Caught exception in looking up space point ptr... 0x8f1a4be0, 0xb8d5c370
Caught exception in looking up space point ptr... 0x77245650, 0x8f1a4be0
Caught exception in looking up space point ptr... 0x98f4d130, 0x98f452c0
Caught exception in looking up space point ptr... 0x98f452c0, 0x98f4d410
Caught exception in looking up space point ptr... 0x72b8fbf0, 0x500c9f30
Caught exception in looking up space point ptr... 0x500c9f30, 0x9b416f60
Caught exception in looking up space point ptr... 0x9b416f60, 0x8a5ab560
Caught exception in looking up space point ptr... 0x95304460, 0x95303f10
Caught exception in looking up space point ptr... 0x95303f10, 0x95304460
Caught exception in looking up space point ptr... 0x42377140, 0x71aa3250
Caught exception in looking up space point ptr... 0x71aa3250, 0x42377140
Caught exception in looking up space point ptr... 0x75f85750, 0x6b4ccff0
Caught exception in looking up space point ptr... 0x6b4ccff0, 0x75f85750
Caught exception in looking up space point ptr... 0x750b4b70, 0x75380af0
Caught exception in looking up space point ptr... 0x75380af0, 0x75380c80
Caught exception in looking up space point ptr... 0x864f5a10, 0x94aa0800
Caught exception in looking up space point ptr... 0x94aa0800, 0x864f5bb0
Caught exception in looking up space point ptr... 0x88c06a60, 0x88c06bf0
Caught exception in looking up space point ptr... 0x88c06bf0, 0x88c06a60
Caught exception in looking up space point ptr... 0x43f670d0, 0x43f647d0
Caught exception in looking up space point ptr... 0x43f647d0, 0x43f670d0
Caught exception in looking up space point ptr... 0x774fd610, 0x774f97f0
Caught exception in looking up space point ptr... 0x774f97f0, 0x774fd610
Caught exception in looking up space point ptr... 0x52bf64b0, 0x4b992710
Caught exception in looking up space point ptr... 0x4b992710, 0x8908ccb0
Caught exception in looking up space point ptr... 0xbc1b7d90, 0xbe2b3740
Caught exception in looking up space point ptr... 0xbe2b3740, 0xbe2b2fd0
Caught exception in looking up space point ptr... 0x8ca2c4b0, 0x4bdba9b0
Caught exception in looking up space point ptr... 0x4bdba9b0, 0x8ca2c390
Caught exception in looking up space point ptr... 0x8f18c140, 0x8f18c070
Caught exception in looking up space point ptr... 0x8f18c070, 0x8f18c140
Caught exception in looking up space point ptr... 0x952d6d60, 0x952d6e90
Caught exception in looking up space point ptr... 0x952d6e90, 0x952d6350
Caught exception in looking up space point ptr... 0x719b3fb0, 0xbd6e1a00
Caught exception in looking up space point ptr... 0xbd6e1a00, 0x719b3fb0
Caught exception in looking up space point ptr... 0x775d5ae0, 0x8d7714c0
Caught exception in looking up space point ptr... 0x8d7714c0, 0x775d5ae0
Caught exception in looking up space point ptr... 0x46697b90, 0xb4d943d0
Caught exception in looking up space point ptr... 0xb4d943d0, 0x46697b90
Caught exception in looking up space point ptr... 0x543971c0, 0x4347bd90
Caught exception in looking up space point ptr... 0x47146490, 0x543971c0
Caught exception in looking up space point ptr... 0xa590e5e0, 0xa590f6b0
Caught exception in looking up space point ptr... 0xa590f6b0, 0xa590e5e0
Caught exception in looking up space point ptr... 0x773f0440, 0x773f0320
Caught exception in looking up space point ptr... 0x773f0320, 0x773f0440
Caught exception in looking up space point ptr... 0x46920b60, 0x46920770
Caught exception in looking up space point ptr... 0x46920770, 0x46920b60
Caught exception in looking up space point ptr... 0x98f4d010, 0x98f5ccc0
Caught exception in looking up space point ptr... 0x98f5ccc0, 0x98f4d010
Caught exception in looking up space point ptr... 0xa2123ad0, 0xa2113e80
Caught exception in looking up space point ptr... 0xa2113e80, 0xa212fbb0
++++>>>> total num hits: 97524, num free: 93913
04-Feb-2026 01:07:25 UTC Closed output file "np02vd_raw_run042433_0559_df-s03-d1_dw_0_20260203T221440_reco_stage0_20260204T010725_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 156.822 200.109 232.689 209.89 25.8482 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8193e-05 0.000135002 0.00027179 0.000118108 5.27045e-05 19
produce:tpcrawdecoder:PDVDTPCReader 16.8078 19.5554 24.1432 18.8453 2.23173 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.713243 0.926086 2.75934 0.778615 0.45574 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0231661 0.0373932 0.102932 0.023466 0.0231481 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229863 0.0232679 0.0240391 0.0232423 0.000210035 19
produce:beamevent:BeamEvent 0.000135004 0.000267098 0.00160139 0.000188464 0.000315716 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.15442 3.5573 4.33992 3.56595 0.302713 19
produce:ophit:OpHitFinder 0.0362735 0.0420432 0.0519284 0.0416693 0.00408464 19
produce:wclsdatavd:WireCellToolkit 97.6527 112.463 124.575 112.929 8.44988 19
produce:gaushit:GausHitFinder 1.18982 2.04404 3.18125 1.7141 0.605819 19
produce:nhitsfilter:NumberOfHitsFilter 0.000209095 0.00037186 0.000556429 0.000398211 9.99619e-05 19
produce:reco3d:SpacePointSolver 11.2142 17.2489 27.3616 15.8337 4.72211 19
produce:hitpdune:DisambigFromSpacePoints 0.156018 0.28284 0.505031 0.227236 0.108542 19
produce:cluster3d:Cluster3D 2.069 37.5673 69.6348 48.6761 24.5713 19
[art]:TriggerResults:TriggerResultInserter 2.8523e-05 4.97709e-05 0.000150367 4.1242e-05 2.88894e-05 19
end_path:out1:RootOutput 5.758e-06 3.0556e-05 0.00037809 1.0336e-05 8.20405e-05 19
end_path:out1:RootOutput(write) 4.22169 6.30805 7.85541 5.81538 1.11548 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5810.27 MB
Peak resident set size usage (VmHWM): 3594.86 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0559_df-s03-d1_dw_0_20260203T221440_reco_stage0_20260204T010725_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0559_df-s03-d1_dw_0_20260203T221440_reco_stage0_20260204T010725_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0559_df-s03-d1_dw_0_20260203T221440_reco_stage0_20260204T010725_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163380.0,
"core.end_time": 1770167247.0,
"core.events": [
63735,
63741,
63747,
63753,
63759,
63765,
63771,
63777,
63783,
63789,
63795,
63801,
63807,
63813,
63819,
63825,
63831,
63837,
63843
],
"core.event_count": 19,
"core.first_event_number": 63735,
"core.last_event_number": 63843,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0559_df-s03-d1_dw_0_20260203T221440.hdf5"
}
]
} 