Jobsub ID 297921.51@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.51@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce03 |
| Last heartbeat | 2026-02-04 01:07:45 |
| From worker node | Hostname | dune001-1535373.0-lcg2492.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:49:16 |
| Input files | vd-protodune:np02vd_raw_run042433_0520_df-s03-d1_dw_0_20260203T215945.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4589s) |
| CPU time | 1h (4202s = 91%) |
| Max RSS bytes | 3389980672 (3232 MiB) |
| Outputting started | 2026-02-04 01:05:47 |
| Output files | |
| Finished | 2026-02-04 01:07:45 |
| Saved logs | justin-logs:297921.51-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x2fd50770, 0x2fd4edf0
Caught exception in looking up space point ptr... 0x2fd4edf0, 0x2f2f4080
Caught exception in looking up space point ptr... 0x2f2f4080, 0x2fd4edf0
Caught exception in looking up space point ptr... 0x3277c600, 0x3277c500
Caught exception in looking up space point ptr... 0x3277c500, 0x3277af00
Caught exception in looking up space point ptr... 0xa3c41a40, 0xa3c39360
Caught exception in looking up space point ptr... 0xa3c39360, 0xa3c41a40
Caught exception in looking up space point ptr... 0xaa63dae0, 0x34b15330
Caught exception in looking up space point ptr... 0x4eed8bf0, 0xaa63dae0
Caught exception in looking up space point ptr... 0x81145100, 0x81144fd0
Caught exception in looking up space point ptr... 0x81144fd0, 0x81145100
Caught exception in looking up space point ptr... 0x97543530, 0x975433a0
Caught exception in looking up space point ptr... 0x975433a0, 0xaa09b3d0
Caught exception in looking up space point ptr... 0xaa09b4a0, 0x97543210
Caught exception in looking up space point ptr... 0x97543210, 0x97543530
Caught exception in looking up space point ptr... 0xa3e13780, 0xa3e13ad0
Caught exception in looking up space point ptr... 0xa3e13ad0, 0xa3e1e0e0
Caught exception in looking up space point ptr... 0x925bb4a0, 0x925bb6f0
Caught exception in looking up space point ptr... 0x925bb6f0, 0x925bb000
Caught exception in looking up space point ptr... 0x921264c0, 0x8cdb6fe0
Caught exception in looking up space point ptr... 0x8cdb6fe0, 0x54bc0a30
Caught exception in looking up space point ptr... 0x883216b0, 0x88323cf0
Caught exception in looking up space point ptr... 0x883218e0, 0x883216b0
Caught exception in looking up space point ptr... 0x507f6040, 0x507f61d0
Caught exception in looking up space point ptr... 0x507f61d0, 0x507f64f0
Caught exception in looking up space point ptr... 0x8ca1edf0, 0x8ca22f30
Caught exception in looking up space point ptr... 0x8ca22f30, 0x8ca1edf0
Caught exception in looking up space point ptr... 0x62c8e150, 0x62c87700
Caught exception in looking up space point ptr... 0x62c87700, 0x62c8e150
Caught exception in looking up space point ptr... 0x5eecd760, 0x5eed28a0
Caught exception in looking up space point ptr... 0x5eed28a0, 0x5eed2710
Caught exception in looking up space point ptr... 0x3b9117f0, 0x7f054110
Caught exception in looking up space point ptr... 0x7f054110, 0x3b9117f0
Caught exception in looking up space point ptr... 0xaa074940, 0xaa0b0b00
Caught exception in looking up space point ptr... 0xaa0b0b00, 0xaa074940
Caught exception in looking up space point ptr... 0x86cfbfa0, 0x86cfbe10
Caught exception in looking up space point ptr... 0x86cfbe10, 0x86cfbfa0
Caught exception in looking up space point ptr... 0x925ae2b0, 0x9259f270
Caught exception in looking up space point ptr... 0x925ad930, 0x925ae2b0
Caught exception in looking up space point ptr... 0xaa6bc770, 0x5fe3ea20
Caught exception in looking up space point ptr... 0x5fe3ea20, 0x401aec90
Caught exception in looking up space point ptr... 0x84092d10, 0x840912c0
Caught exception in looking up space point ptr... 0x84092ef0, 0x84092d10
Caught exception in looking up space point ptr... 0x55a0ce30, 0x55a0d150
Caught exception in looking up space point ptr... 0x55a0d150, 0x55a0ce30
Caught exception in looking up space point ptr... 0xaa089c50, 0xaa092370
Caught exception in looking up space point ptr... 0xaa092370, 0xaa089550
Caught exception in looking up space point ptr... 0x8e63c970, 0x8e640a50
Caught exception in looking up space point ptr... 0x8e640cd0, 0x8e63c970
Caught exception in looking up space point ptr... 0x3d107640, 0x7ecc9600
Caught exception in looking up space point ptr... 0x7ecc9600, 0x3d107790
Caught exception in looking up space point ptr... 0x3da885d0, 0x920d4870
Caught exception in looking up space point ptr... 0x920d4870, 0xab3ecc30
Caught exception in looking up space point ptr... 0x54bfec40, 0x54bfede0
Caught exception in looking up space point ptr... 0x54bfede0, 0x54bfec40
Caught exception in looking up space point ptr... 0x926c2000, 0x926c1730
Caught exception in looking up space point ptr... 0x926c1730, 0x926c2000
Caught exception in looking up space point ptr... 0x86c575d0, 0x501ba180
Caught exception in looking up space point ptr... 0x501ba180, 0x86c575d0
Caught exception in looking up space point ptr... 0x90eaedf0, 0x90eaec10
Caught exception in looking up space point ptr... 0x90eaec10, 0x90eaedf0
Caught exception in looking up space point ptr... 0xa5de06a0, 0xa5de01a0
Caught exception in looking up space point ptr... 0xa5de01a0, 0xa5de06a0
Caught exception in looking up space point ptr... 0x917cb840, 0xa55555c0
Caught exception in looking up space point ptr... 0xa55555c0, 0x917cb840
Caught exception in looking up space point ptr... 0x3d81f7c0, 0x3d822370
Caught exception in looking up space point ptr... 0x3d822370, 0x3d81f7c0
++++>>>> total num hits: 144740, num free: 139342
04-Feb-2026 01:05:35 UTC Closed output file "np02vd_raw_run042433_0520_df-s03-d1_dw_0_20260203T215945_reco_stage0_20260204T010535_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 211.788 235.478 266.506 237.565 12.508 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000111702 0.000166176 0.000415969 0.000125093 7.69737e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.1246 22.1616 27.9645 22.7025 2.47228 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.686333 0.708515 0.749423 0.705518 0.0183086 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0230474 0.0239843 0.0295459 0.0233716 0.00183324 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229374 0.0233933 0.024149 0.0233723 0.000252095 19
produce:beamevent:BeamEvent 0.000128983 0.000273257 0.00168173 0.000198034 0.000334233 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.15513 4.7278 5.2083 4.7949 0.263462 19
produce:ophit:OpHitFinder 0.041106 0.0533013 0.0607069 0.0549115 0.00508659 19
produce:wclsdatavd:WireCellToolkit 159.015 168.159 181.85 168.863 5.6687 19
produce:gaushit:GausHitFinder 1.40994 2.23019 3.06937 2.12358 0.438353 19
produce:nhitsfilter:NumberOfHitsFilter 0.000394089 0.000567421 0.00092132 0.000571702 0.000129031 19
produce:reco3d:SpacePointSolver 15.2004 24.8737 34.957 26.0465 5.78246 19
produce:hitpdune:DisambigFromSpacePoints 0.21789 0.330012 0.474333 0.331774 0.0699878 19
produce:cluster3d:Cluster3D 2.15995 4.36854 10.9124 3.94963 1.95183 19
[art]:TriggerResults:TriggerResultInserter 2.4201e-05 5.26942e-05 0.000176124 3.7141e-05 4.10151e-05 19
end_path:out1:RootOutput 5.99e-06 3.03433e-05 0.000365348 1.025e-05 7.93304e-05 19
end_path:out1:RootOutput(write) 6.23229 7.75367 9.20063 7.85837 0.891584 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5598.39 MB
Peak resident set size usage (VmHWM): 3389.98 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0520_df-s03-d1_dw_0_20260203T215945_reco_stage0_20260204T010535_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0520_df-s03-d1_dw_0_20260203T215945_reco_stage0_20260204T010535_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0520_df-s03-d1_dw_0_20260203T215945_reco_stage0_20260204T010535_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162571.0,
"core.end_time": 1770167137.0,
"core.events": [
59289,
59295,
59301,
59307,
59313,
59319,
59325,
59331,
59337,
59343,
59349,
59355,
59361,
59367,
59373,
59379,
59385,
59391,
59397
],
"core.event_count": 19,
"core.first_event_number": 59289,
"core.last_event_number": 59397,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0520_df-s03-d1_dw_0_20260203T215945.hdf5"
}
]
} 