Jobsub ID 297921.46@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.46@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce04 |
| Last heartbeat | 2026-02-04 01:50:45 |
| From worker node | Hostname | dune001-1520262.0-lcg2580.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:49:16 |
| Input files | vd-protodune:np02vd_raw_run042433_0474_df-s02-d1_dw_0_20260203T214215.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7125s) |
| CPU time | 1h (6742s = 94%) |
| Max RSS bytes | 7076073472 (6748 MiB) |
| Outputting started | 2026-02-04 01:48:04 |
| Output files | |
| Finished | 2026-02-04 01:50:45 |
| Saved logs | justin-logs:297921.46-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
c0, 0x505decf0
Caught exception in looking up space point ptr... 0x505d8510, 0x7678f800
Caught exception in looking up space point ptr... 0x7678f800, 0x505d8510
Caught exception in looking up space point ptr... 0x2d36d750, 0xc51271b0
Caught exception in looking up space point ptr... 0xc51271b0, 0x426dcee0
Caught exception in looking up space point ptr... 0x63138f60, 0x63103dc0
Caught exception in looking up space point ptr... 0x63103dc0, 0x84b89820
Caught exception in looking up space point ptr... 0x81e1ce80, 0x91693410
Caught exception in looking up space point ptr... 0x91693410, 0x81e1ce80
Caught exception in looking up space point ptr... 0x505d7910, 0x4a4bb860
Caught exception in looking up space point ptr... 0x4a4bb860, 0x4a4bb6d0
Caught exception in looking up space point ptr... 0x491d5990, 0xfb3ef6c0
Caught exception in looking up space point ptr... 0xfb3ef6c0, 0x491d5990
Caught exception in looking up space point ptr... 0xbe5d7d40, 0x6f1b71e0
Caught exception in looking up space point ptr... 0x784590f0, 0xbe5d7d40
Caught exception in looking up space point ptr... 0x7c4e9460, 0x7b9dd1b0
Caught exception in looking up space point ptr... 0x7b9dd1b0, 0x7c4e9460
Caught exception in looking up space point ptr... 0x7c470d20, 0xfb3ebcf0
Caught exception in looking up space point ptr... 0xfb3ebcf0, 0xfb419260
Caught exception in looking up space point ptr... 0x6b1d53f0, 0x4d652630
Caught exception in looking up space point ptr... 0x4d652630, 0x6b1d53f0
Caught exception in looking up space point ptr... 0x505de9f0, 0x7ffa3f50
Caught exception in looking up space point ptr... 0x7ffa3f50, 0x505deaf0
Caught exception in looking up space point ptr... 0x49110900, 0x220c24e0
Caught exception in looking up space point ptr... 0x220c24e0, 0x49110900
Caught exception in looking up space point ptr... 0x659b4730, 0x8a72b1a0
Caught exception in looking up space point ptr... 0x8a72b1a0, 0x659b4730
Caught exception in looking up space point ptr... 0x8cea7220, 0x4a168490
Caught exception in looking up space point ptr... 0x4a168490, 0x8cea7220
Caught exception in looking up space point ptr... 0x60e9a2b0, 0xfb3ed750
Caught exception in looking up space point ptr... 0xfb3ed750, 0x60e9a2b0
Caught exception in looking up space point ptr... 0x6f9a1730, 0x49fe2150
Caught exception in looking up space point ptr... 0x49fe2150, 0xf40c22b0
Caught exception in looking up space point ptr... 0x88023960, 0x880237d0
Caught exception in looking up space point ptr... 0x880237d0, 0x88023960
Caught exception in looking up space point ptr... 0x88023960, 0x4f78fa30
Caught exception in looking up space point ptr... 0x4f78fa30, 0x88023960
Caught exception in looking up space point ptr... 0x65c0d270, 0x80934670
Caught exception in looking up space point ptr... 0x80934670, 0x68212570
Caught exception in looking up space point ptr... 0x77ed4010, 0x77ed4330
Caught exception in looking up space point ptr... 0x77ed4330, 0x77ed44c0
Caught exception in looking up space point ptr... 0xea9207d0, 0x45920e00
Caught exception in looking up space point ptr... 0x45920e00, 0xea9207d0
Caught exception in looking up space point ptr... 0x48cd03b0, 0x48cd97b0
Caught exception in looking up space point ptr... 0x821444e0, 0x48cd03b0
Caught exception in looking up space point ptr... 0x60c75990, 0x60dac1b0
Caught exception in looking up space point ptr... 0x60dac1b0, 0x60c75990
Caught exception in looking up space point ptr... 0x7a882480, 0x90be9bf0
Caught exception in looking up space point ptr... 0x90be9bf0, 0x90be9d80
Caught exception in looking up space point ptr... 0x60d736f0, 0x10420af30
Caught exception in looking up space point ptr... 0x10420af30, 0x75259360
Caught exception in looking up space point ptr... 0x7a99ca20, 0x2c48ff70
Caught exception in looking up space point ptr... 0x2c48ff70, 0x7a99ca20
Caught exception in looking up space point ptr... 0x482f7830, 0x67726ee0
Caught exception in looking up space point ptr... 0x67726ee0, 0x4d1f5630
Caught exception in looking up space point ptr... 0x31d28e40, 0x31d28cb0
Caught exception in looking up space point ptr... 0x31d28cb0, 0x31d28e40
Caught exception in looking up space point ptr... 0xa5811910, 0x2b844cc0
Caught exception in looking up space point ptr... 0x2b844cc0, 0xa5811910
Caught exception in looking up space point ptr... 0x104257d30, 0x104259e90
Caught exception in looking up space point ptr... 0x104259e90, 0x10425dee0
Caught exception in looking up space point ptr... 0x70a9f780, 0x5bfd4700
Caught exception in looking up space point ptr... 0x5bfd4700, 0x5bfd6bc0
Caught exception in looking up space point ptr... 0x8ce55dc0, 0x65ef1f00
Caught exception in looking up space point ptr... 0x65ef1f00, 0x8ce55dc0
Caught exception in looking up space point ptr... 0x53261710, 0x53261570
Caught exception in looking up space point ptr... 0x53261570, 0x53261710
++++>>>> total num hits: 2630475, num free: 2560688
04-Feb-2026 01:47:48 UTC Closed output file "np02vd_raw_run042433_0474_df-s02-d1_dw_0_20260203T214215_reco_stage0_20260204T014748_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 222.294 367.575 999.311 241.539 252.888 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000112242 0.000145362 0.000342417 0.000123212 6.4035e-05 19
produce:tpcrawdecoder:PDVDTPCReader 17.9697 19.869 37.4306 18.5219 4.29588 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.690469 0.740895 1.1261 0.702723 0.0982176 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0232671 0.0244518 0.0297439 0.0235642 0.00187491 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0231298 0.0233788 0.0238999 0.0233423 0.000183624 19
produce:beamevent:BeamEvent 0.000120672 0.000250778 0.00134054 0.000190823 0.000260605 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.22042 4.65075 5.08107 4.70359 0.240224 19
produce:ophit:OpHitFinder 0.0435041 0.0550424 0.0755708 0.0530673 0.00746298 19
produce:wclsdatavd:WireCellToolkit 157.424 176.118 191.953 175.523 9.0471 19
produce:gaushit:GausHitFinder 1.90418 4.77602 16.2605 2.52998 4.94842 19
produce:nhitsfilter:NumberOfHitsFilter 0.000535821 0.000880919 0.0021778 0.000690563 0.000431174 19
produce:reco3d:SpacePointSolver 16.3873 38.4452 107.659 26.5792 28.6703 19
produce:hitpdune:DisambigFromSpacePoints 0.204141 0.877433 3.4643 0.334252 1.13057 19
produce:cluster3d:Cluster3D 2.19595 110.934 651.821 3.76423 210.955 19
[art]:TriggerResults:TriggerResultInserter 3.0911e-05 6.11486e-05 0.000220794 4.0681e-05 4.58063e-05 19
end_path:out1:RootOutput 7.76e-06 2.10651e-05 0.000194284 9.22e-06 4.12824e-05 19
end_path:out1:RootOutput(write) 6.73081 10.9855 26.4053 8.41026 5.79906 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 9626.63 MB
Peak resident set size usage (VmHWM): 7076.07 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0474_df-s02-d1_dw_0_20260203T214215_reco_stage0_20260204T014748_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0474_df-s02-d1_dw_0_20260203T214215_reco_stage0_20260204T014748_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0474_df-s02-d1_dw_0_20260203T214215_reco_stage0_20260204T014748_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162576.0,
"core.end_time": 1770169671.0,
"core.events": [
54043,
54049,
54055,
54061,
54067,
54073,
54079,
54085,
54091,
54097,
54103,
54109,
54115,
54121,
54127,
54133,
54139,
54145,
54151
],
"core.event_count": 19,
"core.first_event_number": 54043,
"core.last_event_number": 54151,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0474_df-s02-d1_dw_0_20260203T214215.hdf5"
}
]
} 