Jobsub ID 303656.10@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.10@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:44:52 |
| From worker node | Hostname | dune002-1603974.0-lcg2713.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:35 |
| Input files | vd-protodune:np02vd_raw_run042421_0166_df-s02-d1_dw_0_20260203T150046.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 31m (1909s) |
| CPU time | 28m (1691s = 88%) |
| Max RSS bytes | 2658795520 (2535 MiB) |
| Outputting started | 2026-02-04 00:43:25 |
| Output files | |
| Finished | 2026-02-04 00:44:52 |
| Saved logs | justin-logs:303656.10-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
tr... 0x9df26c70, 0x64628410
Caught exception in looking up space point ptr... 0x492e2a90, 0x492e2900
Caught exception in looking up space point ptr... 0x492e2900, 0x8d438e80
Caught exception in looking up space point ptr... 0x6a663b60, 0x6a678aa0
Caught exception in looking up space point ptr... 0x6a678aa0, 0x6a678bd0
Caught exception in looking up space point ptr... 0x69828fc0, 0x759af170
Caught exception in looking up space point ptr... 0x8f0ea570, 0x69828fc0
Caught exception in looking up space point ptr... 0x8ee79810, 0x8ee799a0
Caught exception in looking up space point ptr... 0x6bc80e80, 0x8ee79810
Caught exception in looking up space point ptr... 0x6f1554b0, 0x67e52f60
Caught exception in looking up space point ptr... 0x6f155640, 0x6f1554b0
Caught exception in looking up space point ptr... 0x8779cd70, 0x82959820
Caught exception in looking up space point ptr... 0x8779cf00, 0x8779cd70
Caught exception in looking up space point ptr... 0x4ffbcc50, 0x6790a740
Caught exception in looking up space point ptr... 0x4ffbcd40, 0x4ffbcc50
Caught exception in looking up space point ptr... 0x540be3a0, 0xa1d45700
Caught exception in looking up space point ptr... 0xa1d45700, 0x6d597270
Caught exception in looking up space point ptr... 0x5fee3160, 0x725f5ee0
Caught exception in looking up space point ptr... 0x5fee8b60, 0x5fee3160
Caught exception in looking up space point ptr... 0x51b9e7a0, 0x51b90ce0
Caught exception in looking up space point ptr... 0x51b90ce0, 0x51b9e610
Caught exception in looking up space point ptr... 0x51b8c820, 0x865ec3a0
Caught exception in looking up space point ptr... 0x865ec3a0, 0x865da3d0
Caught exception in looking up space point ptr... 0x6bd68d90, 0x6e5c4fe0
Caught exception in looking up space point ptr... 0x6e5c4fe0, 0x84376600
Caught exception in looking up space point ptr... 0x5fec3040, 0x5fec3360
Caught exception in looking up space point ptr... 0x5fec3360, 0x5fec3040
Caught exception in looking up space point ptr... 0x7c6d1ed0, 0x4d2c31f0
Caught exception in looking up space point ptr... 0x4d2c31f0, 0x7c6d1ed0
Caught exception in looking up space point ptr... 0x4fd3b820, 0x7b918680
Caught exception in looking up space point ptr... 0x478c0a70, 0x4fd3b820
Caught exception in looking up space point ptr... 0x87a8d9b0, 0x53754eb0
Caught exception in looking up space point ptr... 0x53754eb0, 0x8e81d290
Caught exception in looking up space point ptr... 0xa2a586d0, 0xa2a58540
Caught exception in looking up space point ptr... 0xa2a58540, 0xa2a583b0
Caught exception in looking up space point ptr... 0xa2a583b0, 0xa2a58860
Caught exception in looking up space point ptr... 0x6f5f6810, 0x8dbe32a0
Caught exception in looking up space point ptr... 0x8dbe32a0, 0x653c23d0
Caught exception in looking up space point ptr... 0x726d7eb0, 0x726d7b90
Caught exception in looking up space point ptr... 0x726d7b90, 0x726d7eb0
Caught exception in looking up space point ptr... 0xa1cc99b0, 0xa1cc9da0
Caught exception in looking up space point ptr... 0xa1cc9da0, 0xa1cc99b0
Caught exception in looking up space point ptr... 0x54201a90, 0x872e90c0
Caught exception in looking up space point ptr... 0x872e90c0, 0x54201a90
Caught exception in looking up space point ptr... 0x54201a90, 0x844659e0
Caught exception in looking up space point ptr... 0x844659e0, 0x54201a90
Caught exception in looking up space point ptr... 0x6bc28bf0, 0x6bc28ac0
Caught exception in looking up space point ptr... 0x6bc28ac0, 0x6bc28bf0
Caught exception in looking up space point ptr... 0x82991a40, 0x82991d60
Caught exception in looking up space point ptr... 0x82991d60, 0x82991a40
Caught exception in looking up space point ptr... 0xa1c9b1a0, 0xa1c9b7e0
Caught exception in looking up space point ptr... 0xa1c9b7e0, 0xa1c9b1a0
Caught exception in looking up space point ptr... 0x787b5320, 0x68a3f7c0
Caught exception in looking up space point ptr... 0x68a3f7c0, 0x787b4be0
Caught exception in looking up space point ptr... 0x4cb1f600, 0x846fd4c0
Caught exception in looking up space point ptr... 0x846fd4c0, 0x846fd610
Caught exception in looking up space point ptr... 0xa1cc8f60, 0xa1cc8cc0
Caught exception in looking up space point ptr... 0xa1cc8cc0, 0xa1cc8f60
Caught exception in looking up space point ptr... 0x51d88910, 0x51d887c0
Caught exception in looking up space point ptr... 0x51d887c0, 0x51d88aa0
Caught exception in looking up space point ptr... 0x51a60c00, 0x5288e0c0
Caught exception in looking up space point ptr... 0x51a60970, 0x51a60c00
Caught exception in looking up space point ptr... 0x82676370, 0x4bb2eb00
Caught exception in looking up space point ptr... 0x4bb2eb00, 0x82676370
Caught exception in looking up space point ptr... 0x607e6040, 0x607e6150
Caught exception in looking up space point ptr... 0x607e6150, 0x607e6040
Caught exception in looking up space point ptr... 0x6f613ca0, 0x68b18d20
Caught exception in looking up space point ptr... 0x68b18d20, 0x6f613ca0
++++>>>> total num hits: 318720, num free: 312141
04-Feb-2026 00:43:17 UTC Closed output file "np02vd_raw_run042421_0166_df-s02-d1_dw_0_20260203T150046_reco_stage0_20260204T004317_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 96.3867 141.156 161.487 150.582 21.4879 13
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.9374e-05 0.00014435 0.000291207 0.000111017 6.28694e-05 13
produce:tpcrawdecoder:PDVDTPCReader 13.4612 15.5729 19.0558 15.2627 1.86082 13
produce:triggerrawdecoder:PDVDTriggerReader4 0.690581 0.705215 0.715923 0.710589 0.00937735 13
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0228897 0.023301 0.0239474 0.0231992 0.000316085 13
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.113737 0.120184 0.139002 0.115113 0.00987545 13
produce:beamevent:BeamEvent 0.000124988 0.000269279 0.00125326 0.000191828 0.000285824 13
produce:pdvddaphne:DAPHNEReaderPDVD 3.31489 3.62946 4.01914 3.63824 0.184679 13
produce:ophit:OpHitFinder 0.0335195 0.0407547 0.0456337 0.0417803 0.00314806 13
produce:wclsdatavd:WireCellToolkit 54.691 70.8354 79.6364 73.1946 7.30846 13
produce:gaushit:GausHitFinder 0.85561 1.40029 1.9838 1.53066 0.358318 13
produce:nhitsfilter:NumberOfHitsFilter 0.000220701 0.000346225 0.000436747 0.000364889 7.47224e-05 13
produce:reco3d:SpacePointSolver 7.55923 10.8527 15.1932 10.6321 1.9375 13
produce:hitpdune:DisambigFromSpacePoints 0.0888682 0.23463 0.382973 0.252635 0.0867764 13
produce:cluster3d:Cluster3D 1.26818 32.9484 47.2167 42.3935 17.3422 13
[art]:TriggerResults:TriggerResultInserter 2.3295e-05 4.30702e-05 9.5714e-05 3.7897e-05 1.66049e-05 13
end_path:out1:RootOutput 3.335e-06 9.45046e-06 2.651e-05 8.613e-06 5.42771e-06 13
end_path:out1:RootOutput(write) 2.84634 4.75733 5.52547 5.21174 0.827679 13
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4935.07 MB
Peak resident set size usage (VmHWM): 2658.8 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0166_df-s02-d1_dw_0_20260203T150046_reco_stage0_20260204T004317_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0166_df-s02-d1_dw_0_20260203T150046_reco_stage0_20260204T004317_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0166_df-s02-d1_dw_0_20260203T150046_reco_stage0_20260204T004317_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163906.0,
"core.end_time": 1770165799.0,
"core.events": [
26965,
26971,
26977,
26983,
26989,
26995,
27001,
27007,
27013,
27019,
27025,
27031,
27037
],
"core.event_count": 13,
"core.first_event_number": 26965,
"core.last_event_number": 27037,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0166_df-s02-d1_dw_0_20260203T150046.hdf5"
}
]
} 