Jobsub ID 303730.1@dunegpschedd01.fnal.gov
| Jobsub ID | 303730.1@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 01:20:32 |
| Site | UK_Manchester |
| Entry | UBoone_T2_UK_Manchester_ce01 |
| Last heartbeat | 2026-02-04 03:40:45 |
| From worker node | Hostname | wn2205240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 01:21:15 |
| Input files | vd-protodune:np02vd_raw_run042433_0614_df-s04-d0_dw_0_20260203T223530.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8076s) |
| CPU time | 2h (7414s = 91%) |
| Max RSS bytes | 14920249344 (14229 MiB) |
| Outputting started | 2026-02-04 03:36:05 |
| Output files | |
| Finished | 2026-02-04 03:40:45 |
| Saved logs | justin-logs:303730.1-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
6556bb00, 0x5f17ea00
Caught exception in looking up space point ptr... 0x15faa590, 0x15fa79a0
Caught exception in looking up space point ptr... 0x15fa79a0, 0x15fa7700
Caught exception in looking up space point ptr... 0xab89f3b0, 0xb3d4c240
Caught exception in looking up space point ptr... 0xb3d4c240, 0xb3d4c0d0
Caught exception in looking up space point ptr... 0xec8c6f70, 0xec8bf1d0
Caught exception in looking up space point ptr... 0xec8bf1d0, 0xec8c6f70
Caught exception in looking up space point ptr... 0x14565830, 0x145418f0
Caught exception in looking up space point ptr... 0x145418f0, 0x14565830
Caught exception in looking up space point ptr... 0x36a46960, 0x6630b590
Caught exception in looking up space point ptr... 0x6630b590, 0x6630bc40
Caught exception in looking up space point ptr... 0x38741df0, 0x38742190
Caught exception in looking up space point ptr... 0x38742190, 0x38741df0
Caught exception in looking up space point ptr... 0x134023e0, 0x13402550
Caught exception in looking up space point ptr... 0x13402550, 0x134023e0
Caught exception in looking up space point ptr... 0x6974b180, 0x6974b360
Caught exception in looking up space point ptr... 0x6974b360, 0x6974b180
Caught exception in looking up space point ptr... 0x106865c60, 0x106865940
Caught exception in looking up space point ptr... 0x106865940, 0x1068657b0
Caught exception in looking up space point ptr... 0x190fd3f0, 0x190fde70
Caught exception in looking up space point ptr... 0x190fde70, 0x190fd3f0
Caught exception in looking up space point ptr... 0x15faaa30, 0x15fb2e70
Caught exception in looking up space point ptr... 0x15fb2e70, 0x15fb6fa0
Caught exception in looking up space point ptr... 0x52de6cd0, 0x52de69b0
Caught exception in looking up space point ptr... 0x52de69b0, 0x52de6b40
Caught exception in looking up space point ptr... 0x4631e570, 0x72cd03e0
Caught exception in looking up space point ptr... 0x72cd03e0, 0x4631e570
Caught exception in looking up space point ptr... 0x29dabfe0, 0x70bb60d0
Caught exception in looking up space point ptr... 0x70bb60d0, 0x29dabfe0
Caught exception in looking up space point ptr... 0x15d876d0, 0xb3bbcda0
Caught exception in looking up space point ptr... 0xb3bbcda0, 0xb3bbd130
Caught exception in looking up space point ptr... 0xb8939d70, 0xb8939ee0
Caught exception in looking up space point ptr... 0xb8939ee0, 0xb8939c20
Caught exception in looking up space point ptr... 0x323a1af0, 0x3239ac40
Caught exception in looking up space point ptr... 0x3239ac40, 0x323a1af0
Caught exception in looking up space point ptr... 0x5b5dfc20, 0x5b5f0830
Caught exception in looking up space point ptr... 0x5b5f0830, 0x5b5dfc20
Caught exception in looking up space point ptr... 0x3938d840, 0x3852a490
Caught exception in looking up space point ptr... 0x3852a490, 0x3938d840
Caught exception in looking up space point ptr... 0x3938d840, 0x471b3aa0
Caught exception in looking up space point ptr... 0x471b3aa0, 0x3938d840
Caught exception in looking up space point ptr... 0x33876920, 0x33876b70
Caught exception in looking up space point ptr... 0x33876b70, 0x33877080
Caught exception in looking up space point ptr... 0x3cebf930, 0x58bf5320
Caught exception in looking up space point ptr... 0x58bf5320, 0x3278d4c0
Caught exception in looking up space point ptr... 0x587026b0, 0x587028b0
Caught exception in looking up space point ptr... 0x587028b0, 0x587026b0
Caught exception in looking up space point ptr... 0x3334ac10, 0x33349bd0
Caught exception in looking up space point ptr... 0x33349bd0, 0x3334ac10
Caught exception in looking up space point ptr... 0x160647f0, 0x16064ca0
Caught exception in looking up space point ptr... 0x16064ca0, 0x160647f0
Caught exception in looking up space point ptr... 0x8e16e10, 0x4424da70
Caught exception in looking up space point ptr... 0x4424da70, 0x8e16e10
Caught exception in looking up space point ptr... 0x4434ed70, 0x4434f160
Caught exception in looking up space point ptr... 0x4434f160, 0x4434f010
Caught exception in looking up space point ptr... 0x65d34ba0, 0x65d351e0
Caught exception in looking up space point ptr... 0x65d351e0, 0x65d34ba0
Caught exception in looking up space point ptr... 0x65d34ba0, 0x65d35050
Caught exception in looking up space point ptr... 0x65d35050, 0x65d34ba0
Caught exception in looking up space point ptr... 0x65d72e60, 0x65d72ff0
Caught exception in looking up space point ptr... 0x65d72ff0, 0x65d72cd0
Caught exception in looking up space point ptr... 0x15252a20, 0x152526b0
Caught exception in looking up space point ptr... 0x152526b0, 0x15252890
Caught exception in looking up space point ptr... 0x152509f0, 0x15250860
Caught exception in looking up space point ptr... 0x15250860, 0x152509f0
Caught exception in looking up space point ptr... 0xeb7e4210, 0x2a2ba6a0
Caught exception in looking up space point ptr... 0x2a2ba6a0, 0xeb7e4210
++++>>>> total num hits: 156372, num free: 150487
04-Feb-2026 03:35:44 GMT Closed output file "np02vd_raw_run042433_0614_df-s04-d0_dw_0_20260203T223530_reco_stage0_20260204T033544_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 176.449 419.287 2281.89 208.583 493.997 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000104346 0.000148566 0.000395324 0.000128803 6.61813e-05 19
produce:tpcrawdecoder:PDVDTPCReader 21.4323 28.0479 57.0647 27.1548 7.1687 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.655667 0.717285 0.851419 0.710584 0.0491013 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0218766 0.0267308 0.0756457 0.0224138 0.0120038 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0218649 0.0223097 0.0239605 0.0221277 0.000468826 19
produce:beamevent:BeamEvent 9.2615e-05 0.000215539 0.0011612 0.000167134 0.000224364 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.01113 4.81118 5.61996 4.90263 0.489528 19
produce:ophit:OpHitFinder 0.0344872 0.0444445 0.051931 0.0449271 0.00385873 19
produce:wclsdatavd:WireCellToolkit 117.326 139.352 162.57 137.789 11.2876 19
produce:gaushit:GausHitFinder 1.19325 3.67794 18.2926 2.05584 4.38568 19
produce:nhitsfilter:NumberOfHitsFilter 0.000270148 0.000589473 0.00124851 0.000426803 0.000302271 19
produce:reco3d:SpacePointSolver 13.0356 36.5587 123.212 20.6981 33.494 19
produce:hitpdune:DisambigFromSpacePoints 0.141218 1.19945 4.76858 0.257932 1.65024 19
produce:cluster3d:Cluster3D 2.04094 193.485 1945.53 4.11233 452.456 19
[art]:TriggerResults:TriggerResultInserter 2.4897e-05 8.22274e-05 0.000731867 3.6479e-05 0.000154631 19
end_path:out1:RootOutput 3.426e-06 8.79453e-06 2.5308e-05 8.216e-06 5.1995e-06 19
end_path:out1:RootOutput(write) 5.75514 11.2683 35.2818 7.18726 8.44202 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 17445.4 MB
Peak resident set size usage (VmHWM): 14920.2 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0614_df-s04-d0_dw_0_20260203T223530_reco_stage0_20260204T033544_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0614_df-s04-d0_dw_0_20260203T223530_reco_stage0_20260204T033544_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0614_df-s04-d0_dw_0_20260203T223530_reco_stage0_20260204T033544_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770168089.0,
"core.end_time": 1770176147.0,
"core.events": [
70006,
70012,
70018,
70024,
70030,
70036,
70042,
70048,
70054,
70060,
70066,
70072,
70078,
70084,
70090,
70096,
70102,
70108,
70114
],
"core.event_count": 19,
"core.first_event_number": 70006,
"core.last_event_number": 70114,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0614_df-s04-d0_dw_0_20260203T223530.hdf5"
}
]
} 