Jobsub ID 303656.53@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.53@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | UK_RAL-PPD |
| Entry | CMSHTPC_T2_UK_SGrid_RALPP_hep207 |
| Last heartbeat | 2026-02-04 01:10:21 |
| From worker node | Hostname | heplnc148.pp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 257400 (71 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:11:41 |
| Input files | vd-protodune:np02vd_raw_run042421_0130_df-s02-d1_dw_0_20260203T144117.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 56m (3370s) |
| CPU time | 48m (2930s = 86%) |
| Max RSS bytes | 2555506688 (2437 MiB) |
| Outputting started | 2026-02-04 01:07:53 |
| Output files | |
| Finished | 2026-02-04 01:10:21 |
| Saved logs | justin-logs:303656.53-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
d590
Caught exception in looking up space point ptr... 0x2c063810, 0x2c063680
Caught exception in looking up space point ptr... 0x2c063680, 0x2c063810
Caught exception in looking up space point ptr... 0x25364000, 0x45f66680
Caught exception in looking up space point ptr... 0x45f66680, 0x25364000
Caught exception in looking up space point ptr... 0x2b40fc00, 0x31905560
Caught exception in looking up space point ptr... 0x31905560, 0x4d801170
Caught exception in looking up space point ptr... 0x325857b0, 0x61159560
Caught exception in looking up space point ptr... 0x61159560, 0x3a44cac0
Caught exception in looking up space point ptr... 0x42ef4fd0, 0x5988e8d0
Caught exception in looking up space point ptr... 0x5988e8d0, 0x2e1d7500
Caught exception in looking up space point ptr... 0x2e1d7500, 0x5988ea60
Caught exception in looking up space point ptr... 0x25bf5fb0, 0x25bf6140
Caught exception in looking up space point ptr... 0x25bf6140, 0x42ef4fd0
Caught exception in looking up space point ptr... 0x250c9720, 0x250c9980
Caught exception in looking up space point ptr... 0x250c9980, 0x250c9ab0
Caught exception in looking up space point ptr... 0x250c9ab0, 0x250c7f20
Caught exception in looking up space point ptr... 0x376eba60, 0x34371dc0
Caught exception in looking up space point ptr... 0x34371dc0, 0x3fee3470
Caught exception in looking up space point ptr... 0x6108e490, 0x15315eb0
Caught exception in looking up space point ptr... 0x15315eb0, 0x253322c0
Caught exception in looking up space point ptr... 0x253322c0, 0x5222f520
Caught exception in looking up space point ptr... 0x461936f0, 0x40bdbb10
Caught exception in looking up space point ptr... 0x40bdbb10, 0x56689580
Caught exception in looking up space point ptr... 0x41667890, 0x41667970
Caught exception in looking up space point ptr... 0x41667970, 0x41667890
Caught exception in looking up space point ptr... 0x250cb860, 0x250cd1b0
Caught exception in looking up space point ptr... 0x250cd1b0, 0x250d0ae0
Caught exception in looking up space point ptr... 0x2c05ee20, 0x2c05ed20
Caught exception in looking up space point ptr... 0x2c05ed20, 0x2c05ee20
Caught exception in looking up space point ptr... 0x24b7e460, 0x1574b7e0
Caught exception in looking up space point ptr... 0x1574b7e0, 0x1574b8e0
Caught exception in looking up space point ptr... 0x1191bc70, 0x2cef0310
Caught exception in looking up space point ptr... 0x2cef0310, 0x1191bc70
Caught exception in looking up space point ptr... 0x1191bc70, 0x252ea8b0
Caught exception in looking up space point ptr... 0x252ea8b0, 0x1191bc70
Caught exception in looking up space point ptr... 0xfa15140, 0xfa0a5f0
Caught exception in looking up space point ptr... 0xfa0f510, 0xfa15140
Caught exception in looking up space point ptr... 0x12ea7f40, 0x12ea4a10
Caught exception in looking up space point ptr... 0x12ea8250, 0x12ea7f40
Caught exception in looking up space point ptr... 0x12e867f0, 0x3a65f020
Caught exception in looking up space point ptr... 0x3a65f020, 0x87acb90
Caught exception in looking up space point ptr... 0x87acb90, 0x3a65f020
Caught exception in looking up space point ptr... 0x3a65f020, 0x49e21320
Caught exception in looking up space point ptr... 0x524be780, 0x524be2c0
Caught exception in looking up space point ptr... 0x524be2c0, 0x524be780
Caught exception in looking up space point ptr... 0x327a4b60, 0x4db9a2d0
Caught exception in looking up space point ptr... 0x4db9a2d0, 0x10e836b0
Caught exception in looking up space point ptr... 0x58cccfd0, 0x58ccd2d0
Caught exception in looking up space point ptr... 0x58ccd2d0, 0x58ccd400
Caught exception in looking up space point ptr... 0x27af6450, 0x47513450
Caught exception in looking up space point ptr... 0x47513450, 0x27af6450
Caught exception in looking up space point ptr... 0x27d804c0, 0x27d80330
Caught exception in looking up space point ptr... 0x27d80330, 0x27d804c0
Caught exception in looking up space point ptr... 0x619a5680, 0x619a52b0
Caught exception in looking up space point ptr... 0x619a4900, 0x619a5680
Caught exception in looking up space point ptr... 0x25b9e2f0, 0xdb2b280
Caught exception in looking up space point ptr... 0xdb2b280, 0x25b9e2f0
Caught exception in looking up space point ptr... 0x528f4910, 0x1539c3f0
Caught exception in looking up space point ptr... 0x1539c3f0, 0x25d064f0
Caught exception in looking up space point ptr... 0x3f8a61d0, 0x41d1b530
Caught exception in looking up space point ptr... 0x41d1b530, 0x3f8a61d0
Caught exception in looking up space point ptr... 0x56829200, 0x719a6d0
Caught exception in looking up space point ptr... 0x719a6d0, 0xb6232b0
Caught exception in looking up space point ptr... 0x2c07d740, 0x2c0629f0
Caught exception in looking up space point ptr... 0x27d89290, 0x2c07d740
++++>>>> total num hits: 39522, num free: 37796
04-Feb-2026 01:07:41 GMT Closed output file "np02vd_raw_run042421_0130_df-s02-d1_dw_0_20260203T144117_reco_stage0_20260204T010741_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 108.564 120.73 135.268 120.62 6.11768 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.8638e-05 0.000130338 0.000264138 0.000104297 5.06035e-05 27
produce:tpcrawdecoder:PDVDTPCReader 11.5621 13.5823 15.9462 13.8234 1.35443 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.52823 0.56095 0.843746 0.548364 0.0568643 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0176425 0.0240687 0.16051 0.0179891 0.0268884 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0873534 0.0913297 0.105598 0.0882643 0.00669178 27
produce:beamevent:BeamEvent 9.5259e-05 0.000213356 0.00136314 0.00016984 0.000229749 27
produce:pdvddaphne:DAPHNEReaderPDVD 3.62261 3.96826 4.25638 4.01735 0.210576 27
produce:ophit:OpHitFinder 0.0318927 0.042496 0.0505605 0.0433047 0.00477971 27
produce:wclsdatavd:WireCellToolkit 72.532 81.7822 89.6322 81.7808 4.25938 27
produce:gaushit:GausHitFinder 0.809017 1.26904 1.71731 1.29222 0.255094 27
produce:nhitsfilter:NumberOfHitsFilter 0.000232579 0.000374628 0.00074766 0.000344841 0.000102105 27
produce:reco3d:SpacePointSolver 6.11204 12.2324 19.2283 11.6852 3.04201 27
produce:hitpdune:DisambigFromSpacePoints 0.0764379 0.131944 0.20852 0.128992 0.0322902 27
produce:cluster3d:Cluster3D 1.06929 2.31541 3.87304 2.3211 0.726076 27
[art]:TriggerResults:TriggerResultInserter 2.7011e-05 4.26531e-05 0.000128353 3.2972e-05 2.23985e-05 27
end_path:out1:RootOutput 3.477e-06 7.98893e-06 3.8773e-05 6.893e-06 6.59318e-06 27
end_path:out1:RootOutput(write) 3.7677 4.70267 5.59817 4.75679 0.535784 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4531.57 MB
Peak resident set size usage (VmHWM): 2555.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0130_df-s02-d1_dw_0_20260203T144117_reco_stage0_20260204T010741_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0130_df-s02-d1_dw_0_20260203T144117_reco_stage0_20260204T010741_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0130_df-s02-d1_dw_0_20260203T144117_reco_stage0_20260204T010741_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163915.0,
"core.end_time": 1770167263.0,
"core.events": [
21121,
21127,
21133,
21139,
21145,
21151,
21157,
21163,
21169,
21175,
21181,
21187,
21193,
21199,
21205,
21211,
21217,
21223,
21229,
21235,
21241,
21247,
21253,
21259,
21265,
21271,
21277
],
"core.event_count": 27,
"core.first_event_number": 21121,
"core.last_event_number": 21277,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0130_df-s02-d1_dw_0_20260203T144117.hdf5"
}
]
} 