Jobsub ID 303650.105@dunegpschedd01.fnal.gov
| Jobsub ID | 303650.105@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:28 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:19:25 |
| From worker node | Hostname | wn-lot-017.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:15:29 |
| Input files | vd-protodune:np02vd_raw_run042433_0313_df-s02-d1_dw_0_20260203T204105.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7268s) |
| CPU time | 1h (3744s = 51%) |
| Max RSS bytes | 3630063616 (3461 MiB) |
| Outputting started | 2026-02-04 01:16:40 |
| Output files | |
| Finished | 2026-02-04 01:19:25 |
| Saved logs | justin-logs:303650.105-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x7391b1c0, 0x73919720
Caught exception in looking up space point ptr... 0x7393e620, 0x7391b1c0
Caught exception in looking up space point ptr... 0x909e08b0, 0x909c9990
Caught exception in looking up space point ptr... 0x909f80c0, 0x909e08b0
Caught exception in looking up space point ptr... 0x531d8e20, 0x531d90f0
Caught exception in looking up space point ptr... 0x874b26d0, 0x531d8e20
Caught exception in looking up space point ptr... 0x77a8d3c0, 0x77a9f840
Caught exception in looking up space point ptr... 0x77a9f840, 0x77a8d6e0
Caught exception in looking up space point ptr... 0x841505e0, 0x4c314af0
Caught exception in looking up space point ptr... 0xad21fd10, 0x841505e0
Caught exception in looking up space point ptr... 0xad6ab330, 0xad6949f0
Caught exception in looking up space point ptr... 0xad6949f0, 0xad6948c0
Caught exception in looking up space point ptr... 0x4eab6bb0, 0x70769ca0
Caught exception in looking up space point ptr... 0x70769ca0, 0x486542f0
Caught exception in looking up space point ptr... 0x53a6b580, 0x5188d3e0
Caught exception in looking up space point ptr... 0x5188d3e0, 0xa6524440
Caught exception in looking up space point ptr... 0xa9c7e770, 0xa9ccb300
Caught exception in looking up space point ptr... 0x77eb35a0, 0xa9c7e770
Caught exception in looking up space point ptr... 0x56167900, 0x56175710
Caught exception in looking up space point ptr... 0x56175710, 0xb10a0f00
Caught exception in looking up space point ptr... 0xb1bb1760, 0x75b48230
Caught exception in looking up space point ptr... 0x75b48230, 0x5119e3b0
Caught exception in looking up space point ptr... 0x8c01ee30, 0x8c02a700
Caught exception in looking up space point ptr... 0x8c02a700, 0x8c0373e0
Caught exception in looking up space point ptr... 0xb73af050, 0x8c933bd0
Caught exception in looking up space point ptr... 0x5707c890, 0x4b9aac30
Caught exception in looking up space point ptr... 0x4b9aac30, 0x4b9da050
Caught exception in looking up space point ptr... 0x4b9da050, 0x4bd908d0
Caught exception in looking up space point ptr... 0x4bd908d0, 0xb73af050
Caught exception in looking up space point ptr... 0x4c5533a0, 0x4c552810
Caught exception in looking up space point ptr... 0x4c552810, 0x4c4c9260
Caught exception in looking up space point ptr... 0x4b49acd0, 0x4b49ae60
Caught exception in looking up space point ptr... 0x46b4eda0, 0x4b49acd0
Caught exception in looking up space point ptr... 0xa98eba30, 0xa98f8d70
Caught exception in looking up space point ptr... 0xa98f8d70, 0xa98f8f00
Caught exception in looking up space point ptr... 0x85511a70, 0x57260150
Caught exception in looking up space point ptr... 0x57260150, 0x5725ffc0
Caught exception in looking up space point ptr... 0x8f74f650, 0xb0673ea0
Caught exception in looking up space point ptr... 0xb0673ea0, 0x76cfe330
Caught exception in looking up space point ptr... 0x847ba9e0, 0x58395a80
Caught exception in looking up space point ptr... 0x847bab70, 0x847ba9e0
Caught exception in looking up space point ptr... 0xa6c04ff0, 0xad68f880
Caught exception in looking up space point ptr... 0xad6ae380, 0xa6c04ff0
Caught exception in looking up space point ptr... 0x9a362080, 0x9a34a640
Caught exception in looking up space point ptr... 0x9a362210, 0x9a362080
Caught exception in looking up space point ptr... 0x828e37b0, 0x83a04f30
Caught exception in looking up space point ptr... 0x83a04f30, 0x83a050c0
Caught exception in looking up space point ptr... 0x747e54d0, 0xa04aa120
Caught exception in looking up space point ptr... 0xa04aa120, 0x747e54d0
Caught exception in looking up space point ptr... 0x4c195b50, 0x4c1846c0
Caught exception in looking up space point ptr... 0x4c1846c0, 0x4c1736e0
Caught exception in looking up space point ptr... 0x4b6b5f50, 0x4b6b6050
Caught exception in looking up space point ptr... 0x4b6b6050, 0x7527ae10
Caught exception in looking up space point ptr... 0x9bd1fef0, 0x9bd20040
Caught exception in looking up space point ptr... 0x9bd20040, 0x9bd20300
Caught exception in looking up space point ptr... 0x88698c10, 0x823f30e0
Caught exception in looking up space point ptr... 0x823f30e0, 0x886984d0
Caught exception in looking up space point ptr... 0x5432acb0, 0x57005030
Caught exception in looking up space point ptr... 0x57005030, 0x5432acb0
Caught exception in looking up space point ptr... 0x84eef210, 0x8a93c9a0
Caught exception in looking up space point ptr... 0x8a93c9a0, 0x84eef210
Caught exception in looking up space point ptr... 0x84207990, 0xa1c13fd0
Caught exception in looking up space point ptr... 0xa1c13fd0, 0x512fc530
Caught exception in looking up space point ptr... 0x71426d70, 0xa188bdb0
Caught exception in looking up space point ptr... 0xa0cded10, 0x71426d70
Caught exception in looking up space point ptr... 0x82121c30, 0x82121ed0
Caught exception in looking up space point ptr... 0x82121ed0, 0x82121c30
++++>>>> total num hits: 506939, num free: 497806
04-Feb-2026 02:16:26 CET Closed output file "np02vd_raw_run042433_0313_df-s02-d1_dw_0_20260203T204105_reco_stage0_20260204T011626_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 318.531 378.092 502.285 368.5 47.1044 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.8977e-05 0.000122742 0.000300793 0.000116417 4.47216e-05 19
produce:tpcrawdecoder:PDVDTPCReader 110.634 178.02 263.132 164.665 41.9962 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.656769 0.889217 1.20241 0.842489 0.145351 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0172906 0.0264222 0.0930227 0.022064 0.0164121 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0171334 0.0176669 0.0181863 0.017711 0.000316873 19
produce:beamevent:BeamEvent 6.9009e-05 0.000174434 0.00104687 0.000136655 0.000208609 19
produce:pdvddaphne:DAPHNEReaderPDVD 11.9769 16.7994 25.0448 16.208 3.36911 19
produce:ophit:OpHitFinder 0.0391307 0.0583247 0.0697414 0.0580978 0.00735465 19
produce:wclsdatavd:WireCellToolkit 108.906 115.346 120.639 115.617 3.06269 19
produce:gaushit:GausHitFinder 0.869959 1.80057 3.1173 1.88736 0.564411 19
produce:nhitsfilter:NumberOfHitsFilter 0.000619098 0.0013706 0.00219206 0.00132236 0.000404308 19
produce:reco3d:SpacePointSolver 10.1695 18.1426 32.9564 16.3652 6.34147 19
produce:hitpdune:DisambigFromSpacePoints 0.108265 0.274696 0.503004 0.279065 0.0979564 19
produce:cluster3d:Cluster3D 1.17361 37.5623 68.3486 53.0649 26.9202 19
[art]:TriggerResults:TriggerResultInserter 2.5928e-05 3.74195e-05 0.00011236 3.1099e-05 1.85356e-05 19
end_path:out1:RootOutput 4.748e-06 7.62732e-06 2.7822e-05 5.811e-06 5.26849e-06 19
end_path:out1:RootOutput(write) 7.46499 9.09892 11.1638 8.79122 0.965376 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5564.84 MB
Peak resident set size usage (VmHWM): 3630.06 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0313_df-s02-d1_dw_0_20260203T204105_reco_stage0_20260204T011626_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0313_df-s02-d1_dw_0_20260203T204105_reco_stage0_20260204T011626_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0313_df-s02-d1_dw_0_20260203T204105_reco_stage0_20260204T011626_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770160539.0,
"core.end_time": 1770167789.0,
"core.events": [
35689,
35695,
35701,
35707,
35713,
35719,
35725,
35731,
35737,
35743,
35749,
35755,
35761,
35767,
35773,
35779,
35785,
35791,
35797
],
"core.event_count": 19,
"core.first_event_number": 35689,
"core.last_event_number": 35797,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0313_df-s02-d1_dw_0_20260203T204105.hdf5"
}
]
} 