Jobsub ID 297916.126@dunegpschedd02.fnal.gov
| Jobsub ID | 297916.126@dunegpschedd02.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 00:34:26 |
| From worker node | Hostname | wn-lot-031.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:54:47 |
| Input files | vd-protodune:np02vd_raw_run042422_0117_df-s02-d1_dw_0_20260203T161802.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5845s) |
| CPU time | 41m (2470s = 42%) |
| Max RSS bytes | 2591285248 (2471 MiB) |
| Outputting started | 2026-02-04 00:32:13 |
| Output files | |
| Finished | 2026-02-04 00:34:26 |
| Saved logs | justin-logs:297916.126-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
exception in looking up space point ptr... 0x75314860, 0x753160e0
Caught exception in looking up space point ptr... 0x38c82dd0, 0x38c82c80
Caught exception in looking up space point ptr... 0x38c82c80, 0x38c82dd0
Caught exception in looking up space point ptr... 0x38c82dd0, 0x38c930d0
Caught exception in looking up space point ptr... 0x38c930d0, 0x38c82dd0
Caught exception in looking up space point ptr... 0x36183c70, 0x361856d0
Caught exception in looking up space point ptr... 0x3618a920, 0x36183c70
Caught exception in looking up space point ptr... 0x622aa9d0, 0x622ab620
Caught exception in looking up space point ptr... 0x622ab620, 0x622aa9d0
Caught exception in looking up space point ptr... 0x70bf56e0, 0x70bf8d70
Caught exception in looking up space point ptr... 0x70bf8d70, 0x70bf56e0
Caught exception in looking up space point ptr... 0x23ee9a60, 0x23ee9740
Caught exception in looking up space point ptr... 0x23ee9740, 0x23ee95b0
Caught exception in looking up space point ptr... 0x536d4a00, 0x536cf2f0
Caught exception in looking up space point ptr... 0x536cf2f0, 0x536d4a00
Caught exception in looking up space point ptr... 0x2f713400, 0x2f725ed0
Caught exception in looking up space point ptr... 0x2f725ed0, 0x2f7132b0
Caught exception in looking up space point ptr... 0x383d4480, 0x464c3a20
Caught exception in looking up space point ptr... 0x464c3a20, 0x383d4480
Caught exception in looking up space point ptr... 0x58d2c4c0, 0x206b1e70
Caught exception in looking up space point ptr... 0x206b1e70, 0x2034ca20
Caught exception in looking up space point ptr... 0x2fd55430, 0x46f42f70
Caught exception in looking up space point ptr... 0x46f42f70, 0x24e2fed0
Caught exception in looking up space point ptr... 0x1dffcc90, 0x3931e110
Caught exception in looking up space point ptr... 0x48b6b930, 0x1dffcc90
Caught exception in looking up space point ptr... 0x1e8a9f70, 0x1e8a9c50
Caught exception in looking up space point ptr... 0x1e8a9c50, 0x1e8a9f70
Caught exception in looking up space point ptr... 0x2fbbd3f0, 0x2fbbd580
Caught exception in looking up space point ptr... 0x2fbbd580, 0x2fbbd3f0
Caught exception in looking up space point ptr... 0x57b943c0, 0x4e33fb30
Caught exception in looking up space point ptr... 0x4e33fb30, 0x4e3434f0
Caught exception in looking up space point ptr... 0x197384a0, 0x1972d620
Caught exception in looking up space point ptr... 0x19738660, 0x197384a0
Caught exception in looking up space point ptr... 0x5079f6d0, 0x5079fac0
Caught exception in looking up space point ptr... 0x5079fac0, 0x5079fc10
Caught exception in looking up space point ptr... 0x245801e0, 0x245803c0
Caught exception in looking up space point ptr... 0x245803c0, 0x245801e0
Caught exception in looking up space point ptr... 0x1cbc0520, 0x1cbd42a0
Caught exception in looking up space point ptr... 0x1cbd42a0, 0x1cbd4540
Caught exception in looking up space point ptr... 0x57baf060, 0x57bb3c00
Caught exception in looking up space point ptr... 0x57bb3c00, 0x57baf060
Caught exception in looking up space point ptr... 0x4353b670, 0x61170080
Caught exception in looking up space point ptr... 0x61170080, 0x4353b670
Caught exception in looking up space point ptr... 0x48b4f780, 0x47578050
Caught exception in looking up space point ptr... 0x47578050, 0x48b4f780
Caught exception in looking up space point ptr... 0x66d9b4f0, 0x66d9b3a0
Caught exception in looking up space point ptr... 0x66d9b3a0, 0x66d9b4f0
Caught exception in looking up space point ptr... 0x599d43e0, 0x599d4c70
Caught exception in looking up space point ptr... 0x599d4c70, 0x599d43e0
Caught exception in looking up space point ptr... 0x471bd2b0, 0x471c6f20
Caught exception in looking up space point ptr... 0x471c6f20, 0x471bd2b0
Caught exception in looking up space point ptr... 0x5d951530, 0x5d94df40
Caught exception in looking up space point ptr... 0x5d94df40, 0x5d951930
Caught exception in looking up space point ptr... 0x4e343ba0, 0x4e343880
Caught exception in looking up space point ptr... 0x4e343880, 0x4e343ba0
Caught exception in looking up space point ptr... 0x48b74ed0, 0x24746c10
Caught exception in looking up space point ptr... 0x24746c10, 0x48b74ed0
Caught exception in looking up space point ptr... 0x478f4550, 0x478ff350
Caught exception in looking up space point ptr... 0x478ff350, 0x478f4550
Caught exception in looking up space point ptr... 0x18179f50, 0x18179c60
Caught exception in looking up space point ptr... 0x18179c60, 0x18179e00
Caught exception in looking up space point ptr... 0x17b0b0c0, 0x17b0a240
Caught exception in looking up space point ptr... 0x17b0a240, 0x17b0b0c0
Caught exception in looking up space point ptr... 0x55488830, 0x554886f0
Caught exception in looking up space point ptr... 0x554886f0, 0x55488830
++++>>>> total num hits: 83635, num free: 80927
04-Feb-2026 01:32:02 CET Closed output file "np02vd_raw_run042422_0117_df-s02-d1_dw_0_20260203T161802_reco_stage0_20260204T003202_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 165.584 213.256 265.538 209.142 24.7073 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.8376e-05 9.62528e-05 0.000234979 9.127e-05 2.77348e-05 27
produce:tpcrawdecoder:PDVDTPCReader 73.8595 116.565 167.782 113.741 22.9921 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.581548 0.782974 1.31346 0.695398 0.186494 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0173725 0.0213744 0.0380899 0.0195642 0.00528866 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0860305 0.0875063 0.104151 0.086896 0.00329214 27
produce:beamevent:BeamEvent 7.9769e-05 0.000135061 0.000992615 0.00010171 0.000168812 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.4102 15.6634 20.5985 15.6788 2.4542 27
produce:ophit:OpHitFinder 0.0360235 0.0551261 0.0637541 0.0587817 0.00791916 27
produce:wclsdatavd:WireCellToolkit 58.4725 62.249 70.7251 61.6229 3.08438 27
produce:gaushit:GausHitFinder 0.578251 0.82712 1.16383 0.797794 0.151618 27
produce:nhitsfilter:NumberOfHitsFilter 0.00018704 0.000297167 0.00055612 0.00026765 9.97618e-05 27
produce:reco3d:SpacePointSolver 6.06969 9.97435 15.1467 9.90463 2.86848 27
produce:hitpdune:DisambigFromSpacePoints 0.0553521 0.0905664 0.124481 0.0920213 0.0202733 27
produce:cluster3d:Cluster3D 0.546589 1.2709 2.19068 1.2521 0.435951 27
[art]:TriggerResults:TriggerResultInserter 1.7753e-05 2.22843e-05 6.5202e-05 2.0358e-05 8.67109e-06 27
end_path:out1:RootOutput 3.195e-06 4.26893e-06 1.8555e-05 3.677e-06 2.82763e-06 27
end_path:out1:RootOutput(write) 5.00479 5.64402 7.23603 5.53421 0.528073 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4537.81 MB
Peak resident set size usage (VmHWM): 2591.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0117_df-s02-d1_dw_0_20260203T161802_reco_stage0_20260204T003202_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0117_df-s02-d1_dw_0_20260203T161802_reco_stage0_20260204T003202_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0117_df-s02-d1_dw_0_20260203T161802_reco_stage0_20260204T003202_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770159298.0,
"core.end_time": 1770165124.0,
"core.events": [
18973,
18979,
18985,
18991,
18997,
19003,
19009,
19015,
19021,
19027,
19033,
19039,
19045,
19051,
19057,
19063,
19069,
19075,
19081,
19087,
19093,
19099,
19105,
19111,
19117,
19123,
19129
],
"core.event_count": 27,
"core.first_event_number": 18973,
"core.last_event_number": 19129,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0117_df-s02-d1_dw_0_20260203T161802.hdf5"
}
]
} 