Jobsub ID 297920.121@dunegpschedd02.fnal.gov
| Jobsub ID | 297920.121@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:27 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_dissel_multicore |
| Last heartbeat | 2026-02-04 02:05:44 |
| From worker node | Hostname | wn-snel-026.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7H12 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:42:15 |
| Input files | vd-protodune:np02vd_raw_run042433_0621_df-s03-d0_dw_0_20260203T223809.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8442s) |
| CPU time | 1h (4895s = 57%) |
| Max RSS bytes | 3599605760 (3432 MiB) |
| Outputting started | 2026-02-04 02:03:01 |
| Output files | |
| Finished | 2026-02-04 02:05:44 |
| Saved logs | justin-logs:297920.121-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x8d3cb480, 0x85db7130
Caught exception in looking up space point ptr... 0x8d3cb2f0, 0x8d3cb480
Caught exception in looking up space point ptr... 0x89579910, 0x87376610
Caught exception in looking up space point ptr... 0x89579780, 0x89579910
Caught exception in looking up space point ptr... 0x6e270d80, 0x6f98c140
Caught exception in looking up space point ptr... 0x6f98c140, 0x6f98bfb0
Caught exception in looking up space point ptr... 0x54eea740, 0x54eea840
Caught exception in looking up space point ptr... 0x97e70610, 0x54eea740
Caught exception in looking up space point ptr... 0xb35d9b10, 0x9441c630
Caught exception in looking up space point ptr... 0x9441c630, 0xa8934330
Caught exception in looking up space point ptr... 0xaa4f70f0, 0xaa4f72f0
Caught exception in looking up space point ptr... 0xaa4f72f0, 0xaa4f7790
Caught exception in looking up space point ptr... 0xbcdc27f0, 0xbcdd45e0
Caught exception in looking up space point ptr... 0xbcdb0a00, 0xbcdc27f0
Caught exception in looking up space point ptr... 0x519b0930, 0x519b1180
Caught exception in looking up space point ptr... 0x519b1180, 0x544306d0
Caught exception in looking up space point ptr... 0x4d843100, 0x85d93ef0
Caught exception in looking up space point ptr... 0x4d843270, 0x4d843100
Caught exception in looking up space point ptr... 0x859c2b50, 0x8599c040
Caught exception in looking up space point ptr... 0x8599c040, 0x93fe3910
Caught exception in looking up space point ptr... 0x7b101c40, 0xa09b2f50
Caught exception in looking up space point ptr... 0xa09b2f50, 0x7b0e2540
Caught exception in looking up space point ptr... 0x7d278380, 0x449cd210
Caught exception in looking up space point ptr... 0x7d278510, 0x7d278380
Caught exception in looking up space point ptr... 0x733f5310, 0x502efc30
Caught exception in looking up space point ptr... 0x733f5950, 0x733f5310
Caught exception in looking up space point ptr... 0x809acbe0, 0x809ac730
Caught exception in looking up space point ptr... 0x809acf00, 0x809acbe0
Caught exception in looking up space point ptr... 0x94355550, 0x96876990
Caught exception in looking up space point ptr... 0x96876990, 0x96876b20
Caught exception in looking up space point ptr... 0x939542e0, 0x939b7ec0
Caught exception in looking up space point ptr... 0x724a5510, 0x939542e0
Caught exception in looking up space point ptr... 0x4c13c8c0, 0x4c14b000
Caught exception in looking up space point ptr... 0x4c12dff0, 0x4c13c8c0
Caught exception in looking up space point ptr... 0x6b398ba0, 0x6b386400
Caught exception in looking up space point ptr... 0x6b386400, 0x6b373cb0
Caught exception in looking up space point ptr... 0x750b0750, 0x4887b860
Caught exception in looking up space point ptr... 0x4887b860, 0x4886a240
Caught exception in looking up space point ptr... 0x77101990, 0x48046dc0
Caught exception in looking up space point ptr... 0x48046dc0, 0x48038040
Caught exception in looking up space point ptr... 0x53648d80, 0x5363a190
Caught exception in looking up space point ptr... 0x5363a190, 0x536289e0
Caught exception in looking up space point ptr... 0x8602ccb0, 0x8602d1b0
Caught exception in looking up space point ptr... 0x8602d1b0, 0x8602ccb0
Caught exception in looking up space point ptr... 0x87185750, 0x87185c00
Caught exception in looking up space point ptr... 0x87185c00, 0x87185750
Caught exception in looking up space point ptr... 0xb77f2230, 0xa269a810
Caught exception in looking up space point ptr... 0xa269a810, 0xb77f2230
Caught exception in looking up space point ptr... 0x81936660, 0x9c00f340
Caught exception in looking up space point ptr... 0x9c00f340, 0x81936800
Caught exception in looking up space point ptr... 0x81936800, 0x9c00f490
Caught exception in looking up space point ptr... 0x4e4f9370, 0x4e4f9550
Caught exception in looking up space point ptr... 0x4e4f9550, 0x4e4f9370
Caught exception in looking up space point ptr... 0x98224850, 0x7207d250
Caught exception in looking up space point ptr... 0x7207d250, 0x98224850
Caught exception in looking up space point ptr... 0x8d55d3c0, 0x4309e1c0
Caught exception in looking up space point ptr... 0x4309e1c0, 0x8d55d3c0
Caught exception in looking up space point ptr... 0x949923c0, 0x94992560
Caught exception in looking up space point ptr... 0x94992560, 0x949922c0
Caught exception in looking up space point ptr... 0x5313c130, 0x5313e050
Caught exception in looking up space point ptr... 0x5313e050, 0x5313c130
Caught exception in looking up space point ptr... 0x85952680, 0x9f0709b0
Caught exception in looking up space point ptr... 0x9f0709b0, 0x85952680
Caught exception in looking up space point ptr... 0x8d14b020, 0x8d14ac40
Caught exception in looking up space point ptr... 0x8d14ac40, 0x8d14b020
Caught exception in looking up space point ptr... 0xa2708830, 0x774109f0
Caught exception in looking up space point ptr... 0x774109f0, 0xa2708830
++++>>>> total num hits: 544203, num free: 534489
04-Feb-2026 03:02:49 CET Closed output file "np02vd_raw_run042433_0621_df-s03-d0_dw_0_20260203T223809_reco_stage0_20260204T020249_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 341.94 438.822 533.892 433.468 56.1308 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.4018e-05 0.000113176 0.000329707 0.000102612 5.18531e-05 19
produce:tpcrawdecoder:PDVDTPCReader 118.807 180.508 269.197 182.054 39.1376 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.666164 1.2106 7.03237 0.823496 1.38644 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0175333 0.0328363 0.153078 0.018 0.0319634 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0174884 0.0185273 0.0341221 0.017673 0.00367752 19
produce:beamevent:BeamEvent 0.000100287 0.000212745 0.00119413 0.000131586 0.000251426 19
produce:pdvddaphne:DAPHNEReaderPDVD 9.3163 15.0419 18.7024 14.8708 2.4442 19
produce:ophit:OpHitFinder 0.0395964 0.045403 0.0541605 0.0458537 0.00351194 19
produce:wclsdatavd:WireCellToolkit 117.308 144.424 160.513 149.101 13.2705 19
produce:gaushit:GausHitFinder 1.41117 2.92508 4.25725 3.04118 0.753762 19
produce:nhitsfilter:NumberOfHitsFilter 0.00052876 0.000858937 0.00118325 0.000847376 0.000177464 19
produce:reco3d:SpacePointSolver 17.2224 28.4799 35.8747 28.512 4.37937 19
produce:hitpdune:DisambigFromSpacePoints 0.212229 0.404605 0.626989 0.39232 0.129551 19
produce:cluster3d:Cluster3D 3.99825 56.9312 87.8662 73.5424 32.2228 19
[art]:TriggerResults:TriggerResultInserter 2.3324e-05 4.02961e-05 0.000119344 3.2812e-05 2.40786e-05 19
end_path:out1:RootOutput 3.817e-06 6.71495e-06 3.0747e-05 4.879e-06 6.03385e-06 19
end_path:out1:RootOutput(write) 5.62282 8.75032 10.707 8.24672 1.52935 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5580.82 MB
Peak resident set size usage (VmHWM): 3599.61 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0621_df-s03-d0_dw_0_20260203T223809_reco_stage0_20260204T020249_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0621_df-s03-d0_dw_0_20260203T223809_reco_stage0_20260204T020249_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0621_df-s03-d0_dw_0_20260203T223809_reco_stage0_20260204T020249_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162149.0,
"core.end_time": 1770170571.0,
"core.events": [
70802,
70808,
70814,
70820,
70826,
70832,
70838,
70844,
70850,
70856,
70862,
70868,
70874,
70880,
70886,
70892,
70898,
70904,
70910
],
"core.event_count": 19,
"core.first_event_number": 70802,
"core.last_event_number": 70910,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0621_df-s03-d0_dw_0_20260203T223809.hdf5"
}
]
} 