Jobsub ID 303649.77@dunegpschedd01.fnal.gov
| Jobsub ID | 303649.77@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:48:26 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk_multicore |
| Last heartbeat | 2026-02-04 01:27:07 |
| From worker node | Hostname | wn-choc-012.farm.nikhef.nl |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:01:08 |
| Input files | vd-protodune:np02vd_raw_run042422_0068_df-s03-d1_dw_0_20260203T155131.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8608s) |
| CPU time | 1h (4758s = 55%) |
| Max RSS bytes | 2729844736 (2603 MiB) |
| Outputting started | 2026-02-04 01:24:38 |
| Output files | |
| Finished | 2026-02-04 01:27:07 |
| Saved logs | justin-logs:303649.77-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
xception in looking up space point ptr... 0x432074e0, 0x432076c0
Caught exception in looking up space point ptr... 0x432076c0, 0x6975b4a0
Caught exception in looking up space point ptr... 0x840fa7a0, 0x6053e7c0
Caught exception in looking up space point ptr... 0x6053e7c0, 0x6053eb10
Caught exception in looking up space point ptr... 0x438a6870, 0x65dced20
Caught exception in looking up space point ptr... 0x65dced20, 0x65dceb40
Caught exception in looking up space point ptr... 0x8c0b6d30, 0x43207a30
Caught exception in looking up space point ptr... 0x43207a30, 0x8c0b6d30
Caught exception in looking up space point ptr... 0x8c0b6d30, 0x43207da0
Caught exception in looking up space point ptr... 0x43207da0, 0x8c0b6d30
Caught exception in looking up space point ptr... 0x783ea820, 0x7a242550
Caught exception in looking up space point ptr... 0x7a242550, 0x783ea820
Caught exception in looking up space point ptr... 0x69467900, 0x8bf2a500
Caught exception in looking up space point ptr... 0x870b3980, 0x6e56e320
Caught exception in looking up space point ptr... 0x6e56e320, 0x4131e180
Caught exception in looking up space point ptr... 0x4131e180, 0x5fe55130
Caught exception in looking up space point ptr... 0x5fe47ee0, 0x69467900
Caught exception in looking up space point ptr... 0x480a0400, 0x480a0310
Caught exception in looking up space point ptr... 0x480a0310, 0x480a0400
Caught exception in looking up space point ptr... 0xa5027040, 0x63d07500
Caught exception in looking up space point ptr... 0x63d07500, 0x9fe57710
Caught exception in looking up space point ptr... 0x4272f110, 0x4f5af5f0
Caught exception in looking up space point ptr... 0x4f6033f0, 0x4272f110
Caught exception in looking up space point ptr... 0x7d550ab0, 0x7b58c600
Caught exception in looking up space point ptr... 0x7b58c600, 0x939de870
Caught exception in looking up space point ptr... 0x7a46d1a0, 0x7a46d330
Caught exception in looking up space point ptr... 0x793319c0, 0x7a46d1a0
Caught exception in looking up space point ptr... 0x7ccfd770, 0x69475930
Caught exception in looking up space point ptr... 0x69475930, 0x7ccfd770
Caught exception in looking up space point ptr... 0x7ccfd770, 0x8ce9bce0
Caught exception in looking up space point ptr... 0x8ce9bce0, 0x7ccfd770
Caught exception in looking up space point ptr... 0x54287c20, 0x4ea1ef10
Caught exception in looking up space point ptr... 0x4ea1ef10, 0x8f566750
Caught exception in looking up space point ptr... 0x97ef4080, 0x97f03da0
Caught exception in looking up space point ptr... 0x97f03da0, 0x97f03f30
Caught exception in looking up space point ptr... 0x832f2c90, 0x5245cba0
Caught exception in looking up space point ptr... 0x5245cba0, 0x5245cd30
Caught exception in looking up space point ptr... 0x6404bd90, 0x41325980
Caught exception in looking up space point ptr... 0x41325980, 0x4f6128c0
Caught exception in looking up space point ptr... 0x85d5ebb0, 0x691b4440
Caught exception in looking up space point ptr... 0x87081fd0, 0x85d5ebb0
Caught exception in looking up space point ptr... 0x783892c0, 0x99a233f0
Caught exception in looking up space point ptr... 0x99a233f0, 0x99a23580
Caught exception in looking up space point ptr... 0x8bab0880, 0x99720c20
Caught exception in looking up space point ptr... 0x6e25f330, 0x8bab0880
Caught exception in looking up space point ptr... 0x75adb820, 0x87e64c10
Caught exception in looking up space point ptr... 0x87e64c10, 0x40013f50
Caught exception in looking up space point ptr... 0x9763c3d0, 0x438e6ab0
Caught exception in looking up space point ptr... 0x757799d0, 0x9763c3d0
Caught exception in looking up space point ptr... 0x8766b3f0, 0x8766b4f0
Caught exception in looking up space point ptr... 0x8766b4f0, 0x8766b3f0
Caught exception in looking up space point ptr... 0x91273e30, 0x75aeffb0
Caught exception in looking up space point ptr... 0x75aeffb0, 0x6915cab0
Caught exception in looking up space point ptr... 0x549e3470, 0x8e671b80
Caught exception in looking up space point ptr... 0x8a9958b0, 0x549e3470
Caught exception in looking up space point ptr... 0x4bda1c20, 0x4ea1a040
Caught exception in looking up space point ptr... 0x4ea1a040, 0x4bda1c20
Caught exception in looking up space point ptr... 0x4320ed30, 0x4320f0f0
Caught exception in looking up space point ptr... 0x4320f0f0, 0x4320f410
Caught exception in looking up space point ptr... 0x65c2d660, 0x4d53dc40
Caught exception in looking up space point ptr... 0x4d53dc40, 0x653ca0c0
Caught exception in looking up space point ptr... 0x7038a630, 0x933fc580
Caught exception in looking up space point ptr... 0x933fc580, 0x7038a630
Caught exception in looking up space point ptr... 0x82c81170, 0x65733130
Caught exception in looking up space point ptr... 0x65733130, 0x82c81170
++++>>>> total num hits: 276507, num free: 270721
04-Feb-2026 02:24:28 CET Closed output file "np02vd_raw_run042422_0068_df-s03-d1_dw_0_20260203T155131_reco_stage0_20260204T012428_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 220.284 315.51 407.203 312.767 40.8118 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000102581 0.000195655 0.00108899 0.000132474 0.00019894 27
produce:tpcrawdecoder:PDVDTPCReader 92.1862 135.221 206.868 129.898 28.6219 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.564215 0.82946 1.59379 0.785486 0.214032 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0172667 0.0209808 0.0347622 0.0202072 0.00383105 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0860324 0.0988283 0.324102 0.0879903 0.0450373 27
produce:beamevent:BeamEvent 0.000113793 0.000273035 0.00137692 0.000222328 0.000224692 27
produce:pdvddaphne:DAPHNEReaderPDVD 11.7018 18.4778 26.871 17.8625 3.49782 27
produce:ophit:OpHitFinder 0.0345052 0.0427611 0.0492077 0.0439818 0.00387395 27
produce:wclsdatavd:WireCellToolkit 96.7049 100.556 105.11 100.11 2.14384 27
produce:gaushit:GausHitFinder 1.19582 1.79196 2.36212 1.78297 0.270559 27
produce:nhitsfilter:NumberOfHitsFilter 0.000265942 0.000472536 0.000924366 0.000420064 0.000141095 27
produce:reco3d:SpacePointSolver 5.79276 10.8888 18.93 10.5236 2.84789 27
produce:hitpdune:DisambigFromSpacePoints 0.102843 0.250243 0.390355 0.25668 0.074417 27
produce:cluster3d:Cluster3D 1.3135 41.8063 60.9869 52.5119 21.3769 27
[art]:TriggerResults:TriggerResultInserter 2.6658e-05 4.34984e-05 9.6304e-05 3.9763e-05 1.46301e-05 27
end_path:out1:RootOutput 6.32e-06 8.82578e-06 2.6604e-05 7.936e-06 3.76611e-06 27
end_path:out1:RootOutput(write) 4.2893 5.48848 6.16808 5.66746 0.521037 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4648.03 MB
Peak resident set size usage (VmHWM): 2729.84 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0068_df-s03-d1_dw_0_20260203T155131_reco_stage0_20260204T012428_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0068_df-s03-d1_dw_0_20260203T155131_reco_stage0_20260204T012428_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0068_df-s03-d1_dw_0_20260203T155131_reco_stage0_20260204T012428_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770159680.0,
"core.end_time": 1770168270.0,
"core.events": [
11025,
11031,
11037,
11043,
11049,
11055,
11061,
11067,
11073,
11079,
11085,
11091,
11097,
11103,
11109,
11115,
11121,
11127,
11133,
11139,
11145,
11151,
11157,
11163,
11169,
11175,
11181
],
"core.event_count": 27,
"core.first_event_number": 11025,
"core.last_event_number": 11181,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0068_df-s03-d1_dw_0_20260203T155131.hdf5"
}
]
} 