Jobsub ID 303646.64@dunegpschedd01.fnal.gov
| Jobsub ID | 303646.64@dunegpschedd01.fnal.gov |
| Workflow ID | 12718 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:44:24 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_klomp_multicore |
| Last heartbeat | 2026-02-04 00:47:19 |
| From worker node | Hostname | wn-lot-021.farm.nikhef.nl |
| cpuinfo | AMD EPYC 7702P 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:45:55 |
| Input files | vd-protodune:np02vd_raw_run042422_0112_df-s03-d1_dw_0_20260203T161519.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (7149s) |
| CPU time | 42m (2529s = 35%) |
| Max RSS bytes | 2633285632 (2511 MiB) |
| Outputting started | 2026-02-04 00:45:06 |
| Output files | |
| Finished | 2026-02-04 00:47:19 |
| Saved logs | justin-logs:303646.64-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
---------
node 7 has break: 0.0332336, beachPos: 0 (last: 0.0332336), leftArcVal: 1.79769e+308, rightArcVal: 1.79769e+308
left arc x/y: 0/0.434998, right arc x/y: 0/-0.36853
halfEdge: 0x77fa6230, target vtx: 0, face: 0x77fa62b0, twin: 0x77fa6270, twin tgt: 0, twin face: 0x77fa63b0, next: 0, last: 0
****** null vertex!!! Skipping to next node... *********
--------------------------------------------------------------------------------------------
node 8 has leaf: 0x9acf45c0, face: 0x77fa63b0, pos: 0/-0.36853
>>>>> nToKeep: 0, last non infinite entry: 0
>>>>> there are no non infinite faces
Loop over beachline done, saved 5 arcs, encountered 0 bad break points
-- started with 0 vertices, found 0 inside convex hull
==> Found 3 open faces from total of 3
-> all edges, # edges: 1, count: 3
-> open edges, # edges: 1, count: 3
******************************************************************************************************************
******************************************************************************************************************
******************************************************************************************************************
****> vertexList containted 0 vertices
Caught exception in looking up space point ptr... 0x64b06580, 0x4baf0560
Caught exception in looking up space point ptr... 0x4baf0560, 0x45af3ae0
Caught exception in looking up space point ptr... 0x45af3ae0, 0x45af3980
Caught exception in looking up space point ptr... 0x45af3980, 0x61633a00
Caught exception in looking up space point ptr... 0x61633a00, 0x6a75bde0
Caught exception in looking up space point ptr... 0x6a75bde0, 0x785c7910
Caught exception in looking up space point ptr... 0x785c7910, 0x61e66ca0
Caught exception in looking up space point ptr... 0x61e66ca0, 0x64b06580
Caught exception in looking up space point ptr... 0x7c5b6130, 0x44b94600
Caught exception in looking up space point ptr... 0x44b94600, 0x85461f40
Caught exception in looking up space point ptr... 0x616dd070, 0x73afdcd0
Caught exception in looking up space point ptr... 0x73afdcd0, 0x473c6740
Caught exception in looking up space point ptr... 0x4aaa4720, 0x616dd070
Caught exception in looking up space point ptr... 0x6a82aba0, 0x44e3d750
Caught exception in looking up space point ptr... 0x44e3d750, 0x93f73c90
Caught exception in looking up space point ptr... 0x68d80ce0, 0x7d810210
Caught exception in looking up space point ptr... 0x7d810210, 0x68d80ce0
Caught exception in looking up space point ptr... 0x77b7d470, 0x4fa82f70
Caught exception in looking up space point ptr... 0x4fa82f70, 0x65bebf20
Caught exception in looking up space point ptr... 0x5fc425b0, 0x77b7d470
Caught exception in looking up space point ptr... 0x6b4051d0, 0x841a7f40
Caught exception in looking up space point ptr... 0x841a7f40, 0x6d68c780
Caught exception in looking up space point ptr... 0x84b16c50, 0x97089760
Caught exception in looking up space point ptr... 0x97089760, 0x84b16c50
Caught exception in looking up space point ptr... 0x45b8bee0, 0x604adb40
Caught exception in looking up space point ptr... 0x604adb40, 0x45b8bee0
Caught exception in looking up space point ptr... 0x68f95060, 0x68f94ed0
Caught exception in looking up space point ptr... 0x68f94ed0, 0x68f95060
Caught exception in looking up space point ptr... 0x70fdb040, 0x4c0bd070
Caught exception in looking up space point ptr... 0x4c0bd070, 0x5b4bcbe0
Caught exception in looking up space point ptr... 0x4e61e2d0, 0x6d923850
Caught exception in looking up space point ptr... 0x6d923850, 0x6d6d4940
Caught exception in looking up space point ptr... 0x472972d0, 0x9a98ff00
Caught exception in looking up space point ptr... 0x9a98ff00, 0x419476c0
Caught exception in looking up space point ptr... 0x6a824c60, 0x4fb02290
Caught exception in looking up space point ptr... 0x4fb02290, 0x6a824c60
Caught exception in looking up space point ptr... 0x73c1c520, 0x8036f6e0
Caught exception in looking up space point ptr... 0x8036f6e0, 0x73c1c520
Caught exception in looking up space point ptr... 0x6047f440, 0x608d4cc0
Caught exception in looking up space point ptr... 0x608d4cc0, 0x6047f440
Caught exception in looking up space point ptr... 0x772e8790, 0x42e77970
Caught exception in looking up space point ptr... 0x42e77970, 0x772e8790
Caught exception in looking up space point ptr... 0x712cb3c0, 0x49c957f0
Caught exception in looking up space point ptr... 0x49c957f0, 0x712cb3c0
Caught exception in looking up space point ptr... 0x65ae2b20, 0x4c9d0b80
Caught exception in looking up space point ptr... 0x4c9d0b80, 0x65ae2b20
Caught exception in looking up space point ptr... 0x917dd0e0, 0x43fefb70
Caught exception in looking up space point ptr... 0x43fefb70, 0x917dd0e0
++++>>>> total num hits: 26095, num free: 25032
04-Feb-2026 01:44:58 CET Closed output file "np02vd_raw_run042422_0112_df-s03-d1_dw_0_20260203T161519_reco_stage0_20260204T004458_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 183.29 261.492 351.32 259.706 40.0165 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.7295e-05 0.000112526 0.000326351 0.000103424 4.46443e-05 27
produce:tpcrawdecoder:PDVDTPCReader 89.0247 155.579 233.949 151.971 34.35 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.557753 0.995724 3.94463 0.841452 0.602022 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.017317 0.0212513 0.0522122 0.0180654 0.00761269 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0855007 0.0943798 0.132689 0.0881614 0.0113223 27
produce:beamevent:BeamEvent 8.5129e-05 0.000164437 0.00117759 0.000127429 0.000200288 27
produce:pdvddaphne:DAPHNEReaderPDVD 13.7108 20.0881 28.3698 19.1875 4.03866 27
produce:ophit:OpHitFinder 0.0376216 0.0586016 0.07051 0.0588223 0.00778427 27
produce:wclsdatavd:WireCellToolkit 60.5335 63.5552 68.8058 63.389 2.09256 27
produce:gaushit:GausHitFinder 0.371921 0.828505 1.27407 0.814944 0.207111 27
produce:nhitsfilter:NumberOfHitsFilter 0.000219742 0.000666481 0.00140588 0.000707055 0.000301097 27
produce:reco3d:SpacePointSolver 3.35264 9.5658 15.4032 9.3003 2.81018 27
produce:hitpdune:DisambigFromSpacePoints 0.0301103 0.0945647 0.169455 0.0900349 0.029319 27
produce:cluster3d:Cluster3D 0.835349 2.67839 5.83963 2.67621 1.18856 27
[art]:TriggerResults:TriggerResultInserter 2.5247e-05 3.67344e-05 0.00012787 3.226e-05 1.84418e-05 27
end_path:out1:RootOutput 5.029e-06 6.95619e-06 3.3482e-05 5.921e-06 5.25894e-06 27
end_path:out1:RootOutput(write) 6.22126 7.89884 9.27945 8.04607 0.733711 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4589.36 MB
Peak resident set size usage (VmHWM): 2633.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042422_0112_df-s03-d1_dw_0_20260203T161519_reco_stage0_20260204T004458_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042422_0112_df-s03-d1_dw_0_20260203T161519_reco_stage0_20260204T004458_offline.root
Ran successfully
{
"name": "np02vd_raw_run042422_0112_df-s03-d1_dw_0_20260203T161519_reco_stage0_20260204T004458_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158767.0,
"core.end_time": 1770165900.0,
"core.events": [
18159,
18165,
18171,
18177,
18183,
18189,
18195,
18201,
18207,
18213,
18219,
18225,
18231,
18237,
18243,
18249,
18255,
18261,
18267,
18273,
18279,
18285,
18291,
18297,
18303,
18309,
18315
],
"core.event_count": 27,
"core.first_event_number": 18159,
"core.last_event_number": 18315,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42422
],
"core.runs_subruns": [
4242200001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042422_0112_df-s03-d1_dw_0_20260203T161519.hdf5"
}
]
} 