Jobsub ID 297922.0@dunegpschedd02.fnal.gov
| Jobsub ID | 297922.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce507 |
| Last heartbeat | 2026-02-04 00:59:47 |
| From worker node | Hostname | b9p17p9437.cern.ch |
| cpuinfo | Intel(R) Xeon(R) Silver 4216 CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:56:00 |
| Input files | vd-protodune:np02vd_raw_run042421_0118_df-s03-d1_dw_0_20260203T143451.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (3686s) |
| CPU time | 59m (3595s = 97%) |
| Max RSS bytes | 2600677376 (2480 MiB) |
| Outputting started | 2026-02-04 00:57:28 |
| Output files | |
| Finished | 2026-02-04 00:59:47 |
| Saved logs | justin-logs:297922.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
e10
Caught exception in looking up space point ptr... 0x36e73dd0, 0x36e73c40
Caught exception in looking up space point ptr... 0x36e73c40, 0x36e73dd0
Caught exception in looking up space point ptr... 0xe354290, 0xe353b30
Caught exception in looking up space point ptr... 0xe354100, 0xe354290
Caught exception in looking up space point ptr... 0x3d24d6d0, 0x3fe217e0
Caught exception in looking up space point ptr... 0x341b22c0, 0x3d24d6d0
Caught exception in looking up space point ptr... 0x354b3380, 0x23521740
Caught exception in looking up space point ptr... 0x23521740, 0x354b3f40
Caught exception in looking up space point ptr... 0x539a5400, 0x539a5a30
Caught exception in looking up space point ptr... 0x539a5a30, 0x539a5400
Caught exception in looking up space point ptr... 0x31ef8610, 0x26ee2200
Caught exception in looking up space point ptr... 0x26ee2200, 0x5be494a0
Caught exception in looking up space point ptr... 0x3217b490, 0x3217b160
Caught exception in looking up space point ptr... 0x3217b160, 0x3217b490
Caught exception in looking up space point ptr... 0x3d3cf210, 0x3d3cf580
Caught exception in looking up space point ptr... 0x3d3cf580, 0x3d3cf210
Caught exception in looking up space point ptr... 0x4459cf20, 0x444fd020
Caught exception in looking up space point ptr... 0x444fd020, 0x4459cf20
Caught exception in looking up space point ptr... 0x12d43420, 0x280b9760
Caught exception in looking up space point ptr... 0x280b9760, 0x12d43420
Caught exception in looking up space point ptr... 0x227183c0, 0x2270d080
Caught exception in looking up space point ptr... 0x2270d080, 0x227183c0
Caught exception in looking up space point ptr... 0x23609820, 0x23616f70
Caught exception in looking up space point ptr... 0x23616f70, 0x23609820
Caught exception in looking up space point ptr... 0x3217a840, 0x3217a510
Caught exception in looking up space point ptr... 0x3217a510, 0x3217a840
Caught exception in looking up space point ptr... 0x2271f240, 0x227171a0
Caught exception in looking up space point ptr... 0x227171a0, 0x22729290
Caught exception in looking up space point ptr... 0x22729290, 0x22724df0
Caught exception in looking up space point ptr... 0x243af980, 0x5512b290
Caught exception in looking up space point ptr... 0x5512b290, 0x243af980
Caught exception in looking up space point ptr... 0x3d0b2630, 0x622755c0
Caught exception in looking up space point ptr... 0x622755c0, 0x320a3b90
Caught exception in looking up space point ptr... 0x1febced0, 0x23e5aed0
Caught exception in looking up space point ptr... 0x23e5aed0, 0x1feaf4f0
Caught exception in looking up space point ptr... 0x1feaf4f0, 0x1febe900
Caught exception in looking up space point ptr... 0x1febe900, 0x1feb3320
Caught exception in looking up space point ptr... 0x14331630, 0x61d40cd0
Caught exception in looking up space point ptr... 0x61d40cd0, 0x14331630
Caught exception in looking up space point ptr... 0x2a559400, 0x47433f40
Caught exception in looking up space point ptr... 0x47433f40, 0x2a559400
Caught exception in looking up space point ptr... 0x52bb3570, 0x21321710
Caught exception in looking up space point ptr... 0x62191140, 0x52bb3570
Caught exception in looking up space point ptr... 0x36e61ca0, 0x36a676d0
Caught exception in looking up space point ptr... 0x36a676d0, 0x36e61ca0
Caught exception in looking up space point ptr... 0xe65efd0, 0xe65eef0
Caught exception in looking up space point ptr... 0xe65eef0, 0xe65efd0
Caught exception in looking up space point ptr... 0x4129a1a0, 0x25deeb70
Caught exception in looking up space point ptr... 0x25deeb70, 0x4129a1a0
Caught exception in looking up space point ptr... 0x3bb09310, 0x25353e90
Caught exception in looking up space point ptr... 0x25353e90, 0x4e70fc80
Caught exception in looking up space point ptr... 0x2e0621d0, 0x2e063110
Caught exception in looking up space point ptr... 0x2e063110, 0x2e0621d0
Caught exception in looking up space point ptr... 0x272425c0, 0x3c7f9630
Caught exception in looking up space point ptr... 0x3c7f9630, 0x272425c0
Caught exception in looking up space point ptr... 0x10cd44a0, 0x10cd45c0
Caught exception in looking up space point ptr... 0x10cd45c0, 0x10cd44a0
Caught exception in looking up space point ptr... 0x12ffb4f0, 0xc4f7d20
Caught exception in looking up space point ptr... 0xc4f7d20, 0x12ffb4f0
Caught exception in looking up space point ptr... 0x237f97f0, 0x353e8bf0
Caught exception in looking up space point ptr... 0x353e8bf0, 0x6299e5c0
Caught exception in looking up space point ptr... 0x2e716970, 0x2948adf0
Caught exception in looking up space point ptr... 0x2948adf0, 0x2e716970
Caught exception in looking up space point ptr... 0x23549490, 0x58319a20
Caught exception in looking up space point ptr... 0x58319a20, 0x6294a5d0
++++>>>> total num hits: 59959, num free: 56997
04-Feb-2026 01:57:18 CET Closed output file "np02vd_raw_run042421_0118_df-s03-d1_dw_0_20260203T143451_reco_stage0_20260204T005718_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 123.719 132.713 147.093 131.56 7.15477 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.6604e-05 0.000113959 0.000294925 9.4866e-05 5.52362e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.89215 6.0969 8.33826 6.00944 0.713404 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0104095 0.0201739 0.047472 0.0134112 0.011696 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000489116 0.000776577 0.00383036 0.000669284 0.000609564 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00156173 0.0019652 0.00272317 0.00191061 0.000293603 27
produce:beamevent:BeamEvent 7.9276e-05 0.000159113 0.00122167 0.000117983 0.000209817 27
produce:pdvddaphne:DAPHNEReaderPDVD 5.52243 6.28538 7.50412 6.08052 0.60022 27
produce:ophit:OpHitFinder 0.0435824 0.0531725 0.0807502 0.046504 0.0131824 27
produce:wclsdatavd:WireCellToolkit 89.933 99.1873 113.252 98.7907 6.29236 27
produce:gaushit:GausHitFinder 0.985651 1.49188 2.12508 1.4673 0.30074 27
produce:nhitsfilter:NumberOfHitsFilter 0.00033166 0.000452926 0.000686211 0.00043596 8.19716e-05 27
produce:reco3d:SpacePointSolver 8.66489 12.496 19.4163 12.3003 2.62483 27
produce:hitpdune:DisambigFromSpacePoints 0.0958626 0.158684 0.303437 0.154538 0.0448921 27
produce:cluster3d:Cluster3D 1.08948 2.16342 3.9165 2.01502 0.705624 27
[art]:TriggerResults:TriggerResultInserter 2.8354e-05 4.01369e-05 9.0009e-05 3.7873e-05 1.15647e-05 27
end_path:out1:RootOutput 4.683e-06 4.10619e-05 0.000925385 6.125e-06 0.000173469 27
end_path:out1:RootOutput(write) 4.14314 4.72551 6.16195 4.59176 0.464746 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4561.33 MB
Peak resident set size usage (VmHWM): 2600.68 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0118_df-s03-d1_dw_0_20260203T143451_reco_stage0_20260204T005718_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0118_df-s03-d1_dw_0_20260203T143451_reco_stage0_20260204T005718_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0118_df-s03-d1_dw_0_20260203T143451_reco_stage0_20260204T005718_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162977.0,
"core.end_time": 1770166640.0,
"core.events": [
19185,
19191,
19197,
19203,
19209,
19215,
19221,
19227,
19233,
19239,
19245,
19251,
19257,
19263,
19269,
19275,
19281,
19287,
19293,
19299,
19305,
19311,
19317,
19323,
19329,
19335,
19341
],
"core.event_count": 27,
"core.first_event_number": 19185,
"core.last_event_number": 19341,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0118_df-s03-d1_dw_0_20260203T143451.hdf5"
}
]
} 