Jobsub ID 303656.152@dunegpschedd01.fnal.gov
| Jobsub ID | 303656.152@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:56:25 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 01:50:44 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:15:20 |
| Input files | vd-protodune:np02vd_raw_run042421_0116_df-s03-d1_dw_0_20260203T143345.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5607s) |
| CPU time | 1h (5086s = 90%) |
| Max RSS bytes | 2579918848 (2460 MiB) |
| Outputting started | 2026-02-04 01:48:49 |
| Output files | |
| Finished | 2026-02-04 01:50:44 |
| Saved logs | justin-logs:303656.152-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0xf4709a0, 0x1554ee40
Caught exception in looking up space point ptr... 0x1554ee40, 0x35ab69f0
Caught exception in looking up space point ptr... 0x2230f9c0, 0x4c7bd0c0
Caught exception in looking up space point ptr... 0x4c7bd0c0, 0x2230f830
Caught exception in looking up space point ptr... 0x3db5e240, 0x1133b6e0
Caught exception in looking up space point ptr... 0x1133b6e0, 0x1133b870
Caught exception in looking up space point ptr... 0x2880f3a0, 0x2fca8d20
Caught exception in looking up space point ptr... 0x2fca8d20, 0x2880f3a0
Caught exception in looking up space point ptr... 0x3aa374c0, 0x2d2a3a30
Caught exception in looking up space point ptr... 0x2d2a3a30, 0x3aa374c0
Caught exception in looking up space point ptr... 0x4f2e82e0, 0x4f2ee810
Caught exception in looking up space point ptr... 0x4f2ee810, 0x4f2f0b10
Caught exception in looking up space point ptr... 0x130d8160, 0x1002f450
Caught exception in looking up space point ptr... 0x1002f450, 0x130d1f50
Caught exception in looking up space point ptr... 0x7471300, 0x7471260
Caught exception in looking up space point ptr... 0x27f1e5e0, 0x7471300
Caught exception in looking up space point ptr... 0x7471300, 0x23740730
Caught exception in looking up space point ptr... 0x23740860, 0x7471300
Caught exception in looking up space point ptr... 0x2d0fd590, 0x2d0fd270
Caught exception in looking up space point ptr... 0x2de0d850, 0x2d0fd590
Caught exception in looking up space point ptr... 0x519b43b0, 0x519b35a0
Caught exception in looking up space point ptr... 0x519b3a70, 0x519b43b0
Caught exception in looking up space point ptr... 0x43d3fcb0, 0x929a640
Caught exception in looking up space point ptr... 0x929a640, 0x43d3fcb0
Caught exception in looking up space point ptr... 0x50762c50, 0xd765810
Caught exception in looking up space point ptr... 0xd765810, 0x50762ac0
Caught exception in looking up space point ptr... 0x373e8980, 0x373e8b60
Caught exception in looking up space point ptr... 0x373e8b60, 0x50337630
Caught exception in looking up space point ptr... 0xc8ea300, 0xa15de80
Caught exception in looking up space point ptr... 0xa15de80, 0xc8ea300
Caught exception in looking up space point ptr... 0x3dce19f0, 0x3f6177c0
Caught exception in looking up space point ptr... 0x3f6177c0, 0x5602a7a0
Caught exception in looking up space point ptr... 0x4180a8e0, 0xc7e9fb0
Caught exception in looking up space point ptr... 0xc7e9fb0, 0x4180a8e0
Caught exception in looking up space point ptr... 0x41599c90, 0x25873c50
Caught exception in looking up space point ptr... 0x25873c50, 0x93888c0
Caught exception in looking up space point ptr... 0x4ec084c0, 0x116163e0
Caught exception in looking up space point ptr... 0x116163e0, 0x116164e0
Caught exception in looking up space point ptr... 0x3db80dc0, 0x3db814c0
Caught exception in looking up space point ptr... 0x3db7f9e0, 0x3db80dc0
Caught exception in looking up space point ptr... 0x957a760, 0x956b350
Caught exception in looking up space point ptr... 0x956b350, 0x957a760
Caught exception in looking up space point ptr... 0x2a050af0, 0x2a054340
Caught exception in looking up space point ptr... 0x2a054340, 0x2a050af0
Caught exception in looking up space point ptr... 0x2f4f1ab0, 0x3e46cd70
Caught exception in looking up space point ptr... 0x3e46cd70, 0x2f4f1ab0
Caught exception in looking up space point ptr... 0xd911fd0, 0xd90f030
Caught exception in looking up space point ptr... 0xd90f030, 0xd90e800
Caught exception in looking up space point ptr... 0x546d6880, 0x34094650
Caught exception in looking up space point ptr... 0x34094650, 0x546d6880
Caught exception in looking up space point ptr... 0x4603cbb0, 0x29ebcf00
Caught exception in looking up space point ptr... 0x29ebcf00, 0x29ebd650
Caught exception in looking up space point ptr... 0xcfa4970, 0xcfa7800
Caught exception in looking up space point ptr... 0xcfa7bc0, 0xcfa4970
Caught exception in looking up space point ptr... 0x4074c040, 0x34246720
Caught exception in looking up space point ptr... 0x34246720, 0x4074c040
Caught exception in looking up space point ptr... 0x4074c040, 0x32ed2490
Caught exception in looking up space point ptr... 0x32ed2490, 0x4074c040
Caught exception in looking up space point ptr... 0x4074c040, 0x3aee3170
Caught exception in looking up space point ptr... 0x3aee3170, 0x4074c040
Caught exception in looking up space point ptr... 0x11fe5d80, 0x4abec130
Caught exception in looking up space point ptr... 0x4abec130, 0x11fe5d80
Caught exception in looking up space point ptr... 0x4f347440, 0x5ec25130
Caught exception in looking up space point ptr... 0x5ec25130, 0x4f347440
Caught exception in looking up space point ptr... 0x35a96a30, 0x2d1b5d10
Caught exception in looking up space point ptr... 0x2d1b5d10, 0x35a96a30
++++>>>> total num hits: 61174, num free: 58853
04-Feb-2026 02:48:36 CET Closed output file "np02vd_raw_run042421_0116_df-s03-d1_dw_0_20260203T143345_reco_stage0_20260204T014836_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 164.776 202.274 225.966 207.081 13.7189 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 9.4679e-05 0.000145275 0.000394232 0.000135878 5.09479e-05 27
produce:tpcrawdecoder:PDVDTPCReader 18.1692 19.3159 24.4262 19.1695 1.05231 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.887002 0.920601 0.948055 0.92138 0.0139685 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0298342 0.0305835 0.0456455 0.029964 0.00295895 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.14747 0.150313 0.177588 0.148067 0.00768025 27
produce:beamevent:BeamEvent 0.000154491 0.000244856 0.00169987 0.000188852 0.000285935 27
produce:pdvddaphne:DAPHNEReaderPDVD 8.84511 9.79123 11.4312 9.69955 0.645428 27
produce:ophit:OpHitFinder 0.0636435 0.0831954 0.0972838 0.0821898 0.00804812 27
produce:wclsdatavd:WireCellToolkit 104.266 138.09 162.257 141.256 11.8325 27
produce:gaushit:GausHitFinder 1.37894 2.14897 3.12734 2.15755 0.439709 27
produce:nhitsfilter:NumberOfHitsFilter 0.000435206 0.000840359 0.00198831 0.000790565 0.000306377 27
produce:reco3d:SpacePointSolver 13.7246 20.6027 28.565 20.4133 3.86297 27
produce:hitpdune:DisambigFromSpacePoints 0.164303 0.282846 0.482345 0.270442 0.0843043 27
produce:cluster3d:Cluster3D 1.8675 3.63005 6.61438 3.40359 1.17912 27
[art]:TriggerResults:TriggerResultInserter 3.5591e-05 6.16863e-05 0.00012757 5.9841e-05 2.07219e-05 27
end_path:out1:RootOutput 5.286e-06 9.88048e-06 3.3004e-05 8.501e-06 5.63298e-06 27
end_path:out1:RootOutput(write) 4.92106 7.16373 8.94833 7.51183 1.21783 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4559.77 MB
Peak resident set size usage (VmHWM): 2579.92 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0116_df-s03-d1_dw_0_20260203T143345_reco_stage0_20260204T014836_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0116_df-s03-d1_dw_0_20260203T143345_reco_stage0_20260204T014836_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0116_df-s03-d1_dw_0_20260203T143345_reco_stage0_20260204T014836_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164134.0,
"core.end_time": 1770169718.0,
"core.events": [
18861,
18867,
18873,
18879,
18885,
18891,
18897,
18903,
18909,
18915,
18921,
18927,
18933,
18939,
18945,
18951,
18957,
18963,
18969,
18975,
18981,
18987,
18993,
18999,
19005,
19011,
19017
],
"core.event_count": 27,
"core.first_event_number": 18861,
"core.last_event_number": 19017,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0116_df-s03-d1_dw_0_20260203T143345.hdf5"
}
]
} 