Jobsub ID 303654.98@dunegpschedd01.fnal.gov
| Jobsub ID | 303654.98@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:26 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 01:35:02 |
| From worker node | Hostname | hnode59.pic.es |
| cpuinfo | AMD EPYC 7402P 24-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:08:36 |
| Input files | vd-protodune:np02vd_raw_run042433_0541_df-s04-d0_dw_0_20260203T220744.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5036s) |
| CPU time | 1h (4634s = 92%) |
| Max RSS bytes | 8125902848 (7749 MiB) |
| Outputting started | 2026-02-04 01:32:35 |
| Output files | |
| Finished | 2026-02-04 01:35:02 |
| Saved logs | justin-logs:303654.98-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
r... 0x6a764b40, 0x6a746e00
Caught exception in looking up space point ptr... 0x6a746e00, 0x6a764b40
Caught exception in looking up space point ptr... 0x655e7c00, 0x655e7ff0
Caught exception in looking up space point ptr... 0x655e7ff0, 0x655e7c00
Caught exception in looking up space point ptr... 0x337e4140, 0x337e3ef0
Caught exception in looking up space point ptr... 0x337e3ef0, 0x337e4840
Caught exception in looking up space point ptr... 0x4e21c870, 0x4e383fc0
Caught exception in looking up space point ptr... 0x4e383fc0, 0x340c7770
Caught exception in looking up space point ptr... 0x6800ec70, 0x6800edb0
Caught exception in looking up space point ptr... 0x6800edb0, 0x6800ec70
Caught exception in looking up space point ptr... 0x6187e9d0, 0x11ecc780
Caught exception in looking up space point ptr... 0x11ecc780, 0x6187e9d0
Caught exception in looking up space point ptr... 0x4e6b66c0, 0x4e6b3910
Caught exception in looking up space point ptr... 0x4e6b3910, 0x4e6b66c0
Caught exception in looking up space point ptr... 0x32e67a30, 0x3bbc9cf0
Caught exception in looking up space point ptr... 0x3bbc9cf0, 0x32e67a30
Caught exception in looking up space point ptr... 0x6a2ad550, 0x3737bfe0
Caught exception in looking up space point ptr... 0x3737bfe0, 0x6a2ad550
Caught exception in looking up space point ptr... 0x7eb03f70, 0x7eb01d50
Caught exception in looking up space point ptr... 0x7eb01d50, 0x7eafd4a0
Caught exception in looking up space point ptr... 0x61882ea0, 0x337e84f0
Caught exception in looking up space point ptr... 0x337e84f0, 0x61882ea0
Caught exception in looking up space point ptr... 0x116c3e70, 0x116dcf60
Caught exception in looking up space point ptr... 0x116dcf60, 0x116c3e70
Caught exception in looking up space point ptr... 0x585ae360, 0x585ae240
Caught exception in looking up space point ptr... 0x585ae240, 0x585ae360
Caught exception in looking up space point ptr... 0x6a264800, 0x6ab3b060
Caught exception in looking up space point ptr... 0x6ab3b060, 0x6a264800
Caught exception in looking up space point ptr... 0x19bd6e00, 0x69ffa130
Caught exception in looking up space point ptr... 0x69ffa130, 0x19bd6e00
Caught exception in looking up space point ptr... 0x695b8a70, 0x695c0dc0
Caught exception in looking up space point ptr... 0x695c0dc0, 0x695b8a70
Caught exception in looking up space point ptr... 0xaff9f5a0, 0x89a8d10
Caught exception in looking up space point ptr... 0x89a8d10, 0xaff9f5a0
Caught exception in looking up space point ptr... 0x56de3b80, 0x337ff7f0
Caught exception in looking up space point ptr... 0x337ff7f0, 0x56de3b80
Caught exception in looking up space point ptr... 0x4e35c110, 0x4e35bdf0
Caught exception in looking up space point ptr... 0x4e35bdf0, 0x4e35bc60
Caught exception in looking up space point ptr... 0x5ea97d80, 0x7daa43b0
Caught exception in looking up space point ptr... 0x7daa43b0, 0xd411da0
Caught exception in looking up space point ptr... 0x6a0ce670, 0x5ea97d80
Caught exception in looking up space point ptr... 0x2bca8390, 0x35e210a0
Caught exception in looking up space point ptr... 0x35e210a0, 0x2bca8390
Caught exception in looking up space point ptr... 0x37cea160, 0x30059560
Caught exception in looking up space point ptr... 0x30059560, 0x4273d300
Caught exception in looking up space point ptr... 0x3f04dcc0, 0x3f04db90
Caught exception in looking up space point ptr... 0x3f04db90, 0x3f04dcc0
Caught exception in looking up space point ptr... 0x4e6b8700, 0x1b10aec0
Caught exception in looking up space point ptr... 0x1b10aec0, 0x89ca700
Caught exception in looking up space point ptr... 0x585b6290, 0x585b4670
Caught exception in looking up space point ptr... 0x585b4670, 0x585b6290
Caught exception in looking up space point ptr... 0xd88ef800, 0xd88ef6b0
Caught exception in looking up space point ptr... 0xd88ef6b0, 0xd88ef800
Caught exception in looking up space point ptr... 0x7db0e1b0, 0x585b6bf0
Caught exception in looking up space point ptr... 0x585b6bf0, 0x7db0e1b0
Caught exception in looking up space point ptr... 0xadc0d5d0, 0xadc0f2a0
Caught exception in looking up space point ptr... 0xadc0f2a0, 0x65017060
Caught exception in looking up space point ptr... 0xc869afb0, 0xe7921120
Caught exception in looking up space point ptr... 0xe7921120, 0xc869aae0
Caught exception in looking up space point ptr... 0x33a846e0, 0x33a844e0
Caught exception in looking up space point ptr... 0x33a844e0, 0x33a845e0
Caught exception in looking up space point ptr... 0x42650800, 0x6b70c680
Caught exception in looking up space point ptr... 0x6b70c680, 0x42650800
Caught exception in looking up space point ptr... 0x116c02f0, 0x116bfac0
Caught exception in looking up space point ptr... 0x116bfac0, 0x116c02f0
Caught exception in looking up space point ptr... 0x6fb948d0, 0x6fb94be0
Caught exception in looking up space point ptr... 0x6fb94be0, 0x63610250
++++>>>> total num hits: 109846, num free: 105939
04-Feb-2026 02:32:26 CET Closed output file "np02vd_raw_run042433_0541_df-s04-d0_dw_0_20260203T220744_reco_stage0_20260204T013226_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 146.653 260.702 741.489 161.482 194.864 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.5002e-05 0.000109624 0.000403633 9.5313e-05 7.11897e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.9337 19.9016 21.2282 19.937 0.552252 19
produce:triggerrawdecoder:PDVDTriggerReader4 1.02536 1.06396 1.13538 1.06102 0.0310219 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0341958 0.0390735 0.0520386 0.0349102 0.00617858 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0341856 0.034744 0.0356679 0.0347389 0.00033181 19
produce:beamevent:BeamEvent 5.0672e-05 0.000175603 0.00113074 0.000122424 0.000227963 19
produce:pdvddaphne:DAPHNEReaderPDVD 2.5484 2.93403 3.17053 3.03023 0.198289 19
produce:ophit:OpHitFinder 0.0221651 0.0308023 0.0383663 0.030703 0.00499362 19
produce:wclsdatavd:WireCellToolkit 100.018 107.028 112.307 106.992 3.50389 19
produce:gaushit:GausHitFinder 1.21737 2.14823 5.2374 1.54392 1.21697 19
produce:nhitsfilter:NumberOfHitsFilter 0.000449034 0.000908402 0.00171858 0.000863338 0.000353654 19
produce:reco3d:SpacePointSolver 11.6297 24.5767 60.0313 21.3449 12.8974 19
produce:hitpdune:DisambigFromSpacePoints 0.163462 0.505038 1.82571 0.206449 0.527995 19
produce:cluster3d:Cluster3D 2.2074 95.7387 531.626 3.40011 175.617 19
[art]:TriggerResults:TriggerResultInserter 2.1431e-05 3.64992e-05 8.7503e-05 2.5481e-05 1.84453e-05 19
end_path:out1:RootOutput 3.59e-06 6.58853e-06 2.0861e-05 4.23e-06 4.84499e-06 19
end_path:out1:RootOutput(write) 4.45508 6.6011 14.7897 4.70527 3.4861 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 10113.7 MB
Peak resident set size usage (VmHWM): 8125.9 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0541_df-s04-d0_dw_0_20260203T220744_reco_stage0_20260204T013226_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0541_df-s04-d0_dw_0_20260203T220744_reco_stage0_20260204T013226_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0541_df-s04-d0_dw_0_20260203T220744_reco_stage0_20260204T013226_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163725.0,
"core.end_time": 1770168747.0,
"core.events": [
61684,
61690,
61696,
61702,
61708,
61714,
61720,
61726,
61732,
61738,
61744,
61750,
61756,
61762,
61768,
61774,
61780,
61786,
61792
],
"core.event_count": 19,
"core.first_event_number": 61684,
"core.last_event_number": 61792,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0541_df-s04-d0_dw_0_20260203T220744.hdf5"
}
]
} 