Jobsub ID 303653.83@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.83@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 00:19:35 |
| From worker node | Hostname | td108.pic.es |
| cpuinfo | AMD EPYC 9825 144-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:40:59 |
| Input files | vd-protodune:np02vd_raw_run042421_0082_df-s02-d1_dw_0_20260203T141522.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 37m (2231s) |
| CPU time | 28m (1719s = 77%) |
| Max RSS bytes | 2507907072 (2391 MiB) |
| Outputting started | 2026-02-04 00:18:11 |
| Output files | |
| Finished | 2026-02-04 00:19:35 |
| Saved logs | justin-logs:303653.83-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0, 0x3b50d740
Caught exception in looking up space point ptr... 0x12368ec0, 0x1236bf30
Caught exception in looking up space point ptr... 0x57507b30, 0x1236cba0
Caught exception in looking up space point ptr... 0x1236cba0, 0x12368ec0
Caught exception in looking up space point ptr... 0x2124bbe0, 0x39b4e540
Caught exception in looking up space point ptr... 0x3d6499d0, 0x2124bbe0
Caught exception in looking up space point ptr... 0x633d7f00, 0x52f04660
Caught exception in looking up space point ptr... 0x52f04660, 0x13224190
Caught exception in looking up space point ptr... 0x5801a3e0, 0x1331f680
Caught exception in looking up space point ptr... 0x1331f680, 0x45484a00
Caught exception in looking up space point ptr... 0x5b3627e0, 0x5e0ed860
Caught exception in looking up space point ptr... 0x5e0ed860, 0x37508570
Caught exception in looking up space point ptr... 0x573e8140, 0x3b54ea10
Caught exception in looking up space point ptr... 0x3b54ea10, 0x3b54e910
Caught exception in looking up space point ptr... 0x15095ea0, 0xe982600
Caught exception in looking up space point ptr... 0xe982600, 0x652bd60
Caught exception in looking up space point ptr... 0xb651a40, 0xb6518b0
Caught exception in looking up space point ptr... 0xb6518b0, 0xb651a40
Caught exception in looking up space point ptr... 0x4d4a71a0, 0x4d4a61c0
Caught exception in looking up space point ptr... 0x4d4a07a0, 0x4d4a5a60
Caught exception in looking up space point ptr... 0x4d4a5a60, 0x4d4a6ef0
Caught exception in looking up space point ptr... 0x4d4a6ef0, 0x4d4a71a0
Caught exception in looking up space point ptr... 0x62c4f2f0, 0x62c4efd0
Caught exception in looking up space point ptr... 0x62c4b180, 0x62c4f2f0
Caught exception in looking up space point ptr... 0xb641240, 0xb6402d0
Caught exception in looking up space point ptr... 0xb6402d0, 0xb640370
Caught exception in looking up space point ptr... 0x46280900, 0x44fbd6b0
Caught exception in looking up space point ptr... 0x44fbd6b0, 0x8e54940
Caught exception in looking up space point ptr... 0x1079fb70, 0x1079f8d0
Caught exception in looking up space point ptr... 0x1079f8d0, 0x1079fb70
Caught exception in looking up space point ptr... 0x41f4d630, 0xb7358d0
Caught exception in looking up space point ptr... 0xb7358d0, 0x41f4d630
Caught exception in looking up space point ptr... 0x41f4d630, 0x41f4d4a0
Caught exception in looking up space point ptr... 0x41f4d4a0, 0x41f4d630
Caught exception in looking up space point ptr... 0xaa96fe0, 0x2b0873f0
Caught exception in looking up space point ptr... 0x2b0873f0, 0xaa96fe0
Caught exception in looking up space point ptr... 0x32dda330, 0x32dda200
Caught exception in looking up space point ptr... 0x32dda200, 0x32dda330
Caught exception in looking up space point ptr... 0x27666380, 0x29cab040
Caught exception in looking up space point ptr... 0x29cab040, 0x29caad20
Caught exception in looking up space point ptr... 0x40df98e0, 0x40df2630
Caught exception in looking up space point ptr... 0x40df2630, 0x40df98e0
Caught exception in looking up space point ptr... 0xb640840, 0xb638ad0
Caught exception in looking up space point ptr... 0xb638ad0, 0xb640840
Caught exception in looking up space point ptr... 0x33b0e120, 0x33b10ae0
Caught exception in looking up space point ptr... 0x33b10ae0, 0x33b0e120
Caught exception in looking up space point ptr... 0x3bc6aaf0, 0x5b28c880
Caught exception in looking up space point ptr... 0x3bc4d390, 0x3bc6aaf0
Caught exception in looking up space point ptr... 0x5a030c50, 0x4d2f5bc0
Caught exception in looking up space point ptr... 0x4d2f5bc0, 0x557daf30
Caught exception in looking up space point ptr... 0x3fdc2810, 0x3fdc2320
Caught exception in looking up space point ptr... 0x3fdc2320, 0x3fdc25c0
Caught exception in looking up space point ptr... 0x293fe870, 0x293fe550
Caught exception in looking up space point ptr... 0x293fe550, 0x293fe870
Caught exception in looking up space point ptr... 0x2768d020, 0x29cb1980
Caught exception in looking up space point ptr... 0x29cb1e30, 0x2768d020
Caught exception in looking up space point ptr... 0x33d99010, 0x107a2750
Caught exception in looking up space point ptr... 0x107a2750, 0x33d99010
Caught exception in looking up space point ptr... 0x33b0e010, 0x33b0ca00
Caught exception in looking up space point ptr... 0x33b0ca00, 0x33b0e010
Caught exception in looking up space point ptr... 0x129b7730, 0x24ae9c80
Caught exception in looking up space point ptr... 0x24ae9c80, 0x129b7730
Caught exception in looking up space point ptr... 0x1079ec90, 0x1079ed70
Caught exception in looking up space point ptr... 0x1079ebb0, 0x1079ec90
Caught exception in looking up space point ptr... 0x281a7280, 0x315064a0
Caught exception in looking up space point ptr... 0x315064a0, 0x281a7280
++++>>>> total num hits: 97868, num free: 95563
04-Feb-2026 01:18:05 CET Closed output file "np02vd_raw_run042421_0082_df-s02-d1_dw_0_20260203T141522_reco_stage0_20260204T001805_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 72.6043 79.4161 111.736 77.5952 7.13945 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.546e-05 0.000111852 0.000324771 9.487e-05 4.74321e-05 27
produce:tpcrawdecoder:PDVDTPCReader 15.7863 17.4097 48.0776 16.3033 6.02043 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.857474 0.905333 0.923504 0.913973 0.0172773 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0294718 0.0305767 0.0407816 0.0298495 0.0026701 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.146215 0.154365 0.177764 0.148221 0.0121547 27
produce:beamevent:BeamEvent 0.00013642 0.000239718 0.00159654 0.000167921 0.000275352 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.16346 2.38851 2.73538 2.40164 0.115056 27
produce:ophit:OpHitFinder 0.0241339 0.032732 0.0400163 0.0328035 0.00375479 27
produce:wclsdatavd:WireCellToolkit 44.297 45.6905 47.611 45.6751 0.785552 27
produce:gaushit:GausHitFinder 0.444698 0.64881 0.860162 0.666835 0.104461 27
produce:nhitsfilter:NumberOfHitsFilter 0.000148411 0.000221139 0.000564452 0.000210401 7.53444e-05 27
produce:reco3d:SpacePointSolver 4.35218 7.79916 13.3717 7.14041 2.26921 27
produce:hitpdune:DisambigFromSpacePoints 0.043605 0.0702722 0.102952 0.0659227 0.0157719 27
produce:cluster3d:Cluster3D 0.730021 1.37842 2.35095 1.19799 0.446937 27
[art]:TriggerResults:TriggerResultInserter 3.221e-05 5.54129e-05 0.000154771 5.155e-05 2.16642e-05 27
end_path:out1:RootOutput 8.34e-06 1.34381e-05 4.217e-05 1.287e-05 5.91311e-06 27
end_path:out1:RootOutput(write) 2.71803 2.88145 3.11544 2.8594 0.111705 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4601.96 MB
Peak resident set size usage (VmHWM): 2507.91 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0082_df-s02-d1_dw_0_20260203T141522_reco_stage0_20260204T001805_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0082_df-s02-d1_dw_0_20260203T141522_reco_stage0_20260204T001805_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0082_df-s02-d1_dw_0_20260203T141522_reco_stage0_20260204T001805_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162065.0,
"core.end_time": 1770164286.0,
"core.events": [
13339,
13345,
13351,
13357,
13363,
13369,
13375,
13381,
13387,
13393,
13399,
13405,
13411,
13417,
13423,
13429,
13435,
13441,
13447,
13453,
13459,
13465,
13471,
13477,
13483,
13489,
13495
],
"core.event_count": 27,
"core.first_event_number": 13339,
"core.last_event_number": 13495,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0082_df-s02-d1_dw_0_20260203T141522.hdf5"
}
]
} 