Jobsub ID 303696.2@dunegpschedd01.fnal.gov
| Jobsub ID | 303696.2@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 00:24:27 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce16-multicore |
| Last heartbeat | 2026-02-04 02:10:06 |
| From worker node | Hostname | gpu05.pic.es |
| cpuinfo | Intel(R) Xeon(R) Gold 6230R CPU @ 2.10GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:24:56 |
| Input files | vd-protodune:np02vd_raw_run042433_0399_df-s04-d0_dw_0_20260203T211347.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6195s) |
| CPU time | 1h (5797s = 93%) |
| Max RSS bytes | 3382484992 (3225 MiB) |
| Outputting started | 2026-02-04 02:08:13 |
| Output files | |
| Finished | 2026-02-04 02:10:06 |
| Saved logs | justin-logs:303696.2-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
point ptr... 0x3ba7b8a0, 0x3ba7e890
Caught exception in looking up space point ptr... 0x670cf290, 0x670ceff0
Caught exception in looking up space point ptr... 0x670ceff0, 0x670cf290
Caught exception in looking up space point ptr... 0x670cf290, 0x670ceea0
Caught exception in looking up space point ptr... 0x670ceea0, 0x670cf290
Caught exception in looking up space point ptr... 0x1a3b5f70, 0x1acb23f0
Caught exception in looking up space point ptr... 0x67ff40f0, 0x1a3b5f70
Caught exception in looking up space point ptr... 0x60a3d370, 0x61bb63f0
Caught exception in looking up space point ptr... 0x60a3d4d0, 0x60a3d370
Caught exception in looking up space point ptr... 0x63ced420, 0x487ba870
Caught exception in looking up space point ptr... 0x487ba870, 0x63ced420
Caught exception in looking up space point ptr... 0x62ba0170, 0x62b9fed0
Caught exception in looking up space point ptr... 0x62b9fed0, 0x62ba0170
Caught exception in looking up space point ptr... 0x62ba0170, 0x62b9ffb0
Caught exception in looking up space point ptr... 0x62b9ffb0, 0x62ba0170
Caught exception in looking up space point ptr... 0x6814b550, 0x6814b5f0
Caught exception in looking up space point ptr... 0x6814b5f0, 0x6814b550
Caught exception in looking up space point ptr... 0x3bc7d440, 0x37ef6d60
Caught exception in looking up space point ptr... 0x37ef6d60, 0x3c1073d0
Caught exception in looking up space point ptr... 0x696992b0, 0x69699490
Caught exception in looking up space point ptr... 0x69699490, 0x696992b0
Caught exception in looking up space point ptr... 0x3988b1d0, 0x3a023180
Caught exception in looking up space point ptr... 0x3a023180, 0x3988b1d0
Caught exception in looking up space point ptr... 0x67125700, 0x1473df40
Caught exception in looking up space point ptr... 0x1473df40, 0x7ea3d3d0
Caught exception in looking up space point ptr... 0x8bc7650, 0x8bc73b0
Caught exception in looking up space point ptr... 0x8bc73b0, 0x7ca14eb0
Caught exception in looking up space point ptr... 0x38295550, 0x38295230
Caught exception in looking up space point ptr... 0x38295230, 0x38295550
Caught exception in looking up space point ptr... 0x3a9aaeb0, 0x11b1fd80
Caught exception in looking up space point ptr... 0x11b1fd80, 0x7eb0e8b0
Caught exception in looking up space point ptr... 0x18262f90, 0x67a3c510
Caught exception in looking up space point ptr... 0x67a3c510, 0x18262f90
Caught exception in looking up space point ptr... 0x62bb5060, 0x62bb74d0
Caught exception in looking up space point ptr... 0x62bb74d0, 0x62bb8430
Caught exception in looking up space point ptr... 0x1ab15410, 0x3bf0aeb0
Caught exception in looking up space point ptr... 0x3bf0aeb0, 0x1ab15410
Caught exception in looking up space point ptr... 0x1471b660, 0x1471b1b0
Caught exception in looking up space point ptr... 0x1471b1b0, 0x1471b660
Caught exception in looking up space point ptr... 0x1933e250, 0x3ba7e690
Caught exception in looking up space point ptr... 0x3ba7e690, 0x1933e250
Caught exception in looking up space point ptr... 0xe4cde70, 0xe4ce7b0
Caught exception in looking up space point ptr... 0xe4ce0c0, 0xe4cde70
Caught exception in looking up space point ptr... 0x32a101d0, 0x32a10420
Caught exception in looking up space point ptr... 0x32a10420, 0x32a10b10
Caught exception in looking up space point ptr... 0x3c06c610, 0x3bf0ab90
Caught exception in looking up space point ptr... 0x3bf0ab90, 0x3c06c4d0
Caught exception in looking up space point ptr... 0xaeecb00, 0xaeeca10
Caught exception in looking up space point ptr... 0xaeeca10, 0xaeecb00
Caught exception in looking up space point ptr... 0x3bcaf2f0, 0x637db3c0
Caught exception in looking up space point ptr... 0x637db3c0, 0x830d6590
Caught exception in looking up space point ptr... 0x2ad9fc40, 0x831e7790
Caught exception in looking up space point ptr... 0x831e7790, 0x3400e2c0
Caught exception in looking up space point ptr... 0x671622d0, 0x671e4460
Caught exception in looking up space point ptr... 0x671e4460, 0x6715d790
Caught exception in looking up space point ptr... 0x4d134720, 0x15cc2bf0
Caught exception in looking up space point ptr... 0x15cc2bf0, 0x4d134720
Caught exception in looking up space point ptr... 0x4d134720, 0x4d134640
Caught exception in looking up space point ptr... 0x4d134640, 0x4d134720
Caught exception in looking up space point ptr... 0x3a2252d0, 0x3bdacc80
Caught exception in looking up space point ptr... 0x3bdacc80, 0x3a2252d0
Caught exception in looking up space point ptr... 0x2b0b0750, 0x63613900
Caught exception in looking up space point ptr... 0x63613900, 0x2b0b0750
Caught exception in looking up space point ptr... 0x12bc2180, 0x12bc23e0
Caught exception in looking up space point ptr... 0x12bc23e0, 0x12bc2180
Caught exception in looking up space point ptr... 0x12bc2180, 0x12bc2050
Caught exception in looking up space point ptr... 0x12bc2050, 0x12bc2180
++++>>>> total num hits: 84142, num free: 80797
04-Feb-2026 03:08:00 CET Closed output file "np02vd_raw_run042433_0399_df-s04-d0_dw_0_20260203T211347_reco_stage0_20260204T020800_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 271.072 318.797 360.748 316.541 22.5906 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000105075 0.000150073 0.000359374 0.00014176 5.76806e-05 19
produce:tpcrawdecoder:PDVDTPCReader 22.3914 22.9775 23.8431 22.9674 0.389852 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.860225 0.910019 0.944021 0.9107 0.021435 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0297285 0.0324275 0.0420733 0.0300582 0.00425503 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.029768 0.0300726 0.0311094 0.0300248 0.000275216 19
produce:beamevent:BeamEvent 0.000138278 0.000271312 0.00178363 0.00018491 0.000357444 19
produce:pdvddaphne:DAPHNEReaderPDVD 8.3976 9.58375 11.4406 9.34558 0.72373 19
produce:ophit:OpHitFinder 0.0502262 0.0827839 0.0973286 0.0832675 0.011608 19
produce:wclsdatavd:WireCellToolkit 198.653 238.694 276.04 238.33 21.1588 19
produce:gaushit:GausHitFinder 1.98136 3.17394 4.70983 3.08577 0.786177 19
produce:nhitsfilter:NumberOfHitsFilter 0.000502854 0.000966749 0.0019942 0.000850817 0.000363391 19
produce:reco3d:SpacePointSolver 16.1943 27.4917 44.7284 25.9738 7.40304 19
produce:hitpdune:DisambigFromSpacePoints 0.193673 0.50688 0.868491 0.501961 0.17862 19
produce:cluster3d:Cluster3D 2.29395 5.69118 11.0478 4.81939 2.50039 19
[art]:TriggerResults:TriggerResultInserter 3.2052e-05 6.40395e-05 0.000219136 5.1074e-05 4.16415e-05 19
end_path:out1:RootOutput 5.642e-06 1.15027e-05 4.8768e-05 8.676e-06 9.5483e-06 19
end_path:out1:RootOutput(write) 7.08331 9.52606 12.318 9.89179 1.61467 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5384.51 MB
Peak resident set size usage (VmHWM): 3382.48 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0399_df-s04-d0_dw_0_20260203T211347_reco_stage0_20260204T020800_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0399_df-s04-d0_dw_0_20260203T211347_reco_stage0_20260204T020800_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0399_df-s04-d0_dw_0_20260203T211347_reco_stage0_20260204T020800_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164713.0,
"core.end_time": 1770170883.0,
"core.events": [
45496,
45502,
45508,
45514,
45520,
45526,
45532,
45538,
45544,
45550,
45556,
45562,
45568,
45574,
45580,
45586,
45592,
45598,
45604
],
"core.event_count": 19,
"core.first_event_number": 45496,
"core.last_event_number": 45604,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0399_df-s04-d0_dw_0_20260203T211347.hdf5"
}
]
} 