Jobsub ID 303698.2@dunegpschedd01.fnal.gov
| Jobsub ID | 303698.2@dunegpschedd01.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-04 00:26:28 |
| Site | ES_PIC |
| Entry | DUNE_T1_ES_PIC_ce15-multicore |
| Last heartbeat | 2026-02-04 01:24:40 |
| From worker node | Hostname | tdm003.pic.es |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:27:07 |
| Input files | vd-protodune:np02vd_raw_run042433_0350_df-s03-d0_dw_0_20260203T205508.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 56m (3362s) |
| CPU time | 49m (2955s = 87%) |
| Max RSS bytes | 3407282176 (3249 MiB) |
| Outputting started | 2026-02-04 01:23:10 |
| Output files | |
| Finished | 2026-02-04 01:24:40 |
| Saved logs | justin-logs:303698.2-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
ce point ptr... 0x5e850090, 0x372e1e70
Caught exception in looking up space point ptr... 0x372e1e70, 0x5e850090
Caught exception in looking up space point ptr... 0x7f80cc00, 0x7f80c8e0
Caught exception in looking up space point ptr... 0x7f80c8e0, 0x7f8090e0
Caught exception in looking up space point ptr... 0x557aac30, 0x557aab30
Caught exception in looking up space point ptr... 0x557aab30, 0x557aac30
Caught exception in looking up space point ptr... 0x9bab7f0, 0x9baabd0
Caught exception in looking up space point ptr... 0x9baabd0, 0x9bab7f0
Caught exception in looking up space point ptr... 0x9bab7f0, 0x9ba7990
Caught exception in looking up space point ptr... 0x9ba7990, 0x9bab7f0
Caught exception in looking up space point ptr... 0x330650f0, 0x33064ff0
Caught exception in looking up space point ptr... 0x33064ff0, 0x33064ef0
Caught exception in looking up space point ptr... 0x14613af0, 0xa2f9950
Caught exception in looking up space point ptr... 0xa2f9950, 0xa2f3a10
Caught exception in looking up space point ptr... 0x424379c0, 0x3d198e00
Caught exception in looking up space point ptr... 0x3d198e00, 0x3d198f20
Caught exception in looking up space point ptr... 0x5b34cb70, 0x5b34d690
Caught exception in looking up space point ptr... 0x5b34d690, 0x5b34cb70
Caught exception in looking up space point ptr... 0x1478c190, 0x37df2670
Caught exception in looking up space point ptr... 0x37df2670, 0x1478c190
Caught exception in looking up space point ptr... 0x1478c190, 0x1478c290
Caught exception in looking up space point ptr... 0x1478c290, 0x1478c190
Caught exception in looking up space point ptr... 0x5fe19670, 0x5fe19030
Caught exception in looking up space point ptr... 0x5fe19030, 0x5fe194e0
Caught exception in looking up space point ptr... 0x5fe18ea0, 0x5fe191c0
Caught exception in looking up space point ptr... 0x5fe191c0, 0x5fe19350
Caught exception in looking up space point ptr... 0x5fe19350, 0x5fe19670
Caught exception in looking up space point ptr... 0x3cb40f60, 0x38e81f40
Caught exception in looking up space point ptr... 0x38e81f40, 0x3cb40f60
Caught exception in looking up space point ptr... 0x397aa240, 0x397aa3e0
Caught exception in looking up space point ptr... 0x397aa3e0, 0x397aa240
Caught exception in looking up space point ptr... 0x6db9bbd0, 0x423cc610
Caught exception in looking up space point ptr... 0x423cc610, 0x6db9bbd0
Caught exception in looking up space point ptr... 0x3b558890, 0x42cd5e50
Caught exception in looking up space point ptr... 0x42cd5e50, 0x6eb56a30
Caught exception in looking up space point ptr... 0x3abb1070, 0x4b0e3f90
Caught exception in looking up space point ptr... 0x4b0e3f90, 0x3abb1070
Caught exception in looking up space point ptr... 0x5fe17c50, 0x5fe17710
Caught exception in looking up space point ptr... 0x5fe17710, 0x5fe17c50
Caught exception in looking up space point ptr... 0x5fdfe820, 0x5fdfe6d0
Caught exception in looking up space point ptr... 0x5fdfe6d0, 0x5fdfe820
Caught exception in looking up space point ptr... 0x7b3f9060, 0x7b3f8f10
Caught exception in looking up space point ptr... 0x7b3f8f10, 0x7b3f9060
Caught exception in looking up space point ptr... 0x330775a0, 0x18b1e870
Caught exception in looking up space point ptr... 0x449469c0, 0x330775a0
Caught exception in looking up space point ptr... 0x18b4c340, 0x18b569e0
Caught exception in looking up space point ptr... 0x18b569e0, 0x18b4c340
Caught exception in looking up space point ptr... 0x15a54930, 0x15a545e0
Caught exception in looking up space point ptr... 0x15a545e0, 0x15a54930
Caught exception in looking up space point ptr... 0x5fdf3040, 0x5fdf2eb0
Caught exception in looking up space point ptr... 0x5fdf2eb0, 0x5fdf3040
Caught exception in looking up space point ptr... 0x37582d60, 0x53237430
Caught exception in looking up space point ptr... 0x53237430, 0x37582d60
Caught exception in looking up space point ptr... 0x1899cc50, 0x1899cb20
Caught exception in looking up space point ptr... 0x1899cb20, 0x88f2000
Caught exception in looking up space point ptr... 0x557c4610, 0x557c42f0
Caught exception in looking up space point ptr... 0x557c42f0, 0x557c4610
Caught exception in looking up space point ptr... 0x600c5390, 0x61d64630
Caught exception in looking up space point ptr... 0x61d64630, 0x61d64760
Caught exception in looking up space point ptr... 0x428d4ed0, 0x4b1d8f60
Caught exception in looking up space point ptr... 0x4b1d8f60, 0x4bfd8530
Caught exception in looking up space point ptr... 0x38e8d360, 0x6ec25eb0
Caught exception in looking up space point ptr... 0x6ec25eb0, 0x38e8d360
Caught exception in looking up space point ptr... 0x737f6840, 0x737f6670
Caught exception in looking up space point ptr... 0x737f6670, 0x737f6840
Caught exception in looking up space point ptr... 0x51552a40, 0x51552d40
Caught exception in looking up space point ptr... 0x51552d40, 0xcc14db0
++++>>>> total num hits: 80480, num free: 77187
04-Feb-2026 02:23:02 CET Closed output file "np02vd_raw_run042433_0350_df-s03-d0_dw_0_20260203T205508_reco_stage0_20260204T012302_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 162.588 172.841 196.403 170.813 9.49581 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 7.2831e-05 0.000112007 0.000236494 9.9922e-05 4.18602e-05 19
produce:tpcrawdecoder:PDVDTPCReader 18.7791 21.0431 24.7549 19.6908 2.17568 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.888055 0.91171 0.963058 0.908076 0.0206191 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.029324 0.0301474 0.0362326 0.0298662 0.00145149 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0292537 0.0297952 0.0302012 0.029843 0.000247227 19
produce:beamevent:BeamEvent 6.1151e-05 0.000154513 0.000965826 0.000109142 0.000192845 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.16593 3.45763 3.70256 3.44831 0.164862 19
produce:ophit:OpHitFinder 0.0307602 0.0365399 0.0406385 0.0368219 0.00244606 19
produce:wclsdatavd:WireCellToolkit 109.984 115.638 131.479 115.023 4.79747 19
produce:gaushit:GausHitFinder 1.20074 1.5536 2.11961 1.56849 0.234189 19
produce:nhitsfilter:NumberOfHitsFilter 0.000343936 0.000586158 0.000987698 0.000550729 0.000201177 19
produce:reco3d:SpacePointSolver 14.3342 21.3594 34.1024 20.1482 5.50308 19
produce:hitpdune:DisambigFromSpacePoints 0.171693 0.225408 0.364591 0.217024 0.0508096 19
produce:cluster3d:Cluster3D 1.77436 2.95083 9.42577 2.50084 1.691 19
[art]:TriggerResults:TriggerResultInserter 2.4771e-05 3.41896e-05 0.000102151 2.836e-05 1.70829e-05 19
end_path:out1:RootOutput 3.61e-06 1.99362e-05 0.000243375 6.22e-06 5.28746e-05 19
end_path:out1:RootOutput(write) 5.23705 5.55779 6.36006 5.46392 0.290055 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5375.6 MB
Peak resident set size usage (VmHWM): 3407.28 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0350_df-s03-d0_dw_0_20260203T205508_reco_stage0_20260204T012302_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0350_df-s03-d0_dw_0_20260203T205508_reco_stage0_20260204T012302_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0350_df-s03-d0_dw_0_20260203T205508_reco_stage0_20260204T012302_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770164837.0,
"core.end_time": 1770168184.0,
"core.events": [
39908,
39914,
39920,
39926,
39932,
39938,
39944,
39950,
39956,
39962,
39968,
39974,
39980,
39986,
39992,
39998,
40004,
40010,
40016
],
"core.event_count": 19,
"core.first_event_number": 39908,
"core.last_event_number": 40016,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0350_df-s03-d0_dw_0_20260203T205508.hdf5"
}
]
} 