Jobsub ID 297919.61@dunegpschedd02.fnal.gov
| Jobsub ID | 297919.61@dunegpschedd02.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:54:25 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce507 |
| Last heartbeat | 2026-02-04 00:23:10 |
| From worker node | Hostname | b9p06p3387.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:30:27 |
| Input files | vd-protodune:np02vd_raw_run042421_0155_df-s04-d0_dw_0_20260203T145449.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 49m (2999s) |
| CPU time | 47m (2868s = 95%) |
| Max RSS bytes | 2700926976 (2575 MiB) |
| Outputting started | 2026-02-04 00:20:29 |
| Output files | |
| Finished | 2026-02-04 00:23:10 |
| Saved logs | justin-logs:297919.61-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
a0
Caught exception in looking up space point ptr... 0x35f64aa0, 0x3560f9d0
Caught exception in looking up space point ptr... 0x3560f9d0, 0x3560d460
Caught exception in looking up space point ptr... 0x3560d460, 0x3560f9d0
Caught exception in looking up space point ptr... 0x356dd610, 0x5792cf10
Caught exception in looking up space point ptr... 0x356ef720, 0x356dd610
Caught exception in looking up space point ptr... 0x329d66e0, 0x329d6410
Caught exception in looking up space point ptr... 0x329d6000, 0x329d66e0
Caught exception in looking up space point ptr... 0x33996090, 0x33996540
Caught exception in looking up space point ptr... 0x33996540, 0x33996090
Caught exception in looking up space point ptr... 0xa891db0, 0xc8dbd00
Caught exception in looking up space point ptr... 0x308ebaf0, 0xa891db0
Caught exception in looking up space point ptr... 0x4f3f6de0, 0x49951e10
Caught exception in looking up space point ptr... 0x4f3e8510, 0x4f3f6de0
Caught exception in looking up space point ptr... 0x22bea600, 0x22be9af0
Caught exception in looking up space point ptr... 0x22be9af0, 0x22bea600
Caught exception in looking up space point ptr... 0x4f9fec90, 0x4e86cbe0
Caught exception in looking up space point ptr... 0x4f9fee20, 0x4f9fec90
Caught exception in looking up space point ptr... 0x31228750, 0x33b5aec0
Caught exception in looking up space point ptr... 0x3043f1e0, 0x31228750
Caught exception in looking up space point ptr... 0x13307050, 0x13306a70
Caught exception in looking up space point ptr... 0x3b21a4f0, 0x13307050
Caught exception in looking up space point ptr... 0x10073fe0, 0x10073b30
Caught exception in looking up space point ptr... 0x10073b30, 0x100734f0
Caught exception in looking up space point ptr... 0x57b2a3e0, 0x2aa3b070
Caught exception in looking up space point ptr... 0x2aa3b070, 0x47ee42c0
Caught exception in looking up space point ptr... 0x2bd0ebf0, 0x4739a3f0
Caught exception in looking up space point ptr... 0x2bd0ed80, 0x2bd0ebf0
Caught exception in looking up space point ptr... 0x212b87d0, 0x49a26b50
Caught exception in looking up space point ptr... 0x49a26b50, 0x212bacc0
Caught exception in looking up space point ptr... 0x2d44ef50, 0x8367540
Caught exception in looking up space point ptr... 0x2d460c00, 0x2d44ef50
Caught exception in looking up space point ptr... 0x3dcbd7f0, 0x3dccfdb0
Caught exception in looking up space point ptr... 0x3dccfc20, 0x3dcbd7f0
Caught exception in looking up space point ptr... 0x3d408ae0, 0x3d408e00
Caught exception in looking up space point ptr... 0x3d408e00, 0x3d408ae0
Caught exception in looking up space point ptr... 0x3d408ae0, 0x3d408950
Caught exception in looking up space point ptr... 0x3d408950, 0x3d408ae0
Caught exception in looking up space point ptr... 0x499727f0, 0x499640b0
Caught exception in looking up space point ptr... 0x499640b0, 0x49972660
Caught exception in looking up space point ptr... 0x3119f670, 0xe7b16b0
Caught exception in looking up space point ptr... 0x311ae3f0, 0x3119f670
Caught exception in looking up space point ptr... 0x6a14fe0, 0x6a052c0
Caught exception in looking up space point ptr... 0x6a270f0, 0x6a14fe0
Caught exception in looking up space point ptr... 0x3cf37e50, 0x3cf2b010
Caught exception in looking up space point ptr... 0x3cf2b010, 0x3cf37cc0
Caught exception in looking up space point ptr... 0x11465c50, 0x3e907ab0
Caught exception in looking up space point ptr... 0x3e907ab0, 0x11465c50
Caught exception in looking up space point ptr... 0x293aa600, 0x293aa750
Caught exception in looking up space point ptr... 0x293aa750, 0x293aa600
Caught exception in looking up space point ptr... 0x2b9ca430, 0x25107750
Caught exception in looking up space point ptr... 0x25107750, 0x2b9ca430
Caught exception in looking up space point ptr... 0x2460dfb0, 0x8681760
Caught exception in looking up space point ptr... 0x8681760, 0x2460dfb0
Caught exception in looking up space point ptr... 0x356115a0, 0x38a1a1e0
Caught exception in looking up space point ptr... 0x38a1a1e0, 0x4806e990
Caught exception in looking up space point ptr... 0x15972890, 0x15972bb0
Caught exception in looking up space point ptr... 0x15972bb0, 0x15972890
Caught exception in looking up space point ptr... 0x15972890, 0x15972a20
Caught exception in looking up space point ptr... 0x15972a20, 0x15972890
Caught exception in looking up space point ptr... 0x3c03e4b0, 0x1388d2a0
Caught exception in looking up space point ptr... 0x2d43d340, 0x3c03e4b0
Caught exception in looking up space point ptr... 0x356b4650, 0x356b5090
Caught exception in looking up space point ptr... 0x356b5090, 0x356b47a0
Caught exception in looking up space point ptr... 0x40257880, 0x14482e70
Caught exception in looking up space point ptr... 0x14482e70, 0x3d02ff90
++++>>>> total num hits: 343435, num free: 336584
04-Feb-2026 01:20:20 CET Closed output file "np02vd_raw_run042421_0155_df-s04-d0_dw_0_20260203T145449_reco_stage0_20260204T002020_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 70.6806 108.901 140.051 109.677 17.8503 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.3981e-05 9.70793e-05 0.00052086 7.1972e-05 8.785e-05 27
produce:tpcrawdecoder:PDVDTPCReader 3.96317 5.19627 11.9507 4.81274 1.47503 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00974837 0.0169819 0.0442116 0.0143187 0.00746905 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000402808 0.000501612 0.000874117 0.0004804 9.712e-05 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00139165 0.00167706 0.00196704 0.00167061 0.000116909 27
produce:beamevent:BeamEvent 4.81e-05 0.000105873 0.000766295 8.0121e-05 0.000130798 27
produce:pdvddaphne:DAPHNEReaderPDVD 1.97385 2.80025 4.20919 2.81103 0.439645 27
produce:ophit:OpHitFinder 0.0229866 0.0367242 0.046902 0.0388838 0.00586827 27
produce:wclsdatavd:WireCellToolkit 53.468 64.2239 73.3549 64.9061 5.5405 27
produce:gaushit:GausHitFinder 0.438656 1.09016 2.06191 1.11528 0.340367 27
produce:nhitsfilter:NumberOfHitsFilter 0.000155503 0.000248342 0.000403597 0.000227985 5.92425e-05 27
produce:reco3d:SpacePointSolver 3.77246 7.40051 14.222 7.41202 2.92418 27
produce:hitpdune:DisambigFromSpacePoints 0.0425158 0.152405 0.316973 0.150144 0.0635976 27
produce:cluster3d:Cluster3D 0.676759 23.8624 41.4126 31.1214 14.7457 27
[art]:TriggerResults:TriggerResultInserter 1.568e-05 3.10194e-05 9.3912e-05 2.7161e-05 1.44529e-05 27
end_path:out1:RootOutput 3.28e-06 8.19207e-06 2.7801e-05 6.83e-06 5.85539e-06 27
end_path:out1:RootOutput(write) 2.77804 4.09933 5.27688 4.13487 0.58821 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4683.48 MB
Peak resident set size usage (VmHWM): 2700.93 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0155_df-s04-d0_dw_0_20260203T145449_reco_stage0_20260204T002020_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0155_df-s04-d0_dw_0_20260203T145449_reco_stage0_20260204T002020_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0155_df-s04-d0_dw_0_20260203T145449_reco_stage0_20260204T002020_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770161438.0,
"core.end_time": 1770164421.0,
"core.events": [
25180,
25186,
25192,
25198,
25204,
25210,
25216,
25222,
25228,
25234,
25240,
25246,
25252,
25258,
25264,
25270,
25276,
25282,
25288,
25294,
25300,
25306,
25312,
25318,
25324,
25330,
25336
],
"core.event_count": 27,
"core.first_event_number": 25180,
"core.last_event_number": 25336,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0155_df-s04-d0_dw_0_20260203T145449.hdf5"
}
]
} 