Jobsub ID 303647.63@dunegpschedd01.fnal.gov
| Jobsub ID | 303647.63@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:46:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce512 |
| Last heartbeat | 2026-02-03 23:31:38 |
| From worker node | Hostname | b9g24p4713.cern.ch |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 22:46:55 |
| Input files | vd-protodune:np02vd_raw_run042421_0129_df-s03-d0_dw_0_20260203T144048.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 42m (2545s) |
| CPU time | 40m (2445s = 96%) |
| Max RSS bytes | 2574467072 (2455 MiB) |
| Outputting started | 2026-02-03 23:29:21 |
| Output files | |
| Finished | 2026-02-03 23:31:38 |
| Saved logs | justin-logs:303647.63-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
x9fb2f70
Caught exception in looking up space point ptr... 0x9fb2f70, 0x9fb2e80
Caught exception in looking up space point ptr... 0x2ad37850, 0x28bc19d0
Caught exception in looking up space point ptr... 0x28bc19d0, 0x48fd8750
Caught exception in looking up space point ptr... 0x52784020, 0x527826b0
Caught exception in looking up space point ptr... 0x5277f7c0, 0x52784020
Caught exception in looking up space point ptr... 0x33379820, 0x4c277d00
Caught exception in looking up space point ptr... 0x4c277610, 0x33379820
Caught exception in looking up space point ptr... 0x202b8ee0, 0x202b8d50
Caught exception in looking up space point ptr... 0x202b8d50, 0x202b8bc0
Caught exception in looking up space point ptr... 0x48dd9020, 0x48dd6e00
Caught exception in looking up space point ptr... 0x48dd6e00, 0x48dd9020
Caught exception in looking up space point ptr... 0x15e5cbe0, 0x15e5c3b0
Caught exception in looking up space point ptr... 0x15e5c3b0, 0x15e5c650
Caught exception in looking up space point ptr... 0xdef4970, 0xdef8380
Caught exception in looking up space point ptr... 0xdef8380, 0xdef81f0
Caught exception in looking up space point ptr... 0x2f96f1b0, 0x157ddc40
Caught exception in looking up space point ptr... 0x157ddc40, 0x2f96f1b0
Caught exception in looking up space point ptr... 0x152c7e60, 0x4a890270
Caught exception in looking up space point ptr... 0x4a890270, 0x4a878e40
Caught exception in looking up space point ptr... 0x1340bcf0, 0xf5d7920
Caught exception in looking up space point ptr... 0xf5d7920, 0xff1cf10
Caught exception in looking up space point ptr... 0x235d2a20, 0x235cd6a0
Caught exception in looking up space point ptr... 0x235cd6a0, 0x235c9f80
Caught exception in looking up space point ptr... 0x9fba1a0, 0x9fba000
Caught exception in looking up space point ptr... 0x9fba000, 0x9fba1a0
Caught exception in looking up space point ptr... 0x35f840c0, 0x5b2b7190
Caught exception in looking up space point ptr... 0x5b2b7190, 0x1336b1d0
Caught exception in looking up space point ptr... 0x46b3b2b0, 0x46b3b120
Caught exception in looking up space point ptr... 0x46b3b120, 0x46b3b2b0
Caught exception in looking up space point ptr... 0x46b3b2b0, 0x46b3ad60
Caught exception in looking up space point ptr... 0x46b3ad60, 0x46b3b2b0
Caught exception in looking up space point ptr... 0x157bddb0, 0x157bd900
Caught exception in looking up space point ptr... 0x157bd900, 0x157bddb0
Caught exception in looking up space point ptr... 0x3336c570, 0x33367060
Caught exception in looking up space point ptr... 0x33367060, 0x3336c570
Caught exception in looking up space point ptr... 0x3336c570, 0x3336c3e0
Caught exception in looking up space point ptr... 0x3336c3e0, 0x3336c570
Caught exception in looking up space point ptr... 0x244503b0, 0x2444e730
Caught exception in looking up space point ptr... 0x2444e730, 0x12e4fea0
Caught exception in looking up space point ptr... 0x220fef00, 0x220ff090
Caught exception in looking up space point ptr... 0x29f78aa0, 0x220fef00
Caught exception in looking up space point ptr... 0x32ff8140, 0x32fea270
Caught exception in looking up space point ptr... 0x32fea270, 0x32ff8140
Caught exception in looking up space point ptr... 0xc632990, 0x4cad7530
Caught exception in looking up space point ptr... 0x4cad7530, 0xc632990
Caught exception in looking up space point ptr... 0x1087a470, 0x1087a2e0
Caught exception in looking up space point ptr... 0x1087a2e0, 0x1087a470
Caught exception in looking up space point ptr... 0x2abeb9e0, 0x2fc526e0
Caught exception in looking up space point ptr... 0x2fc526e0, 0x2abeb9e0
Caught exception in looking up space point ptr... 0x2abeb9e0, 0x30b8c920
Caught exception in looking up space point ptr... 0x30b8c920, 0x2abeb9e0
Caught exception in looking up space point ptr... 0x1562a9f0, 0x28b38540
Caught exception in looking up space point ptr... 0x28b38540, 0x1562a9f0
Caught exception in looking up space point ptr... 0x455fab40, 0x23afe5e0
Caught exception in looking up space point ptr... 0x23afe5e0, 0x455fab40
Caught exception in looking up space point ptr... 0x29034380, 0x290341f0
Caught exception in looking up space point ptr... 0x290341f0, 0x29034510
Caught exception in looking up space point ptr... 0x270e1230, 0x352926d0
Caught exception in looking up space point ptr... 0x352926d0, 0x270e1230
Caught exception in looking up space point ptr... 0x2fa9c4a0, 0x2faa4700
Caught exception in looking up space point ptr... 0x2faa4700, 0x414f7f20
Caught exception in looking up space point ptr... 0x21399990, 0x63f76a60
Caught exception in looking up space point ptr... 0x63f76a60, 0x21399990
Caught exception in looking up space point ptr... 0x47122630, 0x471224a0
Caught exception in looking up space point ptr... 0x471224a0, 0x47122630
++++>>>> total num hits: 57109, num free: 54572
04-Feb-2026 00:29:13 CET Closed output file "np02vd_raw_run042421_0129_df-s03-d0_dw_0_20260203T144048_reco_stage0_20260203T232913_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 77.1133 91.7601 111.212 93.1108 6.87497 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.7871e-05 7.80882e-05 0.000159963 7.5792e-05 3.03862e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.15842 4.86877 8.41449 4.73989 0.722647 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.0102527 0.0206678 0.0633611 0.0128553 0.0154378 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000391178 0.000515343 0.000790455 0.000461909 0.000102437 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00138985 0.0018547 0.00370603 0.00170668 0.000531982 27
produce:beamevent:BeamEvent 5.6611e-05 0.000134977 0.00111374 9.3792e-05 0.000194024 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.29387 2.7524 3.25165 2.77197 0.28651 27
produce:ophit:OpHitFinder 0.0231491 0.0341222 0.0465955 0.0334074 0.00517871 27
produce:wclsdatavd:WireCellToolkit 56.9426 68.2497 83.1318 69.1661 5.56582 27
produce:gaushit:GausHitFinder 0.508863 0.857649 1.32894 0.876607 0.160319 27
produce:nhitsfilter:NumberOfHitsFilter 0.000166283 0.000297315 0.00048251 0.000274826 7.75925e-05 27
produce:reco3d:SpacePointSolver 4.60202 9.33392 16.0564 8.98065 2.62726 27
produce:hitpdune:DisambigFromSpacePoints 0.0522537 0.099487 0.160135 0.0947036 0.0281898 27
produce:cluster3d:Cluster3D 0.580269 1.63713 2.45926 1.66924 0.485771 27
[art]:TriggerResults:TriggerResultInserter 2.373e-05 3.4292e-05 7.8662e-05 3.034e-05 1.23112e-05 27
end_path:out1:RootOutput 5.941e-06 1.02083e-05 2.4711e-05 1.024e-05 3.5895e-06 27
end_path:out1:RootOutput(write) 3.27548 3.8853 4.8151 3.82667 0.473541 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4535.79 MB
Peak resident set size usage (VmHWM): 2574.47 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0129_df-s03-d0_dw_0_20260203T144048_reco_stage0_20260203T232913_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0129_df-s03-d0_dw_0_20260203T144048_reco_stage0_20260203T232913_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0129_df-s03-d0_dw_0_20260203T144048_reco_stage0_20260203T232913_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770158826.0,
"core.end_time": 1770161354.0,
"core.events": [
20972,
20978,
20984,
20990,
20996,
21002,
21008,
21014,
21020,
21026,
21032,
21038,
21044,
21050,
21056,
21062,
21068,
21074,
21080,
21086,
21092,
21098,
21104,
21110,
21116,
21122,
21128
],
"core.event_count": 27,
"core.first_event_number": 20972,
"core.last_event_number": 21128,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0129_df-s03-d0_dw_0_20260203T144048.hdf5"
}
]
} 