Jobsub ID 303653.107@dunegpschedd01.fnal.gov
| Jobsub ID | 303653.107@dunegpschedd01.fnal.gov |
| Workflow ID | 12717 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:52:24 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce506 |
| Last heartbeat | 2026-02-04 00:34:58 |
| From worker node | Hostname | b9p06p2822.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:43:01 |
| Input files | vd-protodune:np02vd_raw_run042421_0133_df-s03-d0_dw_0_20260203T144257.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 49m (2957s) |
| CPU time | 47m (2831s = 95%) |
| Max RSS bytes | 2730643456 (2604 MiB) |
| Outputting started | 2026-02-04 00:32:20 |
| Output files | |
| Finished | 2026-02-04 00:34:58 |
| Saved logs | justin-logs:303653.107-dunegpschedd01.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0xe875670, 0xe875910
Caught exception in looking up space point ptr... 0x2d3384e0, 0x2d3386c0
Caught exception in looking up space point ptr... 0x2d3386c0, 0x2d338ee0
Caught exception in looking up space point ptr... 0x602f84b0, 0x32a7e1f0
Caught exception in looking up space point ptr... 0x602c9ac0, 0x602f84b0
Caught exception in looking up space point ptr... 0xdafb850, 0x12842d40
Caught exception in looking up space point ptr... 0x12842d40, 0x12842e90
Caught exception in looking up space point ptr... 0x53987720, 0x4afda660
Caught exception in looking up space point ptr... 0x3c577680, 0x53987720
Caught exception in looking up space point ptr... 0x2b0b3de0, 0x43176740
Caught exception in looking up space point ptr... 0x2b0c3e20, 0x2b0b3de0
Caught exception in looking up space point ptr... 0x32de03f0, 0x5416daa0
Caught exception in looking up space point ptr... 0x52db83c0, 0x32de03f0
Caught exception in looking up space point ptr... 0x5e965f90, 0x2c9b93d0
Caught exception in looking up space point ptr... 0x15f058d0, 0x5e965f90
Caught exception in looking up space point ptr... 0x22366140, 0x2c9b8950
Caught exception in looking up space point ptr... 0x54860950, 0x22366140
Caught exception in looking up space point ptr... 0x3a779ec0, 0x3a7760e0
Caught exception in looking up space point ptr... 0x3a7760e0, 0x26ce3530
Caught exception in looking up space point ptr... 0x39b8acf0, 0x4f81fdd0
Caught exception in looking up space point ptr... 0x4f820750, 0x39b8acf0
Caught exception in looking up space point ptr... 0x22510190, 0x5775e8d0
Caught exception in looking up space point ptr... 0x5775e8d0, 0x46ac6dc0
Caught exception in looking up space point ptr... 0x60ebb0c0, 0xe7b6080
Caught exception in looking up space point ptr... 0x5314c2a0, 0x60ebb0c0
Caught exception in looking up space point ptr... 0x14829c70, 0x14818fb0
Caught exception in looking up space point ptr... 0x14838b80, 0x14829c70
Caught exception in looking up space point ptr... 0x34efb630, 0x34ee9070
Caught exception in looking up space point ptr... 0x34ee9070, 0x34ed6a60
Caught exception in looking up space point ptr... 0x3652b4b0, 0x3651e1c0
Caught exception in looking up space point ptr... 0x3651e1c0, 0x3652b320
Caught exception in looking up space point ptr... 0x4b5c8f10, 0x4b5b7120
Caught exception in looking up space point ptr... 0x4b5b7120, 0x4b5c8d80
Caught exception in looking up space point ptr... 0x26cb6f10, 0x26ca4e00
Caught exception in looking up space point ptr... 0x26ca4e00, 0x26c929d0
Caught exception in looking up space point ptr... 0x4f418c60, 0x4f4187b0
Caught exception in looking up space point ptr... 0x4f4187b0, 0x4f418940
Caught exception in looking up space point ptr... 0x8b4ecc0, 0x3138b440
Caught exception in looking up space point ptr... 0x3138b440, 0x453c14f0
Caught exception in looking up space point ptr... 0x20fa9630, 0x606d48f0
Caught exception in looking up space point ptr... 0x606d48f0, 0x20fa9630
Caught exception in looking up space point ptr... 0xb3fa1f0, 0xb3fa460
Caught exception in looking up space point ptr... 0xb3fa460, 0xb3fa1f0
Caught exception in looking up space point ptr... 0x43d80950, 0x43d80c70
Caught exception in looking up space point ptr... 0x43d80c70, 0x43d80950
Caught exception in looking up space point ptr... 0x43d80950, 0x43d80e50
Caught exception in looking up space point ptr... 0x43d80e50, 0x43d80950
Caught exception in looking up space point ptr... 0x353070c0, 0x35306f30
Caught exception in looking up space point ptr... 0x35306f30, 0x35306c10
Caught exception in looking up space point ptr... 0x35307ac0, 0x353077a0
Caught exception in looking up space point ptr... 0x353077a0, 0x35307ac0
Caught exception in looking up space point ptr... 0x3d8f2f70, 0x3d8f2c50
Caught exception in looking up space point ptr... 0x3d8f2c50, 0x3d8f2f70
Caught exception in looking up space point ptr... 0x3eb04040, 0x3eb03d00
Caught exception in looking up space point ptr... 0x3eb03d00, 0x58cf8c70
Caught exception in looking up space point ptr... 0x5c5073c0, 0x63c494c0
Caught exception in looking up space point ptr... 0x63c494c0, 0x5c5073c0
Caught exception in looking up space point ptr... 0x46dff040, 0x46dfeb30
Caught exception in looking up space point ptr... 0x46dfeb30, 0x46dfecd0
Caught exception in looking up space point ptr... 0x27126ab0, 0x27126c90
Caught exception in looking up space point ptr... 0x27126c90, 0x27126920
Caught exception in looking up space point ptr... 0x3c806530, 0x3c8051f0
Caught exception in looking up space point ptr... 0x3c8051f0, 0x3c806530
Caught exception in looking up space point ptr... 0x6077a290, 0x3c98ad10
Caught exception in looking up space point ptr... 0x3c98ad10, 0x6077a290
++++>>>> total num hits: 299914, num free: 293274
04-Feb-2026 01:32:13 CET Closed output file "np02vd_raw_run042421_0133_df-s03-d0_dw_0_20260203T144257_reco_stage0_20260204T003213_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 72.6886 107.384 136.876 107.906 19.7246 27
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 4.465e-05 0.000111254 0.000404282 8.9361e-05 7.08627e-05 27
produce:tpcrawdecoder:PDVDTPCReader 4.21273 5.27194 17.1897 4.70239 2.43298 27
produce:triggerrawdecoder:PDVDTriggerReader4 0.00973731 0.0200194 0.0898015 0.0122607 0.019838 27
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000376202 0.000659081 0.00330281 0.000542952 0.000531176 27
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.00139485 0.00184133 0.00263889 0.00179218 0.00026672 27
produce:beamevent:BeamEvent 7.101e-05 0.000139921 0.000975655 0.000104371 0.000167606 27
produce:pdvddaphne:DAPHNEReaderPDVD 2.07747 2.70409 3.60506 2.64314 0.350386 27
produce:ophit:OpHitFinder 0.0274303 0.0351406 0.0479509 0.0342067 0.00563965 27
produce:wclsdatavd:WireCellToolkit 52.3161 61.9111 78.1235 62.1537 6.26171 27
produce:gaushit:GausHitFinder 0.508464 1.15842 2.37475 1.04556 0.441778 27
produce:nhitsfilter:NumberOfHitsFilter 0.000167521 0.000272502 0.000471942 0.000250871 8.22062e-05 27
produce:reco3d:SpacePointSolver 3.99073 6.6058 11.0694 6.29525 1.68831 27
produce:hitpdune:DisambigFromSpacePoints 0.0497542 0.162043 0.288923 0.154417 0.0711788 27
produce:cluster3d:Cluster3D 0.895756 25.5394 50.3526 29.8856 15.5352 27
[art]:TriggerResults:TriggerResultInserter 2.152e-05 3.37398e-05 8.09e-05 3.086e-05 1.20204e-05 27
end_path:out1:RootOutput 5.38e-06 1.03682e-05 3.533e-05 8.9e-06 6.0159e-06 27
end_path:out1:RootOutput(write) 2.89853 3.95043 5.74832 3.83499 0.731229 27
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4716.41 MB
Peak resident set size usage (VmHWM): 2730.64 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042421_0133_df-s03-d0_dw_0_20260203T144257_reco_stage0_20260204T003213_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042421_0133_df-s03-d0_dw_0_20260203T144257_reco_stage0_20260204T003213_offline.root
Ran successfully
{
"name": "np02vd_raw_run042421_0133_df-s03-d0_dw_0_20260203T144257_reco_stage0_20260204T003213_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162193.0,
"core.end_time": 1770165134.0,
"core.events": [
21620,
21626,
21632,
21638,
21644,
21650,
21656,
21662,
21668,
21674,
21680,
21686,
21692,
21698,
21704,
21710,
21716,
21722,
21728,
21734,
21740,
21746,
21752,
21758,
21764,
21770,
21776
],
"core.event_count": 27,
"core.first_event_number": 21620,
"core.last_event_number": 21776,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42421
],
"core.runs_subruns": [
4242100001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042421_0133_df-s03-d0_dw_0_20260203T144257.hdf5"
}
]
} 