Jobsub ID 297923.89@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.89@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce515 |
| Last heartbeat | 2026-02-04 01:33:22 |
| From worker node | Hostname | b9p12p0201.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 343800 (95 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-04 00:00:56 |
| Input files | vd-protodune:np02vd_raw_run042433_0586_df-s02-d1_dw_0_20260203T222450.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5343s) |
| CPU time | 1h (5199s = 97%) |
| Max RSS bytes | 14617751552 (13940 MiB) |
| Outputting started | 2026-02-04 01:30:03 |
| Output files | |
| Finished | 2026-02-04 01:33:22 |
| Saved logs | justin-logs:297923.89-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
Caught exception in looking up space point ptr... 0x1041c0aa0, 0x6b785340
Caught exception in looking up space point ptr... 0x5942b190, 0x5942b000
Caught exception in looking up space point ptr... 0x5942b000, 0x5942b190
Caught exception in looking up space point ptr... 0x11253eca0, 0x536f82e0
Caught exception in looking up space point ptr... 0x3158f8c0, 0x11253eca0
Caught exception in looking up space point ptr... 0xeee3ed60, 0x540e4c60
Caught exception in looking up space point ptr... 0x540e4c60, 0xeee3eff0
Caught exception in looking up space point ptr... 0x177c5f9a0, 0x315c6850
Caught exception in looking up space point ptr... 0x31680fc0, 0x177c5f9a0
Caught exception in looking up space point ptr... 0x33a420d0, 0x33a409b0
Caught exception in looking up space point ptr... 0x33a409b0, 0x33a3eba0
Caught exception in looking up space point ptr... 0x12b79ad0, 0x11cce250
Caught exception in looking up space point ptr... 0x11cce250, 0x11c32990
Caught exception in looking up space point ptr... 0x3937bd10, 0x3951f6c0
Caught exception in looking up space point ptr... 0x39304e00, 0x3937bd10
Caught exception in looking up space point ptr... 0x10f5a5340, 0x87e2060
Caught exception in looking up space point ptr... 0x87e2060, 0x558acb70
Caught exception in looking up space point ptr... 0xa9dd3f30, 0x2b616630
Caught exception in looking up space point ptr... 0x2b616630, 0x13acc2050
Caught exception in looking up space point ptr... 0x85c1a100, 0x4779a580
Caught exception in looking up space point ptr... 0x4779a580, 0x85c1a290
Caught exception in looking up space point ptr... 0x85c1a290, 0x4779a680
Caught exception in looking up space point ptr... 0xc24ee0c0, 0xb4325e70
Caught exception in looking up space point ptr... 0xb4325e70, 0xb439fbb0
Caught exception in looking up space point ptr... 0x49662230, 0x49661c80
Caught exception in looking up space point ptr... 0x49661c80, 0x49661f50
Caught exception in looking up space point ptr... 0x2a544060, 0x1d5fb1e80
Caught exception in looking up space point ptr... 0x5f27f000, 0x2a544060
Caught exception in looking up space point ptr... 0x6028ef90, 0x4828b9b0
Caught exception in looking up space point ptr... 0x4828b9b0, 0x33e69960
Caught exception in looking up space point ptr... 0x2902cc20, 0x2902d180
Caught exception in looking up space point ptr... 0x2902d180, 0xa7533a0
Caught exception in looking up space point ptr... 0x443f41a0, 0x13c7daa40
Caught exception in looking up space point ptr... 0x13c7daa40, 0x443f41a0
Caught exception in looking up space point ptr... 0x443f41a0, 0x9066da70
Caught exception in looking up space point ptr... 0x9066da70, 0x443f41a0
Caught exception in looking up space point ptr... 0x4454f2b0, 0x447b86f0
Caught exception in looking up space point ptr... 0x447b86f0, 0x4454f2b0
Caught exception in looking up space point ptr... 0x6917f1d0, 0x10e7eb6c0
Caught exception in looking up space point ptr... 0x10e7eb6c0, 0x6917f1d0
Caught exception in looking up space point ptr... 0x616bf210, 0x61691de0
Caught exception in looking up space point ptr... 0x61691de0, 0x616bf210
Caught exception in looking up space point ptr... 0x12225110, 0x12224f80
Caught exception in looking up space point ptr... 0x12224f80, 0x12225110
Caught exception in looking up space point ptr... 0x5a7377d0, 0x6afd53a0
Caught exception in looking up space point ptr... 0x6afd53a0, 0x5a7377d0
Caught exception in looking up space point ptr... 0xf62326c0, 0xe7ecd760
Caught exception in looking up space point ptr... 0xe7ecd760, 0xf62326c0
Caught exception in looking up space point ptr... 0x16e1c5df0, 0xb42c4e30
Caught exception in looking up space point ptr... 0xb42c4e30, 0x16e1c5df0
Caught exception in looking up space point ptr... 0x16e1c5df0, 0x13d0cfd20
Caught exception in looking up space point ptr... 0x13d0cfd20, 0x16e1c5df0
Caught exception in looking up space point ptr... 0x7f493370, 0x1c57632c0
Caught exception in looking up space point ptr... 0x1c57632c0, 0xe7e0b940
Caught exception in looking up space point ptr... 0x44150c00, 0x44150f20
Caught exception in looking up space point ptr... 0x44150f20, 0x44150c00
Caught exception in looking up space point ptr... 0x8bc738b0, 0x8bc73720
Caught exception in looking up space point ptr... 0x8bc73720, 0x8bc738b0
Caught exception in looking up space point ptr... 0xee7c3030, 0xeea08f80
Caught exception in looking up space point ptr... 0xeea08f80, 0xee7c3030
Caught exception in looking up space point ptr... 0x5a7342a0, 0x5a7397f0
Caught exception in looking up space point ptr... 0x5a7397f0, 0x6b109d40
Caught exception in looking up space point ptr... 0x117815180, 0x117815030
Caught exception in looking up space point ptr... 0x117815030, 0x117815180
Caught exception in looking up space point ptr... 0xe081a890, 0x162bdbf0
Caught exception in looking up space point ptr... 0x162bdbf0, 0xe081a890
++++>>>> total num hits: 4177036, num free: 4042595
04-Feb-2026 02:29:53 CET Closed output file "np02vd_raw_run042433_0586_df-s02-d1_dw_0_20260203T222450_reco_stage0_20260204T012953_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 109.733 278.746 1157.28 153.174 287.631 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 5.281e-05 8.00861e-05 0.000165701 6.812e-05 3.0771e-05 19
produce:tpcrawdecoder:PDVDTPCReader 5.29182 5.80684 6.53653 5.81736 0.324345 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.0101438 0.0196719 0.0506423 0.0117507 0.0125327 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.000378961 0.000488062 0.000809223 0.000415721 0.000120523 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.000369691 0.000449417 0.000786663 0.000412571 9.39649e-05 19
produce:beamevent:BeamEvent 5.297e-05 0.000120527 0.000818583 8.401e-05 0.000166078 19
produce:pdvddaphne:DAPHNEReaderPDVD 1.88994 2.13648 2.58073 2.12112 0.182211 19
produce:ophit:OpHitFinder 0.0194949 0.0290707 0.0392169 0.0292608 0.00447111 19
produce:wclsdatavd:WireCellToolkit 84.6789 87.8934 94.5115 87.1386 2.81249 19
produce:gaushit:GausHitFinder 0.773118 2.26375 6.32943 1.72722 1.57414 19
produce:nhitsfilter:NumberOfHitsFilter 0.00023907 0.000449801 0.00109085 0.000300771 0.000283187 19
produce:reco3d:SpacePointSolver 7.70696 28.3016 109.452 14.8247 31.3262 19
produce:hitpdune:DisambigFromSpacePoints 0.121162 1.14988 6.82585 0.218326 1.95777 19
produce:cluster3d:Cluster3D 1.43491 143.834 916.934 38.3235 247.929 19
[art]:TriggerResults:TriggerResultInserter 2.5931e-05 3.5841e-05 9.4341e-05 3.1811e-05 1.53715e-05 19
end_path:out1:RootOutput 4.69e-06 8.46795e-06 2.927e-05 6.82e-06 5.82825e-06 19
end_path:out1:RootOutput(write) 3.913 7.28 19.4934 5.08761 4.82235 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 16958.6 MB
Peak resident set size usage (VmHWM): 14617.8 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0586_df-s02-d1_dw_0_20260203T222450_reco_stage0_20260204T012953_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0586_df-s02-d1_dw_0_20260203T222450_reco_stage0_20260204T012953_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0586_df-s02-d1_dw_0_20260203T222450_reco_stage0_20260204T012953_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163265.0,
"core.end_time": 1770168595.0,
"core.events": [
66811,
66817,
66823,
66829,
66835,
66841,
66847,
66853,
66859,
66865,
66871,
66877,
66883,
66889,
66895,
66901,
66907,
66913,
66919
],
"core.event_count": 19,
"core.first_event_number": 66811,
"core.last_event_number": 66919,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0586_df-s02-d1_dw_0_20260203T222450.hdf5"
}
]
}