Jobsub ID 297921.0@dunegpschedd02.fnal.gov
| Jobsub ID | 297921.0@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 22:58:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce02 |
| Last heartbeat | 2026-02-04 00:59:59 |
| From worker node | Hostname | dune002-1603250.0-lcg2566.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 7452 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:44:28 |
| Input files | vd-protodune:np02vd_raw_run042433_0556_df-s03-d1_dw_0_20260203T221326.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (4416s) |
| CPU time | 1h (4021s = 91%) |
| Max RSS bytes | 3396481024 (3239 MiB) |
| Outputting started | 2026-02-04 00:58:06 |
| Output files | |
| Finished | 2026-02-04 00:59:59 |
| Saved logs | justin-logs:297921.0-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x5bc34c20, 0x5bc33a20
Caught exception in looking up space point ptr... 0xa7ba16a0, 0xa7ba14e0
Caught exception in looking up space point ptr... 0xa7ba14e0, 0xa7ba16a0
Caught exception in looking up space point ptr... 0x9f4af320, 0x4100f7c0
Caught exception in looking up space point ptr... 0x4100f7c0, 0x5bc2ff30
Caught exception in looking up space point ptr... 0x8b0ba770, 0x8b0ba900
Caught exception in looking up space point ptr... 0x8b0ba900, 0x8b0ba770
Caught exception in looking up space point ptr... 0x883ec910, 0xb0c708a0
Caught exception in looking up space point ptr... 0xb0c708a0, 0x883ec910
Caught exception in looking up space point ptr... 0x647e0fe0, 0x647e1170
Caught exception in looking up space point ptr... 0x647e1300, 0x647c2a80
Caught exception in looking up space point ptr... 0x647c2a80, 0x647c28f0
Caught exception in looking up space point ptr... 0x647c28f0, 0x647e0fe0
Caught exception in looking up space point ptr... 0xaaef5360, 0xa7b8c660
Caught exception in looking up space point ptr... 0xa7b8c660, 0xaaf303e0
Caught exception in looking up space point ptr... 0x3afc6170, 0x3afc5660
Caught exception in looking up space point ptr... 0x3afc5660, 0x3afc6170
Caught exception in looking up space point ptr... 0x8b0c4830, 0x8b0cfb50
Caught exception in looking up space point ptr... 0x8b0cfb50, 0x8b0c4540
Caught exception in looking up space point ptr... 0x7a1d5060, 0x7a1d4f10
Caught exception in looking up space point ptr... 0x7a1d4f10, 0x7a1d5060
Caught exception in looking up space point ptr... 0x5bba1e20, 0x7a0bab20
Caught exception in looking up space point ptr... 0x7a0bab20, 0x5bba1e20
Caught exception in looking up space point ptr... 0x8a731ee0, 0x8a731bc0
Caught exception in looking up space point ptr... 0x8a731bc0, 0x8a731ee0
Caught exception in looking up space point ptr... 0x47369ee0, 0x7b24a790
Caught exception in looking up space point ptr... 0x7b24a790, 0x81d6f230
Caught exception in looking up space point ptr... 0x6ac6d3f0, 0x6ac6d310
Caught exception in looking up space point ptr... 0x6ac6d310, 0x6ac6d3f0
Caught exception in looking up space point ptr... 0x386a9380, 0x386aa350
Caught exception in looking up space point ptr... 0x386aa350, 0x386a9380
Caught exception in looking up space point ptr... 0x876b4570, 0x876c5500
Caught exception in looking up space point ptr... 0x876c5500, 0x876b4570
Caught exception in looking up space point ptr... 0x8836f550, 0x883a8890
Caught exception in looking up space point ptr... 0x883a8890, 0x8836f550
Caught exception in looking up space point ptr... 0x65901650, 0x658fdbe0
Caught exception in looking up space point ptr... 0x658fdbe0, 0x45f236b0
Caught exception in looking up space point ptr... 0x87698da0, 0x8769b840
Caught exception in looking up space point ptr... 0x8769b840, 0x67861f10
Caught exception in looking up space point ptr... 0x6b3c2f20, 0x6b3c8350
Caught exception in looking up space point ptr... 0x6b3c8350, 0x6b3c2f20
Caught exception in looking up space point ptr... 0x662d0da0, 0x662d14b0
Caught exception in looking up space point ptr... 0x662d14b0, 0x662d0cb0
Caught exception in looking up space point ptr... 0x83e90130, 0x83e902c0
Caught exception in looking up space point ptr... 0x83e902c0, 0x83e90130
Caught exception in looking up space point ptr... 0x8e991eb0, 0x844ec200
Caught exception in looking up space point ptr... 0x844ec200, 0x841dddb0
Caught exception in looking up space point ptr... 0x841dddb0, 0x3987e6d0
Caught exception in looking up space point ptr... 0x5bac7f90, 0x5bac7e90
Caught exception in looking up space point ptr... 0x5bac7e90, 0x5bac7c90
Caught exception in looking up space point ptr... 0x72d00860, 0x72d00bd0
Caught exception in looking up space point ptr... 0x72d00bd0, 0x72d00680
Caught exception in looking up space point ptr... 0x5c1df820, 0x5c1df690
Caught exception in looking up space point ptr... 0x5c1df690, 0x5c1df820
Caught exception in looking up space point ptr... 0xa7b82f60, 0xa7b82d90
Caught exception in looking up space point ptr... 0xa7b82d90, 0xa7b82f60
Caught exception in looking up space point ptr... 0x5a5bcfe0, 0xb40c58e0
Caught exception in looking up space point ptr... 0xb40c58e0, 0x5a5bcfe0
Caught exception in looking up space point ptr... 0x7768e070, 0x7767a1f0
Caught exception in looking up space point ptr... 0x7767a1f0, 0x7767a490
Caught exception in looking up space point ptr... 0x7767a490, 0x7e1d8ea0
Caught exception in looking up space point ptr... 0x9f4ac620, 0x5bc350c0
Caught exception in looking up space point ptr... 0x5bc350c0, 0x9f4ac620
Caught exception in looking up space point ptr... 0x88349260, 0x73b9f120
Caught exception in looking up space point ptr... 0x73b9f120, 0x88349260
Caught exception in looking up space point ptr... 0xa381df80, 0xae6ce870
Caught exception in looking up space point ptr... 0xae6ce870, 0xa381df80
++++>>>> total num hits: 136554, num free: 129584
04-Feb-2026 00:57:53 UTC Closed output file "np02vd_raw_run042433_0556_df-s03-d1_dw_0_20260203T221326_reco_stage0_20260204T005753_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 199.614 225.637 258.504 223.986 16.5983 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 0.000103861 0.000194686 0.000582026 0.000140751 0.000118538 19
produce:tpcrawdecoder:PDVDTPCReader 18.4892 22.9378 34.6939 20.7831 4.96799 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.690819 0.711013 0.759399 0.711562 0.0167069 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0233544 0.0246282 0.0406841 0.0236541 0.00379899 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0233388 0.0236005 0.0246052 0.0235355 0.000296614 19
produce:beamevent:BeamEvent 0.000198792 0.000359311 0.00197714 0.000285623 0.000383961 19
produce:pdvddaphne:DAPHNEReaderPDVD 4.38049 4.83652 5.45843 4.83398 0.25016 19
produce:ophit:OpHitFinder 0.0395849 0.0520727 0.0611586 0.0533 0.00541945 19
produce:wclsdatavd:WireCellToolkit 132.643 157.066 183.177 155.815 13.2344 19
produce:gaushit:GausHitFinder 0.953324 1.87442 2.63141 1.82776 0.434874 19
produce:nhitsfilter:NumberOfHitsFilter 0.000316204 0.000597925 0.00102645 0.000561686 0.000152835 19
produce:reco3d:SpacePointSolver 10.4511 26.7696 38.8389 28.3399 5.81251 19
produce:hitpdune:DisambigFromSpacePoints 0.111267 0.308954 0.405707 0.307933 0.0703465 19
produce:cluster3d:Cluster3D 1.07238 3.66959 5.19689 3.69648 0.902371 19
[art]:TriggerResults:TriggerResultInserter 3.024e-05 7.50176e-05 0.000624107 4.302e-05 0.0001305 19
end_path:out1:RootOutput 5.87e-06 0.000107301 0.00182383 1.108e-05 0.000404631 19
end_path:out1:RootOutput(write) 5.41558 7.28815 9.01241 7.0271 1.18015 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5538.39 MB
Peak resident set size usage (VmHWM): 3396.48 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0556_df-s03-d1_dw_0_20260203T221326_reco_stage0_20260204T005753_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0556_df-s03-d1_dw_0_20260203T221326_reco_stage0_20260204T005753_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0556_df-s03-d1_dw_0_20260203T221326_reco_stage0_20260204T005753_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770162285.0,
"core.end_time": 1770166676.0,
"core.events": [
63393,
63399,
63405,
63411,
63417,
63423,
63429,
63435,
63441,
63447,
63453,
63459,
63465,
63471,
63477,
63483,
63489,
63495,
63501
],
"core.event_count": 19,
"core.first_event_number": 63393,
"core.last_event_number": 63501,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0556_df-s03-d1_dw_0_20260203T221326.hdf5"
}
]
} 