Jobsub ID 297923.37@dunegpschedd02.fnal.gov
| Jobsub ID | 297923.37@dunegpschedd02.fnal.gov |
| Workflow ID | 12719 |
| Stage ID | 1 |
| User name | ykermaid@fnal.gov |
| Requested | Processors | 1 |
| GPU | No |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Submitted time | 2026-02-03 23:00:26 |
| Site | UK_RAL-Tier1 |
| Entry | LIGO_UK_RAL_arc_ce01 |
| Last heartbeat | 2026-02-04 00:50:01 |
| From worker node | Hostname | dune001-1527529.0-lcg2695.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 216000 (60 hours) |
| GPU | |
| Inner Apptainer? | True |
| Job state | finished |
| Started | 2026-02-03 23:58:43 |
| Input files | vd-protodune:np02vd_raw_run042433_0156_df-s04-d0_dw_0_20260203T194125.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 49m (2983s) |
| CPU time | 44m (2651s = 88%) |
| Max RSS bytes | 3360120832 (3204 MiB) |
| Outputting started | 2026-02-04 00:48:27 |
| Output files | |
| Finished | 2026-02-04 00:50:01 |
| Saved logs | justin-logs:297923.37-dunegpschedd02.fnal.gov.logs.tgz |
| List job events Cached HTCondor job logs |
Jobscript log (last 10,000 characters)
0x498a30b0, 0x9dc6f6d0
Caught exception in looking up space point ptr... 0x420f1fd0, 0x420f3160
Caught exception in looking up space point ptr... 0x420f3160, 0x420f1fd0
Caught exception in looking up space point ptr... 0x6615d5b0, 0x6615da10
Caught exception in looking up space point ptr... 0x6615da10, 0x6615e0b0
Caught exception in looking up space point ptr... 0x7af8f6c0, 0x60c3d8a0
Caught exception in looking up space point ptr... 0x60c3d8a0, 0x7af8f430
Caught exception in looking up space point ptr... 0x650f6300, 0x86818d80
Caught exception in looking up space point ptr... 0x86818d80, 0x650f6300
Caught exception in looking up space point ptr... 0x650f6300, 0xb41e7e50
Caught exception in looking up space point ptr... 0xb41e7e50, 0x650f6300
Caught exception in looking up space point ptr... 0x650f6300, 0xb41e7cc0
Caught exception in looking up space point ptr... 0xb41e7cc0, 0x650f6300
Caught exception in looking up space point ptr... 0xb2f55850, 0xb2f55cf0
Caught exception in looking up space point ptr... 0xb2f55cf0, 0xb2f539c0
Caught exception in looking up space point ptr... 0xb2f539c0, 0xb2f563e0
Caught exception in looking up space point ptr... 0xb2f563e0, 0x96867850
Caught exception in looking up space point ptr... 0x4116b960, 0x4116a960
Caught exception in looking up space point ptr... 0x4116a960, 0x4116a3e0
Caught exception in looking up space point ptr... 0x87bb1260, 0x87bb1130
Caught exception in looking up space point ptr... 0x87bb1130, 0x87bb1260
Caught exception in looking up space point ptr... 0x42114b20, 0x42114880
Caught exception in looking up space point ptr... 0x42114880, 0x42114960
Caught exception in looking up space point ptr... 0x737d94a0, 0x737b7750
Caught exception in looking up space point ptr... 0x737b7750, 0x737d9310
Caught exception in looking up space point ptr... 0x4ac43fd0, 0x4ac41550
Caught exception in looking up space point ptr... 0x4ac41550, 0x4ac43fd0
Caught exception in looking up space point ptr... 0x88035bb0, 0x880350d0
Caught exception in looking up space point ptr... 0x880350d0, 0x88035bb0
Caught exception in looking up space point ptr... 0x87ffeda0, 0x416137a0
Caught exception in looking up space point ptr... 0x416137a0, 0x87ffeda0
Caught exception in looking up space point ptr... 0x87baf870, 0x87bb0590
Caught exception in looking up space point ptr... 0x87bb0590, 0x87baf870
Caught exception in looking up space point ptr... 0x3be70150, 0x3be6fe30
Caught exception in looking up space point ptr... 0x3be6fe30, 0x3be6ffc0
Caught exception in looking up space point ptr... 0x737a3b60, 0x737ae690
Caught exception in looking up space point ptr... 0x737a3db0, 0x737a3b60
Caught exception in looking up space point ptr... 0x9deab9e0, 0x9dea9e60
Caught exception in looking up space point ptr... 0x9dea9e60, 0x9deab850
Caught exception in looking up space point ptr... 0x498c36e0, 0x6e102180
Caught exception in looking up space point ptr... 0x6e102180, 0x498c3490
Caught exception in looking up space point ptr... 0x9de32620, 0x9de2fd70
Caught exception in looking up space point ptr... 0x9de2fd70, 0x9de30540
Caught exception in looking up space point ptr... 0xade9e480, 0xade9e2f0
Caught exception in looking up space point ptr... 0xade9e2f0, 0xade9dfd0
Caught exception in looking up space point ptr... 0x60c3c090, 0x82bbe050
Caught exception in looking up space point ptr... 0x82bbe050, 0x60c3c090
Caught exception in looking up space point ptr... 0x7ce1d6d0, 0x7ce1d5a0
Caught exception in looking up space point ptr... 0x7ce1d5a0, 0x7ce185a0
Caught exception in looking up space point ptr... 0x494106c0, 0x49410540
Caught exception in looking up space point ptr... 0x49410540, 0x49410000
Caught exception in looking up space point ptr... 0x49882dd0, 0x49866d10
Caught exception in looking up space point ptr... 0x49866d10, 0x49853a70
Caught exception in looking up space point ptr... 0x84d81050, 0x768592b0
Caught exception in looking up space point ptr... 0x768592b0, 0x84d81050
Caught exception in looking up space point ptr... 0x7af98f00, 0xb4f5b920
Caught exception in looking up space point ptr... 0xb4f5b920, 0x7af98f00
Caught exception in looking up space point ptr... 0xabc02320, 0xabc02190
Caught exception in looking up space point ptr... 0xabc02190, 0xabc02320
Caught exception in looking up space point ptr... 0x71250010, 0xb4ab22c0
Caught exception in looking up space point ptr... 0xb4ab22c0, 0x71250010
Caught exception in looking up space point ptr... 0x3f6ee110, 0x3f6f11a0
Caught exception in looking up space point ptr... 0x3f6f05a0, 0x3f6ee110
Caught exception in looking up space point ptr... 0x8745d6e0, 0x8745d8c0
Caught exception in looking up space point ptr... 0x8745d8c0, 0x8745d6e0
Caught exception in looking up space point ptr... 0x4c379050, 0x4c378ec0
Caught exception in looking up space point ptr... 0x4c378ec0, 0x4c378ba0
++++>>>> total num hits: 137304, num free: 132381
04-Feb-2026 00:48:19 UTC Closed output file "np02vd_raw_run042433_0156_df-s04-d0_dw_0_20260203T194125_reco_stage0_20260204T004819_offline.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 136.01 153.069 170.455 152.438 9.2711 19
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 8.5489e-05 0.000114689 0.000301855 9.4342e-05 5.26491e-05 19
produce:tpcrawdecoder:PDVDTPCReader 17.7564 17.9903 18.9971 17.9385 0.266585 19
produce:triggerrawdecoder:PDVDTriggerReader4 0.682025 0.690584 0.714161 0.687426 0.00949129 19
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0229554 0.0232999 0.0253295 0.0232018 0.000510079 19
produce:ctbrawdecoder:PDHDCTBRawDecoder 0.0229588 0.0232368 0.0239155 0.0231361 0.000289189 19
produce:beamevent:BeamEvent 0.000114513 0.000213322 0.00128303 0.00014635 0.000254318 19
produce:pdvddaphne:DAPHNEReaderPDVD 3.09054 3.39833 3.68566 3.42046 0.189036 19
produce:ophit:OpHitFinder 0.0321603 0.0409846 0.0462249 0.0410498 0.00335988 19
produce:wclsdatavd:WireCellToolkit 91.394 105.37 119.227 104.161 7.17326 19
produce:gaushit:GausHitFinder 0.677582 1.38197 2.02565 1.43938 0.333285 19
produce:nhitsfilter:NumberOfHitsFilter 0.000187382 0.000339302 0.000460564 0.00034463 7.05501e-05 19
produce:reco3d:SpacePointSolver 11.6262 16.1322 19.8405 15.8324 2.28269 19
produce:hitpdune:DisambigFromSpacePoints 0.134143 0.19574 0.277234 0.186156 0.0413596 19
produce:cluster3d:Cluster3D 1.40441 2.56431 5.10373 2.45085 0.821815 19
[art]:TriggerResults:TriggerResultInserter 2.9735e-05 4.45102e-05 0.000138188 3.964e-05 2.31085e-05 19
end_path:out1:RootOutput 4.257e-06 9.34884e-06 3.7416e-05 7.491e-06 6.97743e-06 19
end_path:out1:RootOutput(write) 4.09067 5.20745 6.00289 5.44541 0.649044 19
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5559.48 MB
Peak resident set size usage (VmHWM): 3360.12 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np02vd_raw_run042433_0156_df-s04-d0_dw_0_20260203T194125_reco_stage0_20260204T004819_offline.root
Forming reco metadata
Successfully opened file np02vd_raw_run042433_0156_df-s04-d0_dw_0_20260203T194125_reco_stage0_20260204T004819_offline.root
Ran successfully
{
"name": "np02vd_raw_run042433_0156_df-s04-d0_dw_0_20260203T194125_reco_stage0_20260204T004819_offline.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_17_00d00",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage0_protodunevd_offline.fcl",
"dune.campaign": "vd-protodune-det-reco-test",
"core.start_time": 1770163133.0,
"core.end_time": 1770166100.0,
"core.events": [
17794,
17800,
17806,
17812,
17818,
17824,
17830,
17836,
17842,
17848,
17854,
17860,
17866,
17872,
17878,
17884,
17890,
17896,
17902
],
"core.event_count": 19,
"core.first_event_number": 17794,
"core.last_event_number": 17902,
"core.data_stream": "cosmics",
"core.file_type": "detector",
"core.run_type": "vd-protodune",
"core.runs": [
42433
],
"core.runs_subruns": [
4243300001
]
},
"parents": [
{
"did": "vd-protodune:np02vd_raw_run042433_0156_df-s04-d0_dw_0_20260203T194125.hdf5"
}
]
} 