Skip to content

Commit

Permalink
[GPU] Adjust usm_host memory usage for InferRequest tensors
Browse files Browse the repository at this point in the history
  • Loading branch information
sshlyapn committed Oct 3, 2024
1 parent 17ecf03 commit 11d42c6
Showing 1 changed file with 6 additions and 3 deletions.
9 changes: 6 additions & 3 deletions src/plugins/intel_gpu/src/plugin/sync_infer_request.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -34,9 +34,12 @@ namespace {
inline bool can_use_usm_host(const cldnn::engine& engine) {
auto can_use_usm = engine.use_unified_shared_memory();

if (engine.get_device_info().gfx_ver.major == 12 && engine.get_device_info().gfx_ver.minor == 60) {
// WA: Disable USM host memory for infer request`s tensors for PVC as
// it has performance issues in case of host <-> device data transfers inside kernels
const auto& device_info = engine.get_device_info();
if ((device_info.gfx_ver.major == 12 && device_info.gfx_ver.minor == 60) ||
(device_info.gfx_ver.major >= 20 && device_info.dev_type == cldnn::device_type::discrete_gpu)) {
// WA: Disable USM host memory for infer request`s tensors for PVC and subsequent dGPUs, as kernel access
// to system memory is slower than using an explicit memcpy (Host <-> Device) call with the copy engine
// Driver tickets with additional details: 6155, 10054
GPU_DEBUG_TRACE << "Do not use usm_host for performance issue" << std::endl;
can_use_usm = false;
}
Expand Down

0 comments on commit 11d42c6

Please sign in to comment.