Skip to content

Commit

Permalink
Merge branch 'master' into master
Browse files Browse the repository at this point in the history
  • Loading branch information
Saharshjain78 authored Jun 25, 2024
2 parents 1712307 + 83f6d21 commit 3270b7a
Show file tree
Hide file tree
Showing 97 changed files with 1,423 additions and 246 deletions.
3 changes: 2 additions & 1 deletion .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
Expand Up @@ -88,6 +88,7 @@
/src/frontends/tensorflow_common/ @openvinotoolkit/openvino-tf-frontend-maintainers
/src/frontends/tensorflow_lite/ @openvinotoolkit/openvino-tf-frontend-maintainers
/src/frontends/pytorch/ @openvinotoolkit/openvino-pytorch-frontend-maintainers
/src/frontends/jax/ @openvinotoolkit/openvino-jax-frontend-maintainers

# OpenVINO ONNX Frontend:
/src/frontends/onnx/ @openvinotoolkit/openvino-onnx-frontend-maintainers
Expand All @@ -99,7 +100,7 @@
/tests/layer_tests/ @openvinotoolkit/openvino-tests-maintainers @openvinotoolkit/openvino-mo-maintainers
/tests/layer_tests/pytorch_tests/ @openvinotoolkit/openvino-pytorch-frontend-maintainers
/tests/layer_tests/tensorflow_tests @openvinotoolkit/openvino-tf-frontend-maintainers
/tests/layer_tests/jax_tests @openvinotoolkit/openvino-tf-frontend-maintainers
/tests/layer_tests/jax_tests @openvinotoolkit/openvino-tf-frontend-maintainers @openvinotoolkit/openvino-jax-frontend-maintainers
/tests/model_hub_tests @openvinotoolkit/openvino-tf-frontend-maintainers
/tests/model_hub_tests/pytorch @openvinotoolkit/openvino-pytorch-frontend-maintainers

Expand Down
23 changes: 19 additions & 4 deletions .github/components.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,9 @@ LP_transformations:
- TFL_FE
- ONNX_FE
- PDPD_FE
- JAX_FE
build:
- TOKENIZERS # TF_FE tests depends on tokenizers build

preprocessing:
revalidate:
Expand All @@ -32,12 +35,14 @@ CPU:
- PyTorch_FE
- TF_FE
- ONNX_FE
- JAX_FE
build:
- AUTO
- HETERO
- AUTO_BATCH
- TEMPLATE
- IR_FE
- TOKENIZERS # TF_FE tests depends on tokenizers build

GPU:
build:
Expand Down Expand Up @@ -124,7 +129,7 @@ TF_FE:
build:
- CPU
- Python_API
- TOKENIZERS
- TOKENIZERS # TF_FE tests depends on tokenizers build

TFL_FE:
revalidate:
Expand All @@ -139,7 +144,13 @@ PyTorch_FE:
build:
- CPU
- Python_API
- TOKENIZERS

JAX_FE:
revalidate:
- MO
build:
- CPU
- Python_API

C_API:
build:
Expand All @@ -155,6 +166,7 @@ Python_API:
- samples
- MO
- tools
- TF_FE
build:
- CPU
- HETERO
Expand All @@ -164,9 +176,10 @@ Python_API:
- IR_FE
- ONNX_FE
- PDPD_FE
- TF_FE
- TFL_FE
- PyTorch_FE
- JAX_FE
- TOKENIZERS # TF_FE tests depends on tokenizers build

JS_API:
build:
Expand Down Expand Up @@ -200,6 +213,7 @@ MO:
- TF_FE
build:
- Python_API
- TOKENIZERS # TF_FE tests depends on tokenizers build

tools:
build:
Expand All @@ -223,5 +237,6 @@ ONNX_RT:
build: []

TOKENIZERS:
revalidate: []
revalidate:
- TF_FE
build: []
4 changes: 4 additions & 0 deletions .github/labeler.yml
Original file line number Diff line number Diff line change
Expand Up @@ -161,6 +161,10 @@
- any: ['tests/model_hub_tests/**',
'!tests/model_hub_tests/tensorflow/**/*']

'category: JAX FE':
- 'src/frontends/jax/**/*'
- 'tests/layer_tests/jax_tests/**/*'

'category: tools':
- any: ['tools/**',
'!tools/mo/**/*',
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/code_style.yml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ jobs:

- name: suggester / clang-format
if: startsWith(github.event_name, 'pull_request')
uses: reviewdog/action-suggester@42b08604516990e201b3c21902cc13c6a0ee5fe8 # v1.14.0
uses: reviewdog/action-suggester@a1d57ff096639094e0ba35ef3039e79316364796 # v1.15.0
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
level: warning
Expand Down Expand Up @@ -60,7 +60,7 @@ jobs:
# always provide suggestions even for skipped scripts in ov_shellcheck tagret
- name: ShellCheck action
if: always()
uses: reviewdog/action-shellcheck@3546242c869924d13293e38e6289e00a26468e02 # v1.22.0
uses: reviewdog/action-shellcheck@52f34f737a16c65b8caa8c51ae1b23036afe5685 # v1.23.0
with:
level: style
reporter: github-pr-review
Expand Down
14 changes: 9 additions & 5 deletions .github/workflows/job_samples_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,11 +7,11 @@ on:
description: 'Machine on which the tests would run'
type: string
required: true
image:
description: 'Docker image in which the tests would run'
container:
description: 'JSON to be converted to the value of the "container" configuration for the job'
type: string
required: false
default: null
default: '{"image": null}'
affected-components:
description: 'Components that are affected by changes in the commit defined by the Smart CI Action'
type: string
Expand All @@ -21,9 +21,9 @@ permissions: read-all

jobs:
Samples:
timeout-minutes: 30
runs-on: ${{ inputs.runner }}
container:
image: ${{ inputs.image }}
container: ${{ fromJSON(inputs.container) }}
defaults:
run:
shell: bash
Expand Down Expand Up @@ -66,6 +66,8 @@ jobs:
run: brew install coreutils

- name: Fetch setup_python action
# Python is already installed on Ubuntu within Dockerfile
if: runner.os != 'Linux'
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7
with:
sparse-checkout: |
Expand All @@ -74,6 +76,8 @@ jobs:
path: 'openvino'

- name: Setup Python 3.11
# Python is already installed on Ubuntu within Dockerfile
if: runner.os != 'Linux'
uses: ./openvino/.github/actions/setup_python
with:
version: '3.11'
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/linux.yml
Original file line number Diff line number Diff line change
Expand Up @@ -315,7 +315,7 @@ jobs:
uses: ./.github/workflows/job_samples_tests.yml
with:
runner: 'aks-linux-4-cores-16gb'
image: ${{ fromJSON(needs.docker.outputs.images).ov_test.ubuntu_20_04_x64 }}
container: '{"image": "${{ fromJSON(needs.docker.outputs.images).ov_test.ubuntu_20_04_x64 }}", "volumes": ["/mount:/mount"]}'
affected-components: ${{ needs.smart_ci.outputs.affected_components }}

JS_API:
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/linux_arm64.yml
Original file line number Diff line number Diff line change
Expand Up @@ -309,7 +309,7 @@ jobs:
uses: ./.github/workflows/job_samples_tests.yml
with:
runner: 'aks-linux-16-cores-arm'
image: ${{ fromJSON(needs.docker.outputs.images).ov_test.ubuntu_20_04_arm64 }}
container: '{"image": "${{ fromJSON(needs.docker.outputs.images).ov_test.ubuntu_20_04_arm64 }}", "volumes": ["/mount:/mount"]}'
affected-components: ${{ needs.smart_ci.outputs.affected_components }}

JS_API:
Expand Down
14 changes: 11 additions & 3 deletions cmake/developer_package/api_validator/api_validator.cmake
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,11 @@
# SPDX-License-Identifier: Apache-2.0
#

if(WIN32)
function(ov_search_api_validator)
if(NOT ENABLE_API_VALIDATOR)
return()
endif()

# CMAKE_VS_WINDOWS_TARGET_PLATFORM_VERSION is only set when
# Visual Studio generators are used, but we need it
# when we use Ninja as well
Expand All @@ -11,8 +15,10 @@ if(WIN32)
string(REPLACE "\\" "" WINDOWS_SDK_VERSION $ENV{WindowsSDKVersion})
set(CMAKE_VS_WINDOWS_TARGET_PLATFORM_VERSION ${WINDOWS_SDK_VERSION})
message(STATUS "Use ${CMAKE_VS_WINDOWS_TARGET_PLATFORM_VERSION} Windows SDK version")
# set to parent scope as well for later usage in '_ov_add_api_validator_post_build_step'
set(CMAKE_VS_WINDOWS_TARGET_PLATFORM_VERSION ${WINDOWS_SDK_VERSION} PARENT_SCOPE)
else()
message(FATAL_ERROR "WindowsSDKVersion environment variable is not set,\
message(FATAL_ERROR "WindowsSDKVersion environment variable is not set,\
can't find Windows SDK version. Try to use vcvarsall.bat script")
endif()
endif()
Expand Down Expand Up @@ -41,7 +47,9 @@ can't find Windows SDK version. Try to use vcvarsall.bat script")
message(STATUS "Found apivalidator: ${ONECORE_API_VALIDATOR}")
endif()
endif()
endif()
endfunction()

ov_search_api_validator()

function(_ov_add_api_validator_post_build_step_recursive)
cmake_parse_arguments(API_VALIDATOR "" "TARGET" "" ${ARGN})
Expand Down
1 change: 1 addition & 0 deletions cmake/developer_package/compile_flags/sdl.cmake
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,7 @@ if(CMAKE_COMPILER_IS_GNUCXX OR OV_COMPILER_IS_CLANG OR OV_COMPILER_IS_INTEL_LLVM
endif()
elseif(CMAKE_CXX_COMPILER_ID STREQUAL "MSVC")
set(OV_C_CXX_FLAGS "${OV_C_CXX_FLAGS} /sdl /guard:cf")
set(OV_LINKER_FLAGS "${OV_LINKER_FLAGS} /guard:cf")
endif()

if(ENABLE_QSPECTRE)
Expand Down
2 changes: 2 additions & 0 deletions cmake/features.cmake
Original file line number Diff line number Diff line change
Expand Up @@ -192,6 +192,8 @@ ov_dependent_option(ENABLE_JS "Enables JS API building" ON "NOT ANDROID;NOT EMSC

ov_option(ENABLE_OPENVINO_DEBUG "Enable output for OPENVINO_DEBUG statements" OFF)

ov_dependent_option (ENABLE_API_VALIDATOR "Enables API Validator usage" ON "WIN32" OFF)

if(NOT BUILD_SHARED_LIBS AND ENABLE_OV_TF_FRONTEND)
set(FORCE_FRONTENDS_USE_PROTOBUF ON)
else()
Expand Down
4 changes: 2 additions & 2 deletions docs/articles_en/learn-openvino.rst
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Learn OpenVINO

.. meta::
:description: Explore learning materials, including interactive
Python learn-openvino/interactive-tutorials-python and sample console applications that explain
Python tutorials and sample console applications that explain
how to use OpenVINO features.


Expand All @@ -26,7 +26,7 @@ accommodating different learning needs, which means you should find it useful if
as well as an experienced user.

| :doc:`Tutorials <learn-openvino/interactive-tutorials-python>`
| A collection of interactive Python learn-openvino/interactive-tutorials-python. It introduces you to the OpenVINO™ toolkit explaining how to use the Python API and tools for optimized deep learning inference. The learn-openvino/interactive-tutorials-python are available in Jupyter notebooks and can be run in your browser. No installation required.
| A collection of interactive Python tutorials. It introduces you to the OpenVINO™ toolkit explaining how to use the Python API and tools for optimized deep learning inference. The tutorials are available in Jupyter notebooks and can be run in your browser. No installation required.
| :doc:`OpenVINO Samples <learn-openvino/openvino-samples>`
| The OpenVINO samples (Python and C++) are simple console applications that show how to use specific OpenVINO API features. They can assist you in executing tasks such as loading a model, running inference, querying particular device capabilities, etc.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -61,15 +61,14 @@ How AUTO Works
##############

To put it simply, when loading the model to the first device on the list fails, AUTO will try to load it to the next device in line, until one of them succeeds.
What is important, **AUTO starts inference with the CPU of the system by default**, as it provides very low latency and can start inference with no additional delays.
What is important, **AUTO starts inference with the CPU of the system by default unless there is model cached for the best suited device**, as it provides very low latency and can start inference with no additional delays.
While the CPU is performing inference, AUTO continues to load the model to the device best suited for the purpose and transfers the task to it when ready.
This way, the devices which are much slower in compiling models, GPU being the best example, do not impact inference at its initial stages.
For example, if you use a CPU and a GPU, the first-inference latency of AUTO will be better than that of using GPU alone.

Note that if you choose to exclude CPU from the priority list or disable the initial
CPU acceleration feature via ``ov::intel_auto::enable_startup_fallback``, it will be
unable to support the initial model compilation stage. The models with dynamic
input/output or :doc:`stateful operations <../stateful-models>`
unable to support the initial model compilation stage. The models with :doc:`stateful operations <../stateful-models>`
will be loaded to the CPU if it is in the candidate list. Otherwise,
these models will follow the normal flow and be loaded to the device based on priority.

Expand Down
2 changes: 1 addition & 1 deletion docs/dev/build_windows.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@ Supported configurations:
3. After the build process finishes, export the newly built Python libraries to the user environment variables:
```
set PYTHONPATH=<openvino_repo>/bin/<arch>/Release/python;%PYTHONPATH%
set OPENVINO_LIB_PATHS=<openvino_repo>/bin/<arch>/Release;%OPENVINO_LIB_PATH%
set OPENVINO_LIB_PATHS=<openvino_repo>/bin/<arch>/Release;<openvino_repo>/temp/tbb/bin
```
or install the wheel with pip:
```
Expand Down
Loading

0 comments on commit 3270b7a

Please sign in to comment.