Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GHA] Enable thread sanitizer #26634

Open
wants to merge 73 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
26978c5
enabled all builds
mryzhov Sep 17, 2024
0c09b06
enable pull events
mryzhov Sep 17, 2024
0c4c277
added tsan suppresions.txt
mryzhov Sep 18, 2024
28a3501
fixed path in the tests
mryzhov Sep 18, 2024
0b3f26a
added missed sting
mryzhov Sep 18, 2024
412d661
update suppresions
mryzhov Sep 18, 2024
9f11960
set additional filters
mryzhov Sep 18, 2024
6c7e435
ignore list
mryzhov Sep 18, 2024
f2a964d
ignore onnx too
mryzhov Sep 18, 2024
416fef4
exlude tsan from configure
mryzhov Sep 19, 2024
3f1100a
gcc
mryzhov Sep 20, 2024
a399af4
removed clang
mryzhov Sep 20, 2024
0eccfff
disable blacklist
mryzhov Sep 20, 2024
0897a1b
Revert "disable blacklist"
mryzhov Sep 23, 2024
d97eab0
Revert "removed clang"
mryzhov Sep 23, 2024
0d07a86
Revert "gcc"
mryzhov Sep 23, 2024
036fb3a
disable onnx fe
mryzhov Sep 23, 2024
fa02e63
ENABLE_SYSTEM_PROTOBUF=ON
mryzhov Sep 23, 2024
1a52e59
fixed protobuf builds
mryzhov Sep 23, 2024
1dad8fe
Revert "disable onnx fe"
mryzhov Sep 23, 2024
a8d8ce2
Revert "ENABLE_SYSTEM_PROTOBUF=ON"
mryzhov Sep 23, 2024
7b39c02
add condition for ENABLE_THREAD_SANITIZER
mryzhov Sep 24, 2024
fc82d2a
final variant
mryzhov Sep 24, 2024
44c6547
revert tsan blacklist
mryzhov Sep 24, 2024
a217ee7
rerfactoring
mryzhov Sep 24, 2024
809b42d
Apply suggestions from code review
mryzhov Sep 24, 2024
02b466e
fixed envs
mryzhov Sep 24, 2024
0f5fe7e
use docker images
mryzhov Sep 24, 2024
8d10090
fixed image name
mryzhov Sep 24, 2024
27cb932
dedicated sanitizers image
mryzhov Sep 24, 2024
9fc4eba
ccache
mryzhov Sep 24, 2024
d909165
set CMAKE_CXX_COMPILER_LAUNCHER
mryzhov Sep 24, 2024
f119c03
fixed typo
mryzhov Sep 24, 2024
c134d2f
changed test image
mryzhov Sep 24, 2024
2c67e75
improved cache
mryzhov Sep 24, 2024
b7a0bc1
revert test envs
mryzhov Sep 24, 2024
e3512c8
di not cleanup build
mryzhov Sep 24, 2024
c0854a3
increased ccache size
mryzhov Sep 25, 2024
bd466ea
ccache size 20g
mryzhov Sep 25, 2024
abf58b2
changed steps conditionsa
mryzhov Sep 25, 2024
6119654
fixed syntax
mryzhov Sep 25, 2024
26f13f8
use gcc10
mryzhov Sep 25, 2024
23b0e94
-revert lubsan
mryzhov Sep 25, 2024
cf62916
-revert lubsan
mryzhov Sep 25, 2024
7288c03
debug
mryzhov Sep 25, 2024
7dfe47a
tmp disable tests
mryzhov Sep 25, 2024
26e2713
check compilers
mryzhov Sep 26, 2024
f9177af
enabled tests
mryzhov Sep 26, 2024
7f0ae9a
final flags
mryzhov Sep 27, 2024
c84fb76
debug info
mryzhov Sep 27, 2024
9760f6a
cleanup the ccache
mryzhov Sep 27, 2024
cc31b94
reverted tests
mryzhov Sep 27, 2024
90c61ce
sccache instead of ccache
mryzhov Sep 30, 2024
cea5621
change sccache prefix
mryzhov Sep 30, 2024
04bdd25
sccache size 50G
mryzhov Sep 30, 2024
b0e325a
disabled cleanup cache steps
mryzhov Sep 30, 2024
213d334
Revert "disabled cleanup cache steps"
mryzhov Sep 30, 2024
3cb0d9a
SCCACHE_AZURE_CONNECTION_STRING
mryzhov Sep 30, 2024
d518608
diadable cache cleanup
mryzhov Oct 1, 2024
36aa03f
test old tes image
mryzhov Oct 1, 2024
4927057
remove commented code
mryzhov Oct 1, 2024
b33f739
split jobs
mryzhov Oct 1, 2024
87b25aa
Revert "test old tes image"
mryzhov Oct 1, 2024
88c08a9
Revert "remove commented code"
mryzhov Oct 1, 2024
c1e3895
install python for the tests
mryzhov Oct 2, 2024
d266580
fixed descriptions
mryzhov Oct 2, 2024
8481b39
parallel gzip
mryzhov Oct 2, 2024
74d0b67
setup python
mryzhov Oct 2, 2024
0cdfc56
fixed tar command
mryzhov Oct 2, 2024
c7307d2
removed fsanitize-undefined-trap-on-error
mryzhov Oct 2, 2024
0ba8bc3
revert test deps
mryzhov Oct 2, 2024
0d63b9a
increase runner ram
mryzhov Oct 3, 2024
7ad87dd
Merge branch 'master' into gha/sanitizers
mryzhov Oct 3, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/dockerfiles/docker_tag
Original file line number Diff line number Diff line change
@@ -1 +1 @@
pr-26586
pr-26634
70 changes: 70 additions & 0 deletions .github/dockerfiles/ov_build/sanitizers/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,70 @@
ARG REGISTRY="docker.io"
FROM ${REGISTRY}/library/ubuntu:20.04

USER root

# APT configuration
RUN echo 'Acquire::Retries "10";' > /etc/apt/apt.conf && \
echo 'APT::Get::Assume-Yes "true";' >> /etc/apt/apt.conf && \
echo 'APT::Get::Fix-Broken "true";' >> /etc/apt/apt.conf && \
echo 'APT::Get::no-install-recommends "true";' >> /etc/apt/apt.conf

ENV DEBIAN_FRONTEND="noninteractive" \
TZ="Europe/London"

RUN apt-get update && \
apt-get install software-properties-common && \
add-apt-repository --yes --no-update ppa:git-core/ppa && \
add-apt-repository --yes --no-update ppa:deadsnakes/ppa && \
apt-get update && \
apt-get install \
curl \
git \
gpg-agent \
tzdata \
# parallel gzip
pigz \
# Pythons
python3.9-dev \
python3.9-venv \
python3.9-distutils \
# Compiler \
gcc-10 \
g++-10 \
&& \
rm -rf /var/lib/apt/lists/*

# Install build dependencies
ADD install_build_dependencies.sh /install_build_dependencies.sh
RUN chmod +x /install_build_dependencies.sh && \
/install_build_dependencies.sh && \
rm -rf /var/lib/apt/lists/*

# Set gcc-10 as a default compiler
RUN update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-10 30 && \
update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-10 30

# Install sscache
ARG SCCACHE_VERSION="v0.7.5"
ENV SCCACHE_HOME="/opt/sccache" \
SCCACHE_PATH="/opt/sccache/sccache"

RUN mkdir ${SCCACHE_HOME} && cd ${SCCACHE_HOME} && \
SCCACHE_ARCHIVE="sccache-${SCCACHE_VERSION}-x86_64-unknown-linux-musl.tar.gz" && \
curl -SLO https://github.com/mozilla/sccache/releases/download/${SCCACHE_VERSION}/${SCCACHE_ARCHIVE} && \
tar -xzf ${SCCACHE_ARCHIVE} --strip-components=1 && rm ${SCCACHE_ARCHIVE}

ENV PATH="$SCCACHE_HOME:$PATH"

# Setup pip
ENV PIP_VERSION="24.0"
RUN curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py && \
python3 get-pip.py --no-cache-dir pip==${PIP_VERSION} && \
python3.9 get-pip.py --no-cache-dir pip==${PIP_VERSION} && \
rm -f get-pip.py

# Use Python 3.9 as default instead of Python 3.8
# Using venv here 'cause other methods to switch the default Python on Ubuntu 20 break both system and wheels build
RUN python3.9 -m venv venv
ENV PATH="/venv/bin:$PATH"
ENV PIP_CACHE_DIR=/mount/caches/pip/linux/${PIP_VERSION}
2 changes: 2 additions & 0 deletions .github/dockerfiles/ov_build/ubuntu_20_04_x64/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,8 @@ RUN apt-get update && \
# Compiler \
gcc-10 \
g++-10 \
clang \
lld \
Comment on lines +34 to +35
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since a dedicated image is used, I think these changes could be reverted.

&& \
rm -rf /var/lib/apt/lists/*

Expand Down
Loading
Loading