Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix pytest benchmarks and shark_tank generation. #1632

Merged
merged 17 commits into from
Aug 16, 2023
Merged

Fix pytest benchmarks and shark_tank generation. #1632

merged 17 commits into from
Aug 16, 2023

Conversation

monorimet
Copy link
Collaborator

@monorimet monorimet commented Jul 7, 2023 •
edited
Loading

  • fix setup_venv.sh for benchmarks/imports etc.
  • unpin torch-mlir
  • fix torch benchmarks in SharkBenchmarkRunner
  • generate SD artifacts using build_tools/stable_diffusion_testing.py and --import_mlir
  • decouple SD gen from tank/generate_sharktank for now

@monorimet monorimet changed the title (pytest) fix baseline benchmarks for cpu and cuda. Fix pytest benchmarks and shark_tank generation. Jul 11, 2023
@monorimet
Copy link
Collaborator Author

iree-org/iree#14303 updates some experimental TF mlir API imports but with current pypi versions of tf-nightly the API does not match. Switching tf model generation off for now.

powderluv
powderluv reviewed Aug 2, 2023
View reviewed changes
setup.py Outdated Show resolved Hide resolved
@monorimet
Update all_models.csv
c0ef7d1
@monorimet
Update setup.py
00cc070
@monorimet
Update setup_venv.ps1
9bf11e7
@monorimet
Update pyproject.toml
973ef6f 
Bump minimum torch-mlir version
@monorimet
Update test-models.yml
ee64903 
Force update packages to unstick torch-mlir version
dan-garvey
dan-garvey previously approved these changes Aug 14, 2023
View reviewed changes
shark/shark_benchmark_runner.py Outdated Show resolved Hide resolved
@monorimet monorimet merged commit cb50934 into main Aug 16, 2023
3 of 6 checks passed
@monorimet monorimet deleted the ean-pytest-bench branch August 16, 2023 22:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@powderluv powderluv powderluv approved these changes

@dan-garvey dan-garvey dan-garvey left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@monorimet @powderluv @dan-garvey