Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix the use of PyTorch pin commit in MacOS #7558

Merged
merged 8 commits into from
Jan 9, 2025
Merged

Conversation

huydhn
Copy link
Contributor

@huydhn huydhn commented Jan 9, 2025

I missed this in #6564, we need to apply the same fix for MacOS and add a test to make sure that PyTorch built from the pin commit is used instead of nightly.

@huydhn huydhn requested a review from swolchok January 9, 2025 00:05
Copy link

pytorch-bot bot commented Jan 9, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/7558

Note: Links to docs will display an error until the docs builds have been completed.

⏳ No Failures, 1 Pending

As of commit 023381e with merge base 39e8538 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 9, 2025
@huydhn huydhn requested a review from mergennachin January 9, 2025 00:07
Copy link
Contributor

@swolchok swolchok left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

broken: https://github.com/pytorch/executorch/actions/runs/12681330349/job/35344881397?pr=7558#step:9:435

I don't like repeating the computer, but having green CI is the only point for this change, so I have to request changes. please feel free to ping me when it's fixed for expedited review

@@ -40,6 +40,41 @@ install_pip_dependencies() {
popd || return
}

install_domains() {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These functions were removed by #4826. This was wrong for CI job and we need to bring them back.

Copy link
Contributor

@swolchok swolchok left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shipit

@swolchok
Copy link
Contributor

swolchok commented Jan 9, 2025

now we have distributed/triton import failures https://github.com/pytorch/executorch/actions/runs/12681512566/job/35345401675?pr=7558#step:9:50147 . leaving accept in place because we should be directionally correct at this point and I trust you not to ship a red PR

@huydhn
Copy link
Contributor Author

huydhn commented Jan 9, 2025

now we have distributed/triton import failures https://github.com/pytorch/executorch/actions/runs/12681512566/job/35345401675?pr=7558#step:9:50147 . leaving accept in place because we should be directionally correct at this point and I trust you not to ship a red PR

Yeah, this is new. I will make sure to get to the bottom of this before landing the change. I need to compare the list of dependencies before (using PT nightly) and after this change (using PT built from source)

@huydhn
Copy link
Contributor Author

huydhn commented Jan 9, 2025

Darn, a GitHub outage is happening https://www.githubstatus.com/incidents/plgzz71xn6zq, need to wait for this storm to pass while testing this locally

@huydhn
Copy link
Contributor Author

huydhn commented Jan 9, 2025

It's working now, it turns out that nightly binaries are built with USE_DISTRIBUTED=1 for MacOS https://github.com/pytorch/pytorch/blob/main/.ci/wheel/build_wheel.sh#L182. Last time, I remembered that distributed wasn't available on MacOS, this has probably been changed.

@huydhn huydhn merged commit 84e377a into main Jan 9, 2025
81 checks passed
@huydhn huydhn deleted the fix-macos-pinned-commit branch January 9, 2025 06:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: not user facing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants