New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optim Perf Signal Detected by TorchBench CI on '147ac6b312c4c71e89013be592dc519c81fcac4e' #2002

Closed

github-actions bot opened this issue Oct 22, 2023 · 1 comment

Labels

torchbench-perf-report

github-actions bot commented Oct 22, 2023

TorchBench CI has detected a performance signal or runtime regression.

Base PyTorch commit: 6ffe31abcae7d580c451cea195bd52258c72ac81

Affected PyTorch commit: 147ac6b312c4c71e89013be592dc519c81fcac4e

Affected Tests:

timm_vision_transformer_large, RAdam, cuda, differentiable: +79.47731%
resnet152, Adadelta, cuda, maximize: +30.76596%
DALLE2_pytorch, Adagrad, cuda, default: +30.41673%
DALLE2_pytorch, Adagrad, cuda, maximize: +43.77639%
DALLE2_pytorch, Adagrad, cuda, foreach: +34.07074%
DALLE2_pytorch, AdamW, cuda, default: +42.56468%
DALLE2_pytorch, SGD, cuda, maximize: +47.49684%
DALLE2_pytorch, RAdam, cuda, foreach: +49.50562%

Tests that were no longer run on affected commit:

Tests that were newly added on affected commit:

Runtime regressions found?
An errors log was found. Please investigate runtime errors by looking into the logs of the workflow linked.

GitHub workflow that triggered this issue: https://github.com/pytorch/benchmark/actions/runs/6601565408

github-actions bot added the torchbench-perf-report label

Contributor

janeyx99 commented Oct 22, 2023

noise should be handled after #2000

janeyx99 closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment