Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🕵🏻 Double-check evaluation reward benchmarks #302

Merged
merged 1 commit into from
May 29, 2024

Conversation

JuaniRios
Copy link
Contributor

@JuaniRios JuaniRios commented May 22, 2024

What?

  • Small warning fixes
  • Run the benchmark for evaluator rewards and see max weight with 512 max evaluations

Screenshots (optional)

image.png

Anything Else?

  • Reducing evaluations to 512 was a good decision.

@JuaniRios JuaniRios mentioned this pull request May 22, 2024
Copy link
Contributor Author

JuaniRios commented May 22, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @JuaniRios and the rest of your teammates on Graphite Graphite

@lrazovic lrazovic force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from 4aa8414 to 6bab3a7 Compare May 22, 2024 11:58
@JuaniRios JuaniRios requested review from lrazovic and vstam1 May 22, 2024 12:44
@JuaniRios JuaniRios marked this pull request as ready for review May 22, 2024 12:44
Copy link

graphite-app bot commented May 22, 2024

Graphite Automations

"Auto-assign PRs to author" took an action on this PR • (05/22/24)

1 assignee was added to this PR based on Juan Ignacio Rios's automation.

@lrazovic lrazovic force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from 6bab3a7 to 284add0 Compare May 22, 2024 13:14
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch 3 times, most recently from 7282303 to e6e9eb2 Compare May 22, 2024 15:31
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from e6e9eb2 to 89d340a Compare May 24, 2024 09:42
@JuaniRios JuaniRios changed the title Double-check evaluation reward benchmarks 🕵🏻 Double-check evaluation reward benchmarks May 24, 2024
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from 89d340a to 9ef6bb5 Compare May 28, 2024 14:35
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from 9ef6bb5 to 9c072f8 Compare May 29, 2024 10:07
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from 9c072f8 to a6e7c78 Compare May 29, 2024 11:29
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from a6e7c78 to f08750f Compare May 29, 2024 12:01
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from f08750f to 254e6de Compare May 29, 2024 12:26
Copy link
Contributor Author

JuaniRios commented May 29, 2024

Merge activity

  • May 29, 8:27 AM EDT: @JuaniRios started a stack merge that includes this pull request via Graphite.
  • May 29, 8:28 AM EDT: Graphite rebased this pull request as part of a merge.
  • May 29, 8:29 AM EDT: @JuaniRios merged this pull request with Graphite.

Base automatically changed from 05-21-new-benches-3 to main May 29, 2024 12:27
@JuaniRios JuaniRios force-pushed the 05-22-double-check_evaluation_reward_benchmarks branch from 254e6de to 7b32f16 Compare May 29, 2024 12:28
@JuaniRios JuaniRios merged commit 3812826 into main May 29, 2024
@JuaniRios JuaniRios deleted the 05-22-double-check_evaluation_reward_benchmarks branch May 29, 2024 12:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants