Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[core] Postable InternalKVInterface and GcsTableStorage. #49704

Merged
merged 16 commits into from
Jan 11, 2025

Conversation

rynewang
Copy link
Contributor

@rynewang rynewang commented Jan 7, 2025

InternalKVInterface and GcsTableStorage have async APIs that take std::function callbacks. Change them to Postable to allow callers (various Gcs.*Managers) to live on different threads.

To accomodate, each affected Managers are added a default IO Context if not already. Also updated Postable to accept multiple argument TransformArg.

Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
@rynewang rynewang requested a review from a team as a code owner January 7, 2025 22:51
@rynewang
Copy link
Contributor Author

rynewang commented Jan 7, 2025

cpp tests should be failing. Other than that, reviewable.

@jjyao jjyao added the go add ONLY when ready to merge, run all tests label Jan 8, 2025
Copy link
Collaborator

@jjyao jjyao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LG

src/ray/gcs/gcs_server/gcs_function_manager.h Show resolved Hide resolved
src/ray/gcs/gcs_server/gcs_server.cc Outdated Show resolved Hide resolved
src/ray/gcs/gcs_server/gcs_server.cc Outdated Show resolved Hide resolved
src/ray/gcs/gcs_server/gcs_worker_manager.cc Outdated Show resolved Hide resolved
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
instrumented_io_context &io_context)
: GcsActorTable(store_client, io_context) {}
MockedGcsActorTable(std::shared_ptr<gcs::StoreClient> store_client)
: GcsActorTable(store_client) {}
Copy link
Contributor

@dentiny dentiny Jan 8, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

move?

Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
…Interface

Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
Signed-off-by: Ruiyang Wang <rywang014@gmail.com>
@rynewang rynewang enabled auto-merge (squash) January 11, 2025 04:56
@rynewang rynewang merged commit 3b59a69 into ray-project:master Jan 11, 2025
6 checks passed
@rynewang rynewang deleted the postable-InternalKVInterface branch January 11, 2025 07:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
go add ONLY when ready to merge, run all tests
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants