Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[vpj][all] Create a new module for offline components to reduce leakage #1205

Merged
merged 1 commit into from
Sep 28, 2024

Conversation

nisargthakkar
Copy link
Contributor

Create a new module for offline components to reduce leakage

Recently, we moved some shared classes into venice-common to share common functionality. To do this, we added hadoop-common library into venice-common. However, this leaks hadoop-common into online components too which is not desired. Moved these classes into a venice-hadoop-common package

How was this PR tested?

GHCI

Does this PR introduce any user-facing changes?

  • No. You can skip the rest of this section.
  • Yes. Make sure to explain your proposed changes and call out the behavior change.

@FelixGV
Copy link
Contributor

FelixGV commented Sep 28, 2024

Who needs to depend on this module besides VPJ?

Copy link
Contributor

@haoxu07 haoxu07 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for preparing this!

@nisargthakkar nisargthakkar merged commit b932806 into linkedin:main Sep 28, 2024
45 checks passed
@nisargthakkar nisargthakkar deleted the hadoopCommon branch September 28, 2024 20:54
@nisargthakkar
Copy link
Contributor Author

Who needs to depend on this module besides VPJ?

We have an ETL module internally that would benefit from this. This class was originally copied from there into OSS. We plan to release in open-source at some point. It is just a matter of allocating some bandwidth for

@FelixGV
Copy link
Contributor

FelixGV commented Sep 29, 2024

Who needs to depend on this module besides VPJ?

We have an ETL module internally that would benefit from this. This class was originally copied from there into OSS. We plan to release in open-source at some point. It is just a matter of allocating some bandwidth for

Creating a new module just for the sake of this proprietary ETL depender does not seem quite right... can ETL depend on all of VPJ instead?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants