Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add RebalanceConfig class to replace use of BaseConfiguration for rebalance configs #11730

Merged
merged 4 commits into from
Oct 4, 2023

Conversation

klsince
Copy link
Contributor

@klsince klsince commented Oct 3, 2023

As the configs for table rebalance get more and more, it's more consistent and manageable to define a class for them, thus RebalanceConfig class is added in this PR. Another need for this class is to de/serialize the configs to enable retry mechanism for rebalance as to be added in another PR.

The changes are pretty mechanical, with a few cleanup and quick fixes found along the way.

@codecov-commenter
Copy link

codecov-commenter commented Oct 3, 2023

Codecov Report

Merging #11730 (6b3bbd4) into master (f26faa4) will decrease coverage by 0.08%.
Report is 7 commits behind head on master.
The diff coverage is 75.18%.

@@             Coverage Diff              @@
##             master   #11730      +/-   ##
============================================
- Coverage     63.09%   63.01%   -0.08%     
  Complexity     1118     1118              
============================================
  Files          2342     2342              
  Lines        125890   125895       +5     
  Branches      19360    19362       +2     
============================================
- Hits          79434    79337      -97     
- Misses        40807    40895      +88     
- Partials       5649     5663      +14     
Flag Coverage Δ
integration <0.01% <0.00%> (ø)
integration1 <0.01% <0.00%> (ø)
integration2 0.00% <0.00%> (ø)
java-11 14.46% <75.18%> (-48.60%) ⬇️
java-17 62.94% <75.18%> (-0.02%) ⬇️
java-20 62.97% <75.18%> (+0.01%) ⬆️
temurin 63.01% <75.18%> (-0.08%) ⬇️
unittests 63.01% <75.18%> (-0.08%) ⬇️
unittests1 67.08% <0.00%> (-0.18%) ⬇️
unittests2 14.46% <75.18%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Coverage Δ
...va/org/apache/pinot/controller/ControllerConf.java 58.04% <ø> (ø)
...e/assignment/segment/OfflineSegmentAssignment.java 93.75% <100.00%> (-0.19%) ⬇️
.../assignment/segment/RealtimeSegmentAssignment.java 92.30% <100.00%> (-0.17%) ⬇️
...ntroller/helix/core/rebalance/RebalanceConfig.java 100.00% <100.00%> (ø)
...ntroller/helix/core/rebalance/TableRebalancer.java 68.58% <100.00%> (-0.40%) ⬇️
.../core/rebalance/ZkBasedTableRebalanceObserver.java 80.43% <100.00%> (ø)
...x/core/rebalance/tenant/TenantRebalanceConfig.java 60.00% <100.00%> (ø)
...balance/tenant/ZkBasedTenantRebalanceObserver.java 83.67% <100.00%> (ø)
...ntroller/helix/core/PinotHelixResourceManager.java 63.55% <33.33%> (-0.12%) ⬇️
...ller/api/resources/PinotTenantRestletResource.java 50.00% <0.00%> (ø)
... and 4 more

... and 25 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@klsince klsince force-pushed the make_rebalance_config_class branch from 805e95d to a6e52e0 Compare October 3, 2023 20:39
@klsince klsince force-pushed the make_rebalance_config_class branch from a6e52e0 to 8a0f6ea Compare October 3, 2023 20:41
Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM otherwise

@klsince klsince force-pushed the make_rebalance_config_class branch from 577da49 to 6b3bbd4 Compare October 4, 2023 17:39
@klsince klsince merged commit c96221f into apache:master Oct 4, 2023
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants