Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes for migration to commons-configuration2 #11985

Merged

Conversation

abhioncbr
Copy link
Contributor

As per the issue and in continuation of the previous work #11792, #11868, #11916, This PR upgrade the Metadata to commons-configuartion2.

@Jackie-Jiang Jackie-Jiang added the dependencies Pull requests that update a dependency file label Nov 14, 2023
@codecov-commenter
Copy link

codecov-commenter commented Nov 21, 2023

Codecov Report

Attention: 9 lines in your changes are missing coverage. Please review.

Comparison is base (f3b94f6) 61.64% compared to head (e4d8e96) 61.64%.
Report is 5 commits behind head on master.

Files Patch % Lines
...t/local/segment/store/SegmentLocalFSDirectory.java 50.00% 2 Missing ⚠️
...ocal/startree/v2/builder/MultipleTreesBuilder.java 50.00% 2 Missing ⚠️
...pache/pinot/spi/env/CommonsConfigurationUtils.java 89.47% 2 Missing ⚠️
...al/startree/v2/builder/StarTreeIndexSeparator.java 0.00% 1 Missing ⚠️
...egment/spi/index/metadata/SegmentMetadataImpl.java 50.00% 1 Missing ⚠️
.../pinot/segment/spi/utils/SegmentMetadataUtils.java 66.66% 0 Missing and 1 partial ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #11985      +/-   ##
============================================
- Coverage     61.64%   61.64%   -0.01%     
- Complexity     1152     1153       +1     
============================================
  Files          2407     2407              
  Lines        130923   130907      -16     
  Branches      20223    20222       -1     
============================================
- Hits          80705    80693      -12     
+ Misses        44338    44325      -13     
- Partials       5880     5889       +9     
Flag Coverage Δ
custom-integration1 <0.01% <0.00%> (ø)
integration <0.01% <0.00%> (ø)
integration1 <0.01% <0.00%> (ø)
integration2 0.00% <0.00%> (ø)
java-11 34.91% <52.27%> (-26.68%) ⬇️
java-21 61.51% <79.54%> (-0.01%) ⬇️
skip-bytebuffers-false 61.62% <79.54%> (+0.01%) ⬆️
skip-bytebuffers-true 61.46% <79.54%> (-0.02%) ⬇️
temurin 61.64% <79.54%> (-0.01%) ⬇️
unittests 61.63% <79.54%> (-0.01%) ⬇️
unittests1 46.67% <52.27%> (-0.02%) ⬇️
unittests2 27.69% <27.27%> (+0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@abhioncbr abhioncbr force-pushed the upgrade-metadata-commons-configuration2 branch 2 times, most recently from cb96abd to 49a2203 Compare December 1, 2023 03:16
@abhioncbr abhioncbr marked this pull request as ready for review December 5, 2023 18:57
@abhioncbr
Copy link
Contributor Author

@Jackie-Jiang / @xiangfu0 / @walterddr please review. Thanks

Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @xiangfu0 to also take a look

@Jackie-Jiang Jackie-Jiang added the incompatible Indicate PR that introduces backward incompatibility label Dec 6, 2023
@abhioncbr abhioncbr force-pushed the upgrade-metadata-commons-configuration2 branch from b744ebe to 34d976c Compare December 9, 2023 02:27
@abhioncbr
Copy link
Contributor Author

Please review once more @Jackie-Jiang. Thanks

@@ -288,6 +195,7 @@ public static <T> T convert(Object value, Class<T> returnType) {
* - Escaping comma with backslash doesn't work when comma is preceded by a backslash
*/
public static String replaceSpecialCharacterInPropertyValue(String value) {
value = StringEscapeUtils.escapeJava(value);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this a bugfix?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is needed in commons-configuration2, as it does not support string escape/unescape like commons-configuration1.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you give an example of what the property will look like in v1 vs v2? Will v1 automatically escape/unescape the value?

@abhioncbr abhioncbr force-pushed the upgrade-metadata-commons-configuration2 branch from 34d976c to e502b71 Compare December 13, 2023 15:59
@abhioncbr abhioncbr force-pushed the upgrade-metadata-commons-configuration2 branch from 60988cd to 3c9c15a Compare December 14, 2023 03:37
Copy link
Contributor

@Jackie-Jiang Jackie-Jiang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for the great effort!

@@ -288,6 +195,7 @@ public static <T> T convert(Object value, Class<T> returnType) {
* - Escaping comma with backslash doesn't work when comma is preceded by a backslash
*/
public static String replaceSpecialCharacterInPropertyValue(String value) {
value = StringEscapeUtils.escapeJava(value);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you give an example of what the property will look like in v1 vs v2? Will v1 automatically escape/unescape the value?

@Jackie-Jiang Jackie-Jiang merged commit b44b3ae into apache:master Dec 15, 2023
21 checks passed
@abhioncbr abhioncbr deleted the upgrade-metadata-commons-configuration2 branch April 25, 2024 17:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file incompatible Indicate PR that introduces backward incompatibility
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants