Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MongoDB: Code refactoring and generalization #49

Merged
merged 10 commits into from
Sep 18, 2024
Merged

MongoDB: Code refactoring and generalization #49

merged 10 commits into from
Sep 18, 2024

Conversation

amotl
Copy link
Member

@amotl amotl commented Sep 18, 2024

About

The MongoDBFullLoadTranslator has been generalized on behalf of recent improvements to cratedb-toolkit already. This patch just slots it into the right place to make it reusable, and also makes the MongoDBCDCTranslator use the improved decoding machinery. Along the lines, the patch fixes a little issue with Zyp Transformations and exercises another use case.

Details

  • MongoDB: Added MongoDBFullLoadTranslator and MongoDBCrateDBConverter
  • MongoDB: Use bson package to parse BSON CANONICAL representation
  • MongoDB: Complete and verify BSON data type mapping end-to-end
  • MongoDB: Use improved decoding machinery also for MongoDBCDCTranslator
  • Zyp: Fixed execution of collection transformation
  • Zyp: Added software test and documentation about flattening lists

References

@cla-bot cla-bot bot added the cla-signed label Sep 18, 2024
@amotl amotl changed the title Mongodb full next MongoDB: Code refactoring and generalization Sep 18, 2024
@amotl amotl force-pushed the mongodb-full-next branch 4 times, most recently from 3da5315 to 5befd3e Compare September 18, 2024 22:07
@amotl amotl marked this pull request as ready for review September 18, 2024 23:15
@amotl amotl merged commit 9034076 into main Sep 18, 2024
23 checks passed
@amotl amotl deleted the mongodb-full-next branch September 18, 2024 23:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant