-
Notifications
You must be signed in to change notification settings - Fork 85
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[dvc][doc] Create MVP for DaVinciRecordTransformer #1087
Commits on Jul 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 8dc58f0 - Browse repository at this point
Copy the full SHA 8dc58f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 88b62fe - Browse repository at this point
Copy the full SHA 88b62feView commit details -
Configuration menu - View commit details
-
Copy full SHA for fc856b7 - Browse repository at this point
Copy the full SHA fc856b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 03f0453 - Browse repository at this point
Copy the full SHA 03f0453View commit details -
Configuration menu - View commit details
-
Copy full SHA for 45ba862 - Browse repository at this point
Copy the full SHA 45ba862View commit details -
Configuration menu - View commit details
-
Copy full SHA for e8fa547 - Browse repository at this point
Copy the full SHA e8fa547View commit details
Commits on Jul 30, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b3f3e0a - Browse repository at this point
Copy the full SHA b3f3e0aView commit details -
Configuration menu - View commit details
-
Copy full SHA for f3cacff - Browse repository at this point
Copy the full SHA f3cacffView commit details -
Configuration menu - View commit details
-
Copy full SHA for d2532b3 - Browse repository at this point
Copy the full SHA d2532b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d3ee2b - Browse repository at this point
Copy the full SHA 4d3ee2bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 189127c - Browse repository at this point
Copy the full SHA 189127cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9995758 - Browse repository at this point
Copy the full SHA 9995758View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2c421a6 - Browse repository at this point
Copy the full SHA 2c421a6View commit details
Commits on Jul 31, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 68d2be8 - Browse repository at this point
Copy the full SHA 68d2be8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ffbf41 - Browse repository at this point
Copy the full SHA 9ffbf41View commit details -
Configuration menu - View commit details
-
Copy full SHA for fc0b188 - Browse repository at this point
Copy the full SHA fc0b188View commit details
Commits on Aug 1, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 05c22b4 - Browse repository at this point
Copy the full SHA 05c22b4View commit details
Commits on Aug 2, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1ef7c20 - Browse repository at this point
Copy the full SHA 1ef7c20View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6b56ff8 - Browse repository at this point
Copy the full SHA 6b56ff8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2cbd14f - Browse repository at this point
Copy the full SHA 2cbd14fView commit details
Commits on Aug 13, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1ed816b - Browse repository at this point
Copy the full SHA 1ed816bView commit details -
Correctly pass DVRT functional interface to initBackend, add todo to …
…store classHash in rocksDB
Configuration menu - View commit details
-
Copy full SHA for 6162604 - Browse repository at this point
Copy the full SHA 6162604View commit details -
Configuration menu - View commit details
-
Copy full SHA for 968d357 - Browse repository at this point
Copy the full SHA 968d357View commit details
Commits on Aug 14, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e78340e - Browse repository at this point
Copy the full SHA e78340eView commit details
Commits on Aug 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 42485d9 - Browse repository at this point
Copy the full SHA 42485d9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 22b57e9 - Browse repository at this point
Copy the full SHA 22b57e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5f4da22 - Browse repository at this point
Copy the full SHA 5f4da22View commit details -
Configuration menu - View commit details
-
Copy full SHA for e57caeb - Browse repository at this point
Copy the full SHA e57caebView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3c7ec6c - Browse repository at this point
Copy the full SHA 3c7ec6cView commit details
Commits on Aug 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 36926d5 - Browse repository at this point
Copy the full SHA 36926d5View commit details
Commits on Aug 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for ef6ac83 - Browse repository at this point
Copy the full SHA ef6ac83View commit details
Commits on Aug 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 14fef31 - Browse repository at this point
Copy the full SHA 14fef31View commit details
Commits on Sep 4, 2024
-
Delete classHash file. Compare value classes and don't override value…
… class in AvroGenericDaVinciClient
Configuration menu - View commit details
-
Copy full SHA for 80dd551 - Browse repository at this point
Copy the full SHA 80dd551View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2dd00a8 - Browse repository at this point
Copy the full SHA 2dd00a8View commit details -
Configuration menu - View commit details
-
Copy full SHA for a4227a5 - Browse repository at this point
Copy the full SHA a4227a5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 91ba185 - Browse repository at this point
Copy the full SHA 91ba185View commit details
Commits on Sep 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for cf7169e - Browse repository at this point
Copy the full SHA cf7169eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4d958a2 - Browse repository at this point
Copy the full SHA 4d958a2View commit details
Commits on Sep 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 4017da6 - Browse repository at this point
Copy the full SHA 4017da6View commit details -
Configuration menu - View commit details
-
Copy full SHA for d15f437 - Browse repository at this point
Copy the full SHA d15f437View commit details
Commits on Sep 18, 2024
-
Added a ToDo to make chunking with record transformer lazy, and make …
…the return type of delete void. Proceed with deletion based off of storeRecordsInDaVinci
Configuration menu - View commit details
-
Copy full SHA for 7e49576 - Browse repository at this point
Copy the full SHA 7e49576View commit details
Commits on Sep 19, 2024
-
Created a config for record transformer that's passed into the DaVinc…
…iConfig to remove the need of instantiating a dummy record transformer, updated docs, and simplified function names
Configuration menu - View commit details
-
Copy full SHA for f175b10 - Browse repository at this point
Copy the full SHA f175b10View commit details
Commits on Oct 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 849ebce - Browse repository at this point
Copy the full SHA 849ebceView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3f44da3 - Browse repository at this point
Copy the full SHA 3f44da3View commit details -
Configuration menu - View commit details
-
Copy full SHA for ccf1940 - Browse repository at this point
Copy the full SHA ccf1940View commit details -
Configuration menu - View commit details
-
Copy full SHA for 54ba9ee - Browse repository at this point
Copy the full SHA 54ba9eeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 12b012c - Browse repository at this point
Copy the full SHA 12b012cView commit details -
* Create MVP for record transformer * Fix docs and imports * Don't make serializers and deserializers global * Dont check for boolean val * Delete classHash if it exists * Assert file deletion is true * Improve code coverage * Add tests for blocking record transformer * Created AvroGenericDaVinciClient for record transformer test * Make sure getRecordTransformer is valid * Make sure getRecordTransformer isn't null * Reorganize testRecordTransformerClient and fix key schema * Fix TestStringRecordTransformer to work with Avro objects and update doc * Refactor onRecovery and add javadoc for DaVinciRecordTransformer's constructor * Reset offset if we need to bootstrap from VT * Delete classHash after running tests * Throw an error if a user tries to use blob transfer with record transformer * Make previous public methods private, remove subscribe call inside onRecovery * Correctly pass DVRT functional interface to initBackend, add todo to store classHash in rocksDB * Fix spotbugs * Init DVRT inside SIT, and move DVRT recovery to SIT * Modify checkout action * Undo * Fix compilation * Cache deserializer/serializer * Create utility class for record transformer * Create AbstractStorageIterator and a RocksDB implementation * Delete classHash file. Compare value classes and don't override value class in AvroGenericDaVinciClient * Remove compareCacheConfig mock * Wrap access modifier with doPrivileged * Fix spotless error * Remove unused variables * Added a ToDo to make chunking with record transformer lazy, and make the return type of delete void. Proceed with deletion based off of storeRecordsInDaVinci * Created a config for record transformer that's passed into the DaVinciConfig to remove the need of instantiating a dummy record transformer, updated docs, and simplified function names * Add message envelope for DVRT * Fix spotless issue * Fix test * update docs
Configuration menu - View commit details
-
Copy full SHA for e747f70 - Browse repository at this point
Copy the full SHA e747f70View commit details
Commits on Oct 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 33690b7 - Browse repository at this point
Copy the full SHA 33690b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1bb889b - Browse repository at this point
Copy the full SHA 1bb889bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9462bc7 - Browse repository at this point
Copy the full SHA 9462bc7View commit details -
Configuration menu - View commit details
-
Copy full SHA for ac165e6 - Browse repository at this point
Copy the full SHA ac165e6View commit details -
Configuration menu - View commit details
-
Copy full SHA for edbd3ca - Browse repository at this point
Copy the full SHA edbd3caView commit details
Commits on Oct 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0b74a7a - Browse repository at this point
Copy the full SHA 0b74a7aView commit details
Commits on Oct 23, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 39201bc - Browse repository at this point
Copy the full SHA 39201bcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a8e44a - Browse repository at this point
Copy the full SHA 4a8e44aView commit details -
Configuration menu - View commit details
-
Copy full SHA for fdd0ef0 - Browse repository at this point
Copy the full SHA fdd0ef0View commit details
Commits on Oct 24, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b09a3c9 - Browse repository at this point
Copy the full SHA b09a3c9View commit details
Commits on Oct 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for feb73cf - Browse repository at this point
Copy the full SHA feb73cfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 71ffec7 - Browse repository at this point
Copy the full SHA 71ffec7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6b8bab1 - Browse repository at this point
Copy the full SHA 6b8bab1View commit details -
Configuration menu - View commit details
-
Copy full SHA for a94b196 - Browse repository at this point
Copy the full SHA a94b196View commit details -
Configuration menu - View commit details
-
Copy full SHA for be07be4 - Browse repository at this point
Copy the full SHA be07be4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 609c06d - Browse repository at this point
Copy the full SHA 609c06dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4215967 - Browse repository at this point
Copy the full SHA 4215967View commit details -
Configuration menu - View commit details
-
Copy full SHA for beb821f - Browse repository at this point
Copy the full SHA beb821fView commit details
Commits on Oct 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for bb25b73 - Browse repository at this point
Copy the full SHA bb25b73View commit details -
Configuration menu - View commit details
-
Copy full SHA for 83a88bd - Browse repository at this point
Copy the full SHA 83a88bdView commit details -
Configuration menu - View commit details
-
Copy full SHA for bf85c1e - Browse repository at this point
Copy the full SHA bf85c1eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3170405 - Browse repository at this point
Copy the full SHA 3170405View commit details
Commits on Oct 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6aa3e74 - Browse repository at this point
Copy the full SHA 6aa3e74View commit details