-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Writable Warm] Composite Directory implementation and integrating it with FileCache #12782
[Writable Warm] Composite Directory implementation and integrating it with FileCache #12782
Commits on Jun 20, 2024
-
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 3c6ad60 - Browse repository at this point
Copy the full SHA 3c6ad60View commit details -
Refactor TransferManager interface to RemoteStoreFileTrackerAdapter
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 30ddaea - Browse repository at this point
Copy the full SHA 30ddaeaView commit details -
Implement block level fetch for Composite Directory
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for a7361d2 - Browse repository at this point
Copy the full SHA a7361d2View commit details -
Removed CACHE state from FileTracker
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 54beed2 - Browse repository at this point
Copy the full SHA 54beed2View commit details -
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 87772f0 - Browse repository at this point
Copy the full SHA 87772f0View commit details -
Add new setting for warm, remove store type setting, FileTracker and …
…RemoteStoreFileTrackerAdapter, CompositeDirectoryFactory and update Composite Directory implementation Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 8fb76d1 - Browse repository at this point
Copy the full SHA 8fb76d1View commit details -
Modify TransferManager - replace BlobContainer with Functional Interf…
…ace to fetch an InputStream instead Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 932ad92 - Browse repository at this point
Copy the full SHA 932ad92View commit details -
Reuse OnDemandBlockSnapshotIndexInput instead of OnDemandBlockComposi…
…teIndexInput Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 3e74318 - Browse repository at this point
Copy the full SHA 3e74318View commit details -
Modify constructors to avoid breaking public api contract and code re…
…view fixes Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for dca1a07 - Browse repository at this point
Copy the full SHA dca1a07View commit details -
Add experimental annotations for newly created classes and review com…
…ment fixes Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 723aba0 - Browse repository at this point
Copy the full SHA 723aba0View commit details -
Use ref count as a temporary measure to prevent file from eviction un…
…til uploaded to Remote Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 959f90c - Browse repository at this point
Copy the full SHA 959f90cView commit details -
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 2632738 - Browse repository at this point
Copy the full SHA 2632738View commit details -
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for ba34798 - Browse repository at this point
Copy the full SHA ba34798View commit details -
Configuration menu - View commit details
-
Copy full SHA for 85003ee - Browse repository at this point
Copy the full SHA 85003eeView commit details -
Handle delete and close in Composite Directory, log current state of …
…FileCache and correct it's clear method and modify unit and integration tests as per review comments Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for de1895e - Browse repository at this point
Copy the full SHA de1895eView commit details -
Refactor usages of WRITEABLE_REMOTE_INDEX_SETTING to TIERED_REMOTE_IN…
…DEX_SETTING Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for f9d880b - Browse repository at this point
Copy the full SHA f9d880bView commit details -
Add tests for FileCachedIndexInput and review comment fixes
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for e1b18ad - Browse repository at this point
Copy the full SHA e1b18adView commit details -
Add additional IT for feature flag disabled
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 5e008db - Browse repository at this point
Copy the full SHA 5e008dbView commit details -
Move setting for Partial Locality type behind Feature Flag, fix bug f…
…or ref count via cloneMap in FullFileCachedIndexInput and other review fixes Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for c1e6b18 - Browse repository at this point
Copy the full SHA c1e6b18View commit details -
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 74f9c29 - Browse repository at this point
Copy the full SHA 74f9c29View commit details -
Add javadocs for FullFileCachedIndexInput
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 7fce3d3 - Browse repository at this point
Copy the full SHA 7fce3d3View commit details -
Signed-off-by: Shreyansh Ray <rayshrey@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 901849b - Browse repository at this point
Copy the full SHA 901849bView commit details