Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[improve] Handle PositionInfo that's too large to serialize as a single entry #17

Open
wants to merge 27 commits into
base: master
Choose a base branch
from
Open

[improve] Handle PositionInfo that's too large to serialize as a single entry #17

wants to merge 27 commits into from

Commits on Sep 23, 2024

  1. ManagedCursor: compress data written to BookKeeper 

    (cherry picked from commit 1ef9664)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e014356 View commit details
    Browse the repository at this point in the history

  2. serialize/compress without intermediate byte arrays (apache#268) 

    * serialize/compress without intermediate byte arrays
* use lightproto for cursor serialization to the ledger
* Reuse PositionInfo

(cherry picked from commit 1887c44)
    @dlg99
    dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    33e4c71 View commit details
    Browse the repository at this point in the history

  3. Print time 

    (cherry picked from commit 98a3d25)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    6d1b93a View commit details
    Browse the repository at this point in the history

  4. ManagedCursor: manually serialise PositionInfo (apache#270) 

    * ManagedCursor: manually serialise PositionInfo
* Add tests and save last serialized side to prevent reallocations

(cherry picked from commit 8a365d0)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    568d446 View commit details
    Browse the repository at this point in the history

  5. Fix PositionInfoUtilsTest 

    (cherry picked from commit 44ba614)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    0240250 View commit details
    Browse the repository at this point in the history

  6. PositionInfo Util serialization fix and test (apache#272) 

    (cherry picked from commit f1323c6)
    @dlg99
    dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    ed8df4d View commit details
    Browse the repository at this point in the history

  7. Remove auto reset of cursor in case of read error 

    (cherry picked from commit d4b94ab)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    c2f0908 View commit details
    Browse the repository at this point in the history

  8. Revert removal of 'containsKey' in ManagedCursorImpl 

    (cherry picked from commit 5f07f0c)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    27152ff View commit details
    Browse the repository at this point in the history

  9. Prevent ZK connection loss in case of huge cursor status (apache#273) 

    (cherry picked from commit 6d2e494)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    564a668 View commit details
    Browse the repository at this point in the history

  10. [managed-ledger] Compressed cursors: fix problem with little buffers (a… 

    …pache#275)

(cherry picked from commit 6a2a010)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    0d23d5b View commit details
    Browse the repository at this point in the history

  11. [tests] Fix build after merge conflict 

    (cherry picked from commit 4c5387d)
    @eolivelli @dlg99
    eolivelli authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    08af8fc View commit details
    Browse the repository at this point in the history

  12. Fix WriteCursorLedgerSize metric 

    (cherry picked from commit c3fe80e)
    @nicoloboschi @dlg99
    nicoloboschi authored and dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e8d3930 View commit details
    Browse the repository at this point in the history

  13. try ledger recovery from previous entries in case of corrupt/missing … 

    …footer of the chunked data (apache#282)

(cherry picked from commit 6e72ecb)
    @dlg99
    dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    89adf38 View commit details
    Browse the repository at this point in the history

  14. fix boken test after merge/resolve

    @dlg99
    dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    43a5b31 View commit details
    Browse the repository at this point in the history

  15. post-rebase fixes

    @dlg99
    dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    8db72f4 View commit details
    Browse the repository at this point in the history

  16. removed usage of byte[] where possible

    @dlg99
    dlg99 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    1397faf View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. added config parameters for teh chunk size and to enable/disable chin… 

    …king
    @dlg99
    dlg99 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    d4b4195 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. CR feedback, addComponent(true, ..)

    @dlg99
    dlg99 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    2fdbe63 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Updated broker.conf with new entries

    @dlg99
    dlg99 committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    9b88801 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. updated configs with docs and new config values, including the standa… 

    …lone.conf
    @dlg99
    dlg99 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    7918f21 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. [improve][pip] Improve PIP process and voting timeline (apache#23387)

    @rdhabalia
    rdhabalia authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    1dad078 View commit details
    Browse the repository at this point in the history

  2. [improve] Configure Rocksdb to use musl libc flavor of the native lib… 

    …rary (apache#23375)
    @lhotari
    lhotari authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c41c7e9 View commit details
    Browse the repository at this point in the history

  3. [fix][broker] Fix out-of-order issues with ConsistentHashingStickyKey… 

    …ConsumerSelector (apache#23327)
    @lhotari
    lhotari authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    adb9014 View commit details
    Browse the repository at this point in the history

  4. [fix][client] Fix failover consumer-listener stuck with cumulative ac… 

    …k and epoch time (apache#23345)
    @rdhabalia
    rdhabalia authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    53e996c View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Merge branch 'master' into cpick/cursor-large-state

    @dlg99
    dlg99 committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    048142c View commit details
    Browse the repository at this point in the history

  2. info logging to debug

    @dlg99
    dlg99 committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    590c5ac View commit details
    Browse the repository at this point in the history

  3. CR feedback

    @dlg99
    dlg99 committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    54157d8 View commit details
    Browse the repository at this point in the history