Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding lock to reduce the memory pressure while synching #1104

Closed
wants to merge 15 commits into from
Closed

Adding lock to reduce the memory pressure while synching #1104

wants to merge 15 commits into from

Commits on Sep 12, 2023

  1. bugfix: added subReorg check on relayPh

    @kiltsonfire @gameofpointers
    kiltsonfire authored and gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    beb5b58 View commit details
    Browse the repository at this point in the history

  2. bugfix: cannot have go routine on subrelay in updateDom

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    89ef5fd View commit details
    Browse the repository at this point in the history

  3. bugfix: WriteBlock before Inserting the local mined block

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    1c87e99 View commit details
    Browse the repository at this point in the history

  4. bugfix: updated the futureblock dist from 15 to 100

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    56a7c94 View commit details
    Browse the repository at this point in the history

  5. Use bestPh to pick inslice append phHeader

    @kiltsonfire @gameofpointers
    kiltsonfire authored and gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    923c34d View commit details
    Browse the repository at this point in the history

  6. bugfix: Locking updatePhCacheFromDom and computing pending header 

    Protecting the async updates
    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    aabe04f View commit details
    Browse the repository at this point in the history

  7. Added location information in the Appended print

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    ae4e089 View commit details
    Browse the repository at this point in the history

  8. bugfix: UpdateDom no longer calculates, uses the pendingHeader given by 

    the zone

UpdateDom takes zone pending header as input rather than entropy
    @kiltsonfire @gameofpointers
    kiltsonfire authored and gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    ade2813 View commit details
    Browse the repository at this point in the history

  9. Modified the CalcDifficulty controller to use k factor that changes w… 

    …ith log of Difficutly (i.e bits)
    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    0d0da91 View commit details
    Browse the repository at this point in the history

  10. GasLimit adjustment steps for the Testnet 

    GasLimit  ceiling target changes based on 4 steps
Each step is 150,000 blocks (i.e expected blocks for 3 weeks)

GasCeil is changed to 110M because it is enough to accomodate the 1700 testnet
target

These changes are for the testnet and probably is not a long term
controller
    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    c45b913 View commit details
    Browse the repository at this point in the history

  11. Added fetcher limit for block imports as a DDos prevention mechanism

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    ff5b5e1 View commit details
    Browse the repository at this point in the history

  12. Changed the basefee and the reward function for Testnet

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    8ac0cda View commit details
    Browse the repository at this point in the history

  13. Added minimum threshold deltaS into CalcOrder 

    From simulations and rigorous testing we have understood that there is
stable operating point on just using Stoichastic or using the threshold
to determine Dom blocks in a Synchronous setting

To be able to handle the adverse network scenarios and testnet
environment and malicious miners the correct solution is mixture of
having threshold to counteract malicious miners getting lucky and
having a increased difficulty threshold to find a dom block
    @kiltsonfire @gameofpointers
    kiltsonfire authored and gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    2f2a0f8 View commit details
    Browse the repository at this point in the history

  14. Lock the proc, so that only one proc of append queue happens at a time

    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    7d32a65 View commit details
    Browse the repository at this point in the history

  15. bugfix: Added lock around block writes to reduce memory pressure 

    Since downloader insert is an asynchronous process, writing thousands of
large blocks into the DB at the same time is very memory intensive.
Adding this lock will make sure that only one block is written at a time
and from the testing in the garden environment this has shown improved
performance in memory use while syncing
    @gameofpointers
    gameofpointers committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    8d8c4d2 View commit details
    Browse the repository at this point in the history