Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding lock to reduce the memory pressure while synching #1104

Closed

Conversation

gameofpointers
Copy link
Contributor

@dominant-strategies/core-dev

wizeguyy
wizeguyy previously approved these changes Sep 12, 2023
core/block_validator.go Outdated Show resolved Hide resolved
Copy link
Contributor

@Djadih Djadih left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One needs addressing, the rest are nice to address

gameofpointers and others added 6 commits September 12, 2023 12:54
GasLimit  ceiling target changes based on 4 steps
Each step is 150,000 blocks (i.e expected blocks for 3 weeks)

GasCeil is changed to 110M because it is enough to accomodate the 1700 testnet
target

These changes are for the testnet and probably is not a long term
controller
From simulations and rigorous testing we have understood that there is
stable operating point on just using Stoichastic or using the threshold
to determine Dom blocks in a Synchronous setting

To be able to handle the adverse network scenarios and testnet
environment and malicious miners the correct solution is mixture of
having threshold to counteract malicious miners getting lucky and
having a increased difficulty threshold to find a dom block
Since downloader insert is an asynchronous process, writing thousands of
large blocks into the DB at the same time is very memory intensive.
Adding this lock will make sure that only one block is written at a time
and from the testing in the garden environment this has shown improved
performance in memory use while syncing
Djadih
Djadih previously approved these changes Sep 12, 2023
@gameofpointers gameofpointers dismissed Djadih’s stale review September 12, 2023 18:46

The merge-base changed after approval.

Djadih
Djadih previously approved these changes Sep 12, 2023
@gameofpointers gameofpointers dismissed Djadih’s stale review September 12, 2023 18:47

The merge-base changed after approval.

Djadih
Djadih previously approved these changes Sep 12, 2023
@gameofpointers gameofpointers dismissed Djadih’s stale review September 12, 2023 18:52

The merge-base changed after approval.

@gameofpointers gameofpointers temporarily deployed to quai-sandbox September 12, 2023 21:00 — with GitHub Actions Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants