Skip to content
This repository has been archived by the owner on Jul 13, 2023. It is now read-only.

Purge old webpush records from Router table #1382

Open
jrconlin opened this issue Apr 24, 2020 · 1 comment
Open

Purge old webpush records from Router table #1382

jrconlin opened this issue Apr 24, 2020 · 1 comment
Assignees
Labels
5 Estimate - l - Moderately complex, will require some effort but clearly defined.

Comments

@jrconlin
Copy link
Member

jrconlin commented Apr 24, 2020

As of April 2020, the Webpush router table is 1.33 TB with 6.3B rows.

There is a lot of old data in there.

Purging the old data would require a scan to kill all records that have a last_connect earlier than a given threshold (180d?) and have a router_type of webpush. The operation itself would not be cheap, but it would save the cost of a lot of no longer needed records.

"garbage collection"

@jrconlin jrconlin added the 5 Estimate - l - Moderately complex, will require some effort but clearly defined. label Apr 24, 2020
@jrconlin jrconlin self-assigned this Apr 28, 2020
@jrconlin
Copy link
Member Author

Doing some back of the envelope cost calculations on this, it might be more expensive to purge the records than leave them. If we presume a 60% garbage rate, we'll recoup the costs of doing a delete after about 20 months. One problem, however is that the most recent burst of registration records, due to the churn from client rotating UAID on reconnect, would not be picked up by this purge.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
5 Estimate - l - Moderately complex, will require some effort but clearly defined.
Projects
None yet
Development

No branches or pull requests

1 participant