How to reduce the time to sync node?

[qwwwpp]

I am using [juxt/crux-core "20.12-1.13.0-beta"]. There are about 187000 records in my postgres, and it takes 20 minutes for crux.api/sync to finish.
Is there a way to reduce the sync time? For example, taking a snapshot of the current node and save it, when the node restart, it will read from the snapshot, and then sync the rest records.

[jarohen]

Hey @qwwwpp 👋

I suspect you're running into a JDBC ingest bug that was fixed in 21.05-1.17.0 - could you try applying the migration in those release notes and upgrading Crux?

Cheers,

James

[qwwwpp]

After upgrade to 21.05-1.17.0, it only takes 2 minutes to sync, that is 10X improvement! Thank you.
I will try checkpointing after migrating some old queries.

[refset]

For example, taking a snapshot of the current node and save it, when the node restart, it will read from the snapshot, and then sync the rest records.

In addtition to @jarohen's answer just now, have you seen the "checkpointing" configuration options yet? I think that does exactly what you are looking for: https://opencrux.com/reference/1.17.1/checkpointing.html