Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get compress performance to match paper algorithm 4 #3

Merged
merged 20 commits into from
Aug 15, 2024

Conversation

a10y
Copy link
Contributor

@a10y a10y commented Aug 14, 2024

This gets us close to 2-3 cycles per byte or so that they reference in the paper for predicated scalar compression.

image

^ the benchmark is compression on string with length 50, so compression is roughly 1-2ns per byte (roughly 3-5 cycles on my M2)

@a10y a10y marked this pull request as ready for review August 14, 2024 21:28
rust-toolchain.toml Outdated Show resolved Hide resolved
@@ -0,0 +1,63 @@
The unanimous Declaration of the thirteen united States of America, When in the Course of human events, it becomes necessary for one people to dissolve the political bands which have connected them with another, and to assume among the powers of the earth, the separate and equal station to which the Laws of Nature and of Nature's God entitle them, a decent respect to the opinions of mankind requires that they should declare the causes which impel them to the separation.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🇺🇸 ❤️

src/lib.rs Outdated Show resolved Hide resolved
@a10y a10y changed the title [WIP] get compress performance to match paper algorithm 4 Get compress performance to match paper algorithm 4 Aug 15, 2024
@a10y a10y merged commit 31351ca into develop Aug 15, 2024
1 check passed
@a10y a10y deleted the aduffy/speedup-compress branch August 15, 2024 15:16
@github-actions github-actions bot mentioned this pull request Aug 15, 2024
a10y pushed a commit that referenced this pull request Aug 15, 2024
## 🤖 New release
* `fsst-rs`: 0.0.1

<details><summary><i><b>Changelog</b></i></summary><p>

<blockquote>

## [0.0.1](https://github.com/spiraldb/fsst/releases/tag/v0.0.1) -
2024-08-15

### Fixed
- fix doc link

### Other
- turn on release-plz
- add fuzzer, fix bug ([#7](#7))
- logo ([#6](#6))
- bugfix, comment fix, force compile fails for big-endian
([#5](#5))
- Configure Renovate ([#1](#1))
- Get compress performance to match paper algorithm 4
([#3](#3))
- docs
- cleanup
- words
- README
- disable release action for now
- deny(missing_docs), 512 -> 511
- add toolchain
- add actions files
- implementation v0
- initial impl
- Initial commit
</blockquote>


</p></details>

---
This PR was generated with
[release-plz](https://github.com/MarcoIeni/release-plz/).

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants