v0.11.0
Here we are for a new release of parquet2. This release has 3 main features:
- added optional support LZ4 compression and decompression in WASM builds (via LZ4-flex by @PSeitz)
- added support to read bloom filters
- added support to read and write page indexes
A summary of the Full Changelog is available below.
Thank you for everyone that contributed to this release! (credits to individual PRs below)
Breaking changes:
- Renamed
ParquetError
toError
#109 - Made
.end
not consume the parquetFileWriter
#127 (jorgecarleitao) - Removed
compression
fromWriteOptions
#125 (kornholi) - Simplified API and converted some panics on read to errors #112 (jorgecarleitao)
- Improved typing to reduce clones and use of unwraps #106 (jorgecarleitao)
- Simplified
PageIterator
#103 (jorgecarleitao)
New features:
- Added support for page-level filter pushdown (indexes) #102
- Added support for bloom filters #98
- Added optional support for LZ4 via LZ4-flex crate (thus enabling wasm) #124 (jorgecarleitao)
- Added support for page-level filter pushdown (column and offset indexes) #107 (jorgecarleitao)
- Added support to read column and page indexes #100 (jorgecarleitao)
Fixed bugs:
- Fixed minimum version for LZ4 #122 (kornholi)
- Fixed Lz4Raw compression error (if input is tiny) #118 (dantengsky)
- Fixed LZ4 #95 (jorgecarleitao)
Enhancements:
- Made offsets be always written #123 (jorgecarleitao)
- Added specialized deserialization of one-level filtered pages #120 (jorgecarleitao)
- Added support to read and use bloom filters #99 (jorgecarleitao)
- Added
ordinal
andtotal_compressed_size
to column meta #96 (jorgecarleitao) - Added non-consuming function to get values of delta-decoder #94 (jorgecarleitao)
- Disabled bitpacking default-features and upgraded to edition 2021 #93 (light4)
Documentation updates:
- Fix deployment of guide #115 (jorgecarleitao)
Testing updates:
- Added tests for reducing statistics #116 (jorgecarleitao)
- Simplified tests #104 (jorgecarleitao)