Short for Py
thon E
asy I
nput O
utput, pyeio
is a python library meant to simplify file IO processes.
This is currently very unstable, but the idea is to capture as much functionality as possible, consolidate it, simplify it, minimize dependencies (further down the line) and optimize stuff with rust.
In addition to a python library, it also comes with a CLI - currently very restricted but somewhat optimized, intended to replicate functionality found across other system utilities and CLIs.
For instance, to count the number of lines in a 15 GB items.jsonl
file one could run:
wc -l items.jsonl
eio wc -l items.jsonl
Runs anywhere from 10 to 20x faster. I suspect things will be very unstable for another few months.