Skip to content

harttraveller/pyeio

Repository files navigation

pyeio



Short for Python Easy Input Output, pyeio is a python library meant to simplify file IO processes.

This is currently very unstable, but the idea is to capture as much functionality as possible, consolidate it, simplify it, minimize dependencies (further down the line) and optimize stuff with rust.

In addition to a python library, it also comes with a CLI - currently very restricted but somewhat optimized, intended to replicate functionality found across other system utilities and CLIs.

For instance, to count the number of lines in a 15 GB items.jsonl file one could run:

wc -l items.jsonl
eio wc -l items.jsonl

Runs anywhere from 10 to 20x faster. I suspect things will be very unstable for another few months.