Skip to content

bmschmidt/quadfeather

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Quadfeather

Quickly create deep quadtree structures from CSV or feather files to allow serving over HTTP or quicker access to random portions of spatial data.

Each node in the quadtree is a single feather file containing some number of rows (default 2**16) and arrow metadata indicating the existence of children.

python -m pip install git+https://github.com/bmschmidt/quadfeather
quadfeather-test-data 255000 # populates a csv at tmp.csv with 255000 items
quadfeather --files tmp.csv --tile_size 10000 --destination tiles

Todo

  1. Allow splitting off of some columns.
  2. Explain JS integration.
  3. Octtree for 3-d data.

Optional todo

  1. Other partition strategies? Quadtree is easy to understand.,
  2. Linked-open data standards.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •  

Languages