Skip to content

A small vector API service for generating Small, Medium and Large language vectors from Spacy using FastAPI

License

Notifications You must be signed in to change notification settings

patw/VectorService

Repository files navigation

VectorService

A small vector API service for generating Small, Medium and Large language vectors from Spacy using FastAPI

The service will let you generate vectors (96d or 300d) for each language model as well as perform comparisons using the built in cosine similarity functions.

SimDiff endpoint will allow you to compare the outputs of all 3 models when comparing 2 strings of text. This is useful for showing the difference in accuracy between these models.

Local Installation

pip install -r requirements.txt

python -m spacy download en_core_web_sm
python -m spacy download en_core_web_md
python -m spacy download en_core_web_lg

Local Running

uvicorn main:app --reload

Running in docker

docker run -t -i -d -p 80:80 --name vectorservice --restart unless-stopped graboskyc/vectorservice:latest

And visit http://localhost:80/docs in a browser

About

A small vector API service for generating Small, Medium and Large language vectors from Spacy using FastAPI

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published