Skip to content

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

License

Notifications You must be signed in to change notification settings

ShakeebAftab-KoyaDocu/node-llama-cpp

About

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 88.4%
  • C++ 6.9%
  • CSS 3.3%
  • Other 1.4%