prompt-iteration-promptfoo

Evaluation with promptfoo

Setup

To install dependencies, run from eval-promptfoo:

npm install

Create and set your Literal AI and OpenAI API keys in .env:

cp .env.example .env

Run

Run a simple chat application and evaluate its results with two different prompt templates with:

npm run dev

Here is the experiment comparison you will get: