mit-media-lab-pytutor-promptfoo

MIT media lab pytutor promptfoo Read here for LLM readteaming

how to run it

run npm ci to install promptfoo package
in your terminal, run export OPENAI_API_KEY=your_api_key_here
now you can choose one frolm below
- Run promptfoo eval to see the result in the terminal
- Run promptfoo view to use the local web viewer
- Run promptfoo share to create a shareable URL

Then, you will see a beautiful test tables like this.

how do I modify / add more test cases

Everything is in the file called promptfooconfig.yaml :)