Skip to content

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Notifications You must be signed in to change notification settings

The-AI-Alliance/ai-application-testing

Repository files navigation

README for Developer Testing for GenAI Applications

Published Documentation

This repo contains the code and documentation for the AI Alliance guide for Developer Testing for GenAI Applications, which explores the inherent difficulties and potential solutions for the desire to write deterministic, repeatable, automated tests when you have non-deterministic GenAI components in your application.

See the documentation for a more detailed description of the project.

Getting Involved

We welcome contributions as PRs. Please see our Alliance community repo for general information about contributing to any of our projects. This section provides some specific details you need to know.

In particular, see the AI Alliance CONTRIBUTING instructions. You will need to agree with the AI Alliance Code of Conduct.

All code contributions are licensed under the Apache 2.0 LICENSE (which is also in this repo, LICENSE.Apache-2.0).

All documentation contributions are licensed under the Creative Commons Attribution 4.0 International (which is also in this repo, LICENSE.CC-BY-4.0).

All data contributions are licensed under the Community Data License Agreement - Permissive - Version 2.0 (which is also in this repo, LICENSE.CDLA-2.0).

We use the "Developer Certificate of Origin" (DCO).

Warning

Before you make any git commits with changes, understand what's required for DCO.

See the Alliance contributing guide section on DCO for details. In practical terms, supporting this requirement means you must use the -s flag with your git commit commands.

The Website

The documentation for this repo is published using GitHub Pages. See GITHUB_PAGES for details.

About

Exploration of how to ensure robust, repeatable developer tests (e.g., unit tests) when generative AI introduces non-determinism.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published