Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique
-
Updated
Aug 22, 2024 - Python
Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique
[EMNLP 2024] Holistic Automated Red Teaming for Large Language Models through Top-Down Test Case Generation and Multi-turn Interaction
This is the official implementation (code, data) of the paper "MOSSBench: Is Your Multimodal Language Model Oversensitive to Safe Queries?""
Add a description, image, and links to the safety-alignment topic page so that developers can more easily learn about it.
To associate your repository with the safety-alignment topic, visit your repo's landing page and select "manage topics."