From 127e342756206127fdca07a14876ae4330ee0c58 Mon Sep 17 00:00:00 2001 From: Raj Movva Date: Sun, 3 Dec 2023 15:48:48 -0500 Subject: [PATCH] Add NLPositionality LabInTheWild datasets --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 05bdffc..63ebb6b 100644 --- a/README.md +++ b/README.md @@ -101,6 +101,7 @@ This list above are selected key references. Please see our EMNLP 2022 theme pap | [Lourie et al., 2021](https://arxiv.org/abs/2008.09094) | Scruples-dilemmas: A Corpus of Community Ethical Judgments (with 5 crowd annotations per instance) | https://github.com/allenai/scruples | :small_orange_diamond: | | [Potts et al., 2021](https://arxiv.org/abs/2012.15349) | Dyna-Sentiment (5 crowd annotations) | https://github.com/cgpotts/dynasent | :small_orange_diamond: | | [Danescu-Niculescu-Mizil et al. 2013](https://arxiv.org/abs/1306.6078) | Wikipedia Politeness (with up to 5 crowd annotations) | https://convokit.cornell.edu/documentation/wiki_politeness.html or https://github.com/minnesotanlp/Quantifying-Annotation-Disagreement | :small_orange_diamond: | +| [Santy, Liang, et al. 2023](https://arxiv.org/abs/2306.01943) | "NLPositionality: Characterizing Design Biases of Datasets and Models." Social norms/acceptability and toxicity classification, ~10-100 annotators per example with annotator demographics | https://github.com/liang-jenny/NLPositionality/ | |