PosTagged and Lemmatized nGrams extracted from TS Wikipedia Corpus. This dataset consists 12.101.939 nGrams harvested from TS Wikipedia Corpus.
The data set is consisted of 9 tab separated columns respectively presents the first word of nGram, its part of speech annotation, the lemma for the first word, the second word, its part of speech annotation, the lemma of the second word, the observed frequency of nGram, the frequency of the first word and the frequency of the second word in the whole data set. Given frequencies are calculated case-sensitively
| Word 1 | PosTag | Lemma | Word_2 | PosTag | Lemma | Freq of nGram | Freq of Word_1 | Freq of Word_2 |
|---|---|---|---|---|---|---|---|---|
| en | Adv | en | büyük | Adj | büyük | 12490 | 95101 | 63047 |
| Dünya | Noun | Dünya | Kupası | Noun | kupa | 3968 | 27642 | 13907 |
The art of speech tagging accuracy of the dataset is ~82%.
Published by Taner Sezer.
Please cite the following reference if you found this dataset useful:
Sezer, Taner, and Türker Sezer. TS Wikipedia LDC2015T15. Web Download. Philadelphia: Linguistic Data Consortium, 2015.