Turkish Texts for Toxic Language Detection

Dataset Description

Dataset Summary

This text dataset is a collection of Turkish texts that have been merged from various existing offensive language datasets found online. The dataset contains a total of 77,800 instances, each labeled as either offensive or not offensive.

To ensure the dataset's completeness, we utilized multiple transformer models to augment the dataset with pseudo labels. The resulting dataset is designed to be a comprehensive resource for Turkish offensive language detection.

The dataset is provided in CSV format, for more details on the merged datasets used, please refer to the reference section.

Loading Dataset

To use dataset by using Huggingface dataset use snippet below:

from datasets import load_dataset

# If the dataset is gated/private, make sure you have run huggingface-cli login
dataset = load_dataset("Overfit-GM/turkish-toxic-language")

Dataset Structure

Source Data & References

• https://www.kaggle.com/c/jigsaw-multilingual-toxic-comment-classification
• https://huggingface.co/datasets/offenseval2020_tr
• https://github.com/imayda/turkish-hate-speech-dataset-2
• https://www.kaggle.com/datasets/kbulutozler/5k-turkish-tweets-with-incivil-content
• https://www.kaggle.com/abozyigit/turkish-cyberbullying