Offensive text detection across languages and datasets using rule-based and hybrid methods

Gémes, Kinga [Gémes, Kinga Andrea (Nyelvtechnológia), szerző] Automatizálási és Alkalmazott Informatikai Tanszék (BME / VIK); Kovács, Ádám [Kovács, Ádám (Nyelvtechnológia), szerző] Automatizálási és Alkalmazott Informatikai Tanszék (BME / VIK); Recski, Gábor [Recski, Gábor András (Nyelvtechnológia), szerző]

Angol nyelvű Konferenciaközlemény (Folyóiratcikk) Tudományos
Megjelent: CEUR WORKSHOP PROCEEDINGS 1613-0073 3318 Paper: short22 , 10 p. 2022
Konferencia: 31st ACM International Conference on Information and Knowledge Management (CIKM 2022) 2022-10-17 [Atlanta, Amerikai Egyesült Államok]
    Azonosítók
    We investigate the potential of rule-based systems for the task of offensive text detection in English and German, and demonstrate their effectiveness in low-resource settings, as an alternative or addition to transfer learning across tasks and languages. Task definitions and annotation guidelines used by existing datasets show great variety, hence state-of-the-art machine learning models do not transfer well across datasets or languages. Furthermore, such systems lack explainability and pose a critical risk of unintended bias. We present simple rule systems based on semantic graphs for classifying offensive text in two languages and provide both quantitative and qualitative comparison of their performance with deep learning models on 5 datasets across multiple languages and shared tasks.
    Hivatkozás stílusok: IEEEACMAPAChicagoHarvardCSLMásolásNyomtatás
    2026-10-17 23:41