Success of PhD students in the SemEval international workshop competition

In the winter semester of 2022/2023, PhD students of the ICT&Design Doctoral School, Arkadiusz Modzelewski and Witold Sosnowski, won qualification for the 17th edition of the SemEval 2023 International Semantic Evaluation Workshop. They participated in a task on Category Detection, Framing and Persuasion Techniques in Web Messages in a Multilingual Configuration.

As part of the task, they investigated the ability of natural language processing systems (NLP) to detect genres and persuasion techniques in multiple languages and conducted experiments with various data augmentation techniques, including machine translation and text generation.

To this end, they used the OpenAI GPT-3 Davinci language model to create synthetic texts for genre detection, and for persuasion technique detection, they relied on dataset expansion through text translation using the DeepL translator.

Tuned models that utilized augmented data ranked in the top ten across all languages, demonstrating the effectiveness of the proposed approach. 

Genre detection models showed excellent performance, securing first, second, and third place in Spanish, German, and Italian, respectively.

Meanwhile, one of the persuasion technique detection models secured third position in Polish. Their contribution to science includes a system architecture that utilizes DeepL and GPT-3 for data augmentation to detect both genre and persuasion techniques.

The proposed methods are described in the article: “DSHacker at SemEval-2023 Task 3: Genres and Persuasion Techniques Detection with Multilingual Data Augmentation through Machine Translation and Text Generation”, which has been accepted for publication. The SemEval workshop, where the competition results will be presented, will take place as part of the ACL-2023 conference in Toronto, Canada. 

ICT & Design Doctoral School has announced recruitment for the 2023/24 academic year. More information here.