AraDialAug: A Meta-Learning and Data Augmentation Approach for Arabic Dialogue Generation

الموضوعات

علوم تطبيقية وتكنولوجية

الملخص

Arabic dialogue generation presents unique challenges due to the language's rich morphology and the scarcity of data resources. Recent advances have employed meta learning to facilitate fast adaptation of language models to low-resource domains. This thesis builds upon such groundwork by introducing paraphrase data augmentation to further improve the generalization and adaptation capabilities of pre-trained models inArabic Natural Language Generation (NLG). We propose an enhanced approach that leverages a fine-tuned ARAT5 model with meta-learning via the Reptile algorithm. Our methodology encompasses augmenting both the context and responses within the auxiliary and target datasets. We incorporate paraphrase data augmentation for 10% and 30% of the seed data, examining the resultant impact on model performance. Our experiments demonstrate significant improvements in dialogue generation quality, as evidenced by higher BLEU-4 scores and Semantic Textual Similarity (STS) metrics inintrinsic evaluation, even with limited data. These results surpass those achieved by thestate-of-the-art methods described in prior work. The qualitative extrinsic evaluations reinforce the quantitative metrics, indicating a noticeable enhancement in the fluency and relevance of the generated responses. Our findings suggest that paraphrase data augmentation, when used judiciously within the framework of meta-learning, can serveas a powerful tool for advancing the field of Arabic conversational AI, particularly inlow-resource scenarios.

روابط وملفات

التعريف والنوع

رقم الوثيقة

0b6510b8-e31b-4c31-b923-dbce12ef1a18

رقم العقد

0

نوع الوسائط

Crawler

نوع المحتوى

الرسائل العلمية

صيغة المصدر

رسائل ماجيستير

نوع الملف

pdf text

أسماء الملفات

796987_1.pdf

بيانات النشر

ألقاب المؤلفين

[{"name_ar":"Assaad Hani El Halabi","title_ar":"اعداد","title_en":"Preparation"},{"name_ar":"Wassim El Hajj","title_ar":"اشراف","title_en":"Supervision"}]

اللغة

English

المصدر والدورية

اسم المصدر

AraDialAug: A Meta-Learning and Data Augmentation Approach for Arabic Dialogue Generation

المحتوى والصفحات

عدد الصفحات

0

إشراف وإعداد

الإشراف

Wassim El Hajj

الإعداد

Assaad Hani El Halabi

الاقتباسات الببليوغرافية