A Study of Recurrent and Convolutional Neural Networks in the Native Language Identification Task
Xiangliang Zhang, Robert Werfelmann
جامعة الملك عبدالله للعلوم والتقنية · السعودية
الموضوعات
علوم تطبيقية وتكنولوجية
الملخص
Native Language Identification (NLI) is the task of predicting the native language of an author from their text written in a second language. The idea is to find writing habits that transfer from an author’s native language to their second language. Many approaches to this task have been studied, from simple word frequency analysis, to analyzing grammatical and spelling mistakes to find patterns and traits that are common between different authors of the same native language. This can be a very complex task, depending on the native language and the proficiency of the author’s second language. The most common approach that has seen very good results is based on the usage of n-gram features of words and characters. In this thesis, we attempt to extract lexical, grammatical, and semantic features from the sentences of non-native English essays using neural networks. The training and testing data was obtained from a large corpus of publicly available essays written by authors of several countries around the world. The neural network models consisted of Long Short-Term Memory and Convolutional networks using the sentences of each document as the input. Additional statistical features were generated from the text to complement the predictions of the neural networks, which were then used as feature inputs to a Support Vector Machine, making the final prediction.Results show that Long Short-Term Memory neural network can improve performance over a naive bag of words approach, but with a much smaller feature set. With more fine-tuning of neural network hyperparameters, these results will likely improve significantly.
روابط وملفات
التعريف والنوع
- رقم الوثيقة
- e4ee51f2-e0b5-44ee-89f3-a33897a93399
- رقم العقد
- 0
- نوع الوسائط
- Crawler
- نوع المحتوى
- الرسائل العلمية
- صيغة المصدر
- رسائل ماجيستير
- نوع الملف
- pdf text
- أسماء الملفات
- 1699060_1.pdf
بيانات النشر
- ألقاب المؤلفين
- [{"name_ar":" Xiangliang Zhang","title_ar":"اشراف","title_en":"Supervision"},{"name_ar":"Robert Werfelmann","title_ar":"اعداد","title_en":"Preparation"}]
- اللغة
- English
المصدر والدورية
- اسم المصدر
- A Study of Recurrent and Convolutional Neural Networks in the Native Language Identification Task
المحتوى والصفحات
- عدد الصفحات
- 0
- كلمات الباحثين
- Classification, Machine learning , native language identification , Natural language processing , neural networks
إشراف وإعداد
- الإشراف
- Xiangliang Zhang
- الإعداد
- Robert Werfelmann
الاقتباسات الببليوغرافية
APA
MLA