The evaluation of the results is not based on the content\u2019s size or quality but on grammatical soundness. For instance, I check if they use appropriate words and if they use the correct form (e.g., past tense, case, etc.). Particularly, fallbeyging or declination (cases shaping nouns and pronouns) is a difficult grammar rule that foreigners (and some Icelanders) struggle with when learning the language. If the model accomplishes declination of (pro)nouns, this would indicate superb Icelandic skills.<\/p>\n\n\n\n
Analysis and results<\/h2>\n\n\n\n
In this section, I present my evaluation of the performance of the two models. For your information, I am not a linguist or Icelandic teacher, but I have a good understanding of my native tongue. I feel confident that my analysis is robust and valid for Icelandic.<\/p>\n\n\n\n
Results indicate that both models speak (or write) Icelandic. Excellent!<\/p>\n\n\n\n
This covers the first part of my analysis. In the second part, we will explore how well or poorly they perform in their spoken (or written) Icelandic, particularly focusing on grammar rules (see above).<\/p>\n\n\n\n
Gemini\u2019s Icelandic skills are surprisingly good. The text is remarkably elo- quent and creative in terms of vocabulary and descriptions. On the other hand, as presented in Figure 1, there were minor errors in Gemini\u2019s response to my question.<\/p>\n\n\n\n Specifically, three errors were found in terms of pronouns and forming adjectives depending on the gender of the subject at hand.<\/p>\n\n\n\n Co-pilot\u2019s Icelandic skills were decent, although I hoped for a more creative response. While it is clearly not as eloquent and rich as Gemini\u2019s response, this is not the determining factor in the evaluation. Indeed, Co-pilot performed quite well in terms of grammar and even outperformed Gemini in some areas, such as using pronouns (see Figure 2).<\/p>\n\n\n\n Gemini is stronger in fallbeyging or declination; I did not detect any errors in its response in terms of declination of nouns. However, Co-pilot uses the incorrect case of Geysir, as illustrated in Figure 2. As such, Gemini\u2019s Icelandic skills are superior to Co-pilot\u2019s.<\/p>\n\n\n\n Most (if not all) Icelandic linguists can agree with the claim that declination of nouns is the \u201choly grail\u201d of Icelandic proficiency. If you have mastered declination (or fallbeyging), you have reached an advanced proficiency in the Icelandic language.<\/p>\n\n\n\n Overall, I was impressed with the proficiency of both AI models in Icelandic. I am curious to know how well they perform in other languages. Of course, the benchmark used here (i.e., declination) does not apply to other languages, so this should be adapted in future research. Please share your thoughts in the comments section below.<\/p>\n\n\n\n Heimisdottir, L. (2024, September). The Icelandic Approach: Preserving and Re- vitalizing Linguistic and Cultural Diversity in AI<\/a>. <\/p>\n\n\n\n![\"Figure](\"http:\/\/34.74.14.69\/wp-content\/uploads\/2025\/05\/gemini-speaking-icelandic.png?w=1000\")
![\"Figure](\"http:\/\/34.74.14.69\/wp-content\/uploads\/2025\/05\/co-pilot-speaking-icelandic.png?w=1000\")
Conclusion<\/h2>\n\n\n\n
References<\/h2>\n\n\n\n