Word stemming challenges in Malay texts: a literature review

Abstract

Word stemming algorithm is used in artificial intelligence applications to stem derived words to their respective root words. Even though there are many existing words stemming algorithms for the Malay language have been proposed in the past years, there is still a need for an effective word stemming algorithm to address word stemming challenges due to the complexity of Malay language. Thus, this paper will highlight three main word stemming challenges in the existing word stemming algorithms namely morphological rules of Malay language, word patterns in digital Malay texts and word stemming evaluation. Hence, these stemming challenges will be considered in future development of an effective word stemming algorithms for the Malay language.