A Comparison Study of Some Arabic Root Finding Algorithms

作者:Al Shawakfa Emad*; Al Badarneh Amer; Shatnawi Safwan; Al Rabab'ah Khaleel; Bani Ismail Basel
来源:Journal of the American Society for Information Science and Technology, 2010, 61(5): 1015-1024.
DOI:10.1002/asi.21301

摘要

Arabic has a complex structure, which makes it difficult to apply natural language processing (NLP). Much research on Arabic NLP (ANLP) does exist; however, it is not as mature as that of other languages. Finding Arabic roots is an important step toward conducting effective research on most of ANLP applications. The authors have studied and compared six root-finding algorithms with success rates of over 90%. All algorithms of this study did not use the same testing corpus and/or benchmarking measures. They unified the testing process by implementing their own algorithm descriptions and building a corpus out of 3823 triliteral roots, applying 73 triliteral patterns, and with 18 affixes, producing around 27.6 million words. They tested the algorithms with the generated corpus and have obtained interesting results; they offer to share the corpus freely for benchmarking and ANLP research.

  • 出版日期2010-5