Universiti Teknologi Malaysia Institutional Repository

On the use of fuzzy information retrieval for gauging similarity of arabic documents

Mohammed Alzahrani, Salha and Salim, Naomie (2009) On the use of fuzzy information retrieval for gauging similarity of arabic documents. In: 2nd International Conference on the Applications of Digital Information and Web Technologies, ICADIWT 2009. Institute of Electrical and Electronics Engineers, New York, 539 -544. ISBN 978-142444457-1

Full text not available from this repository.

Official URL: http://dx.doi.org/10.1109/ICADIWT.2009.5273835

Abstract

As one of the richest human languages in terms of words constructions and diversity of meanings, judging similarity amongst statements in Arabic documents is complex. In this paper, we present a mechanism for gauging similarity of Arabic documents using fuzzy IR model. Similarity degree of two documents is the averaged similarity among statements treated as equal although they have been restructured or reworded. We introduced some fuzzy similarity sets such as near duplicate, very similar, similar, slightly similar, dissimilar and very dissimilar. These similarity sets can be implemented as a spectrum of values ranges from 1 (duplicate) and 0 (different). Our corpus collection has been built in which all stop words were removed and nonstop words were stemmed using typical Arabic IR techniques. The corpora has 100 documents with 4477 statements and 54346 non-stop-word, stemmed words in total. Another 15 query documents with 303 statements and 1620 words were specifically constructed for our test. Experimental results show that fuzzy IR can be used to define the extent documents are similar or dissimilar, where similarity can be mapped to one of the proposed fuzzy sets. The performance of our fuzzy IR system, measured in fuzzy precision and fuzzy recall, shows that it outperforms Boolean IR in retrieving more documents that have similar content but with different synonyms.

Item Type:Book Section
Additional Information:2nd International Conference on the Applications of Digital Information and Web Technologies, ICADIWT 2009; London; 4 August 2009 through 6 August 2009
Uncontrolled Keywords:arabic, fuzzy ir, information retrieval, similarity
Subjects:Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions:Computer Science and Information System (Formerly known)
ID Code:13027
Deposited By: Liza Porijo
Deposited On:14 Jul 2011 01:26
Last Modified:14 Jul 2011 01:26

Repository Staff Only: item control page