Extraction, selection and ranking of Field Association (FA) Terms from domain-specific corpora for building a comprehensive FA terms dictionary.
Saved in:
| Title: | Extraction, selection and ranking of Field Association (FA) Terms from domain-specific corpora for building a comprehensive FA terms dictionary. |
|---|---|
| Authors: | Dorji, Tshering1 cigay@is.tokushima-u.ac.jp, Atlam, El-sayed1 atlam@is.tokushima-u.ac.jp, Yata, Susumu1 yata@is.tokushima-u.ac.jp, Fuketa, Masao1 fuketa@is.tokushima-u.ac.jp, Morita, Kazuhiro1 kam@is.tokushima-u.ac.jp, Aoe, Jun-ichi1 aoe@is.tokushima-u.ac.jp |
| Source: | Knowledge & Information Systems. Apr2011, Vol. 27 Issue 1, p141-161. 21p. 3 Diagrams, 6 Charts. |
| Subjects: | Document selection, Terms & phrases, Extraction (Linguistics), Encyclopedias & dictionaries, Wikipedia |
| Abstract: | Field Association (FA) Terms-words or phrases that serve to identify document fields are effective in document classification, similar file retrieval and passage retrieval. But the problem lies in the lack of an effective method to extract and select relevant FA Terms to build a comprehensive dictionary of FA Terms. This paper presents a new method to extract, select and rank FA Terms from domain-specific corpora using part-of-speech (POS) pattern rules, corpora comparison and modified tf-idf weighting. Experimental evaluation on 21 fields using 306 MB of domain-specific corpora obtained from English Wikipedia dumps selected up to 2,517 FA Terms (single and compound) per field at precision and recall of 74-97 and 65-98. This is better than the traditional methods. The FA Terms dictionary constructed using this method achieved an average accuracy of 97.6% in identifying the fields of 10,077 test documents collected from Wikipedia, Reuters RCV1 corpus and 20 Newsgroup data set. [ABSTRACT FROM AUTHOR] |
| Copyright of Knowledge & Information Systems is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
Be the first to leave a comment!
