View in EDS

SpidersRUs: Creating specialized search engines in multiple languages

Saved in:
Bibliographic Details
Title: SpidersRUs: Creating specialized search engines in multiple languages
Authors: Chau, Michael1 mchau@business.hku.hk, Qin, Jialun2 jialun_qin@uml.edu, Zhou, Yilu3 yzhou@gwu.edu, Tseng, Chunju4 chunju@u.arizona.edu, Chen, Hsinchun4 hchen@eller.arizona.edu
Source: Decision Support Systems. Jun2008, Vol. 45 Issue 3, p621-640. 20p.
Subjects: Search engine programming, Cross-language information retrieval, Information retrieval software, Electronic information resource searching, Online information services, User interfaces, Information resources, Systems design
Abstract: While small-scale search engines in specific domains and languages are increasingly used by Web users, most existing search engine development tools do not support the development of search engines in languages other than English, cannot be integrated with other applications, or rely on proprietary software. A tool that supports search engine creation in multiple languages is thus highly desired. To study the research issues involved, we review related literature and suggest the criteria for an ideal search tool. We present the design of a toolkit, called SpidersRUs, developed for multilingual search engine creation. The design and implementation of the tool, consisting of a Spider module, an Indexer module, an Index Structure, a Search module, and a Graphical User Interface module, are discussed in detail. A sample user session and a case study on using the tool to develop a medical search engine in Chinese are also presented. The technical issues involved and the lessons learned in the project are then discussed. This study demonstrates that the proposed architecture is feasible in developing search engines easily in different languages such as Chinese, Spanish, Japanese, and Arabic. [Copyright &y& Elsevier]
Copyright of Decision Support Systems is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
Description
Abstract:While small-scale search engines in specific domains and languages are increasingly used by Web users, most existing search engine development tools do not support the development of search engines in languages other than English, cannot be integrated with other applications, or rely on proprietary software. A tool that supports search engine creation in multiple languages is thus highly desired. To study the research issues involved, we review related literature and suggest the criteria for an ideal search tool. We present the design of a toolkit, called SpidersRUs, developed for multilingual search engine creation. The design and implementation of the tool, consisting of a Spider module, an Indexer module, an Index Structure, a Search module, and a Graphical User Interface module, are discussed in detail. A sample user session and a case study on using the tool to develop a medical search engine in Chinese are also presented. The technical issues involved and the lessons learned in the project are then discussed. This study demonstrates that the proposed architecture is feasible in developing search engines easily in different languages such as Chinese, Spanish, Japanese, and Arabic. [Copyright &y& Elsevier]
ISSN:01679236
DOI:10.1016/j.dss.2007.07.006