SpidersRUs: Creating specialized search engines in multiple languages

Saved in:
Bibliographic Details
Title: SpidersRUs: Creating specialized search engines in multiple languages
Authors: Chau, Michael1 mchau@business.hku.hk, Qin, Jialun2 jialun_qin@uml.edu, Zhou, Yilu3 yzhou@gwu.edu, Tseng, Chunju4 chunju@u.arizona.edu, Chen, Hsinchun4 hchen@eller.arizona.edu
Source: Decision Support Systems. Jun2008, Vol. 45 Issue 3, p621-640. 20p.
Subjects: Search engine programming, Cross-language information retrieval, Information retrieval software, Electronic information resource searching, Online information services, User interfaces, Information resources, Systems design
Abstract: While small-scale search engines in specific domains and languages are increasingly used by Web users, most existing search engine development tools do not support the development of search engines in languages other than English, cannot be integrated with other applications, or rely on proprietary software. A tool that supports search engine creation in multiple languages is thus highly desired. To study the research issues involved, we review related literature and suggest the criteria for an ideal search tool. We present the design of a toolkit, called SpidersRUs, developed for multilingual search engine creation. The design and implementation of the tool, consisting of a Spider module, an Indexer module, an Index Structure, a Search module, and a Graphical User Interface module, are discussed in detail. A sample user session and a case study on using the tool to develop a medical search engine in Chinese are also presented. The technical issues involved and the lessons learned in the project are then discussed. This study demonstrates that the proposed architecture is feasible in developing search engines easily in different languages such as Chinese, Spanish, Japanese, and Arabic. [Copyright &y& Elsevier]
Copyright of Decision Support Systems is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 32638578
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: SpidersRUs: Creating specialized search engines in multiple languages
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Chau%2C+Michael%22">Chau, Michael</searchLink><relatesTo>1</relatesTo><i> mchau@business.hku.hk</i><br /><searchLink fieldCode="AR" term="%22Qin%2C+Jialun%22">Qin, Jialun</searchLink><relatesTo>2</relatesTo><i> jialun_qin@uml.edu</i><br /><searchLink fieldCode="AR" term="%22Zhou%2C+Yilu%22">Zhou, Yilu</searchLink><relatesTo>3</relatesTo><i> yzhou@gwu.edu</i><br /><searchLink fieldCode="AR" term="%22Tseng%2C+Chunju%22">Tseng, Chunju</searchLink><relatesTo>4</relatesTo><i> chunju@u.arizona.edu</i><br /><searchLink fieldCode="AR" term="%22Chen%2C+Hsinchun%22">Chen, Hsinchun</searchLink><relatesTo>4</relatesTo><i> hchen@eller.arizona.edu</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Decision+Support+Systems%22">Decision Support Systems</searchLink>. Jun2008, Vol. 45 Issue 3, p621-640. 20p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Search+engine+programming%22">Search engine programming</searchLink><br /><searchLink fieldCode="DE" term="%22Cross-language+information+retrieval%22">Cross-language information retrieval</searchLink><br /><searchLink fieldCode="DE" term="%22Information+retrieval+software%22">Information retrieval software</searchLink><br /><searchLink fieldCode="DE" term="%22Electronic+information+resource+searching%22">Electronic information resource searching</searchLink><br /><searchLink fieldCode="DE" term="%22Online+information+services%22">Online information services</searchLink><br /><searchLink fieldCode="DE" term="%22User+interfaces%22">User interfaces</searchLink><br /><searchLink fieldCode="DE" term="%22Information+resources%22">Information resources</searchLink><br /><searchLink fieldCode="DE" term="%22Systems+design%22">Systems design</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: While small-scale search engines in specific domains and languages are increasingly used by Web users, most existing search engine development tools do not support the development of search engines in languages other than English, cannot be integrated with other applications, or rely on proprietary software. A tool that supports search engine creation in multiple languages is thus highly desired. To study the research issues involved, we review related literature and suggest the criteria for an ideal search tool. We present the design of a toolkit, called SpidersRUs, developed for multilingual search engine creation. The design and implementation of the tool, consisting of a Spider module, an Indexer module, an Index Structure, a Search module, and a Graphical User Interface module, are discussed in detail. A sample user session and a case study on using the tool to develop a medical search engine in Chinese are also presented. The technical issues involved and the lessons learned in the project are then discussed. This study demonstrates that the proposed architecture is feasible in developing search engines easily in different languages such as Chinese, Spanish, Japanese, and Arabic. [Copyright &y& Elsevier]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Decision Support Systems is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=32638578
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.dss.2007.07.006
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 20
        StartPage: 621
    Subjects:
      – SubjectFull: Search engine programming
        Type: general
      – SubjectFull: Cross-language information retrieval
        Type: general
      – SubjectFull: Information retrieval software
        Type: general
      – SubjectFull: Electronic information resource searching
        Type: general
      – SubjectFull: Online information services
        Type: general
      – SubjectFull: User interfaces
        Type: general
      – SubjectFull: Information resources
        Type: general
      – SubjectFull: Systems design
        Type: general
    Titles:
      – TitleFull: SpidersRUs: Creating specialized search engines in multiple languages
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Chau, Michael
      – PersonEntity:
          Name:
            NameFull: Qin, Jialun
      – PersonEntity:
          Name:
            NameFull: Zhou, Yilu
      – PersonEntity:
          Name:
            NameFull: Tseng, Chunju
      – PersonEntity:
          Name:
            NameFull: Chen, Hsinchun
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 06
              Text: Jun2008
              Type: published
              Y: 2008
          Identifiers:
            – Type: issn-print
              Value: 01679236
          Numbering:
            – Type: volume
              Value: 45
            – Type: issue
              Value: 3
          Titles:
            – TitleFull: Decision Support Systems
              Type: main
ResultId 1