Engineering rank/select data structures for large-alphabet strings.
Saved in:
| Title: | Engineering rank/select data structures for large-alphabet strings. |
|---|---|
| Authors: | Arroyuelo, Diego1 (AUTHOR), Carmona, Gabriel2 (AUTHOR), Larrañaga, Héctor3 (AUTHOR), Riveros, Francisco3 (AUTHOR), Rojas-Morales, Carlos Eugenio3 (AUTHOR), Sepúlveda, Erick3 (AUTHOR) |
| Source: | Computer Journal. Jan2026, Vol. 69 Issue 1, p108-132. 25p. |
| Subjects: | Data structures, Run-length encoding, Natural language processing, Data compression, Information retrieval |
| Abstract: | Large-alphabet strings, prevalent in information retrieval and natural language processing, pose unique storage and processing challenges. This paper explores the efficient implementation of the alphabet-partition approach, introducing a compressed data structure that efficiently supports the operations |${\mathsf{rank}}$| and |${\mathsf{select}}$|. Our implementation significantly outperforms existing methods, improving the |${\mathsf{select}}$| operation speed by 80% with only 11% additional space. We demonstrate the utility of our structure in various applications, including inverted list intersections, run-length compressed strings, and distributed computation of |${\mathsf{rank}}$| and |${\mathsf{select}}$|. Notably, for run-length compressed strings using the Burrows–Wheeler transform, our data structure requires only 0.98–1.09 times the space of state-of-the-art RLFM-indexes to achieve 1.23–2.33 times faster pattern occurrence counting while also providing better theoretical guarantees. [ABSTRACT FROM AUTHOR] |
| Copyright of Computer Journal is the property of Oxford University Press / USA and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 191866089 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Engineering rank/select data structures for large-alphabet strings. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Arroyuelo%2C+Diego%22">Arroyuelo, Diego</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Carmona%2C+Gabriel%22">Carmona, Gabriel</searchLink><relatesTo>2</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Larrañaga%2C+Héctor%22">Larrañaga, Héctor</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Riveros%2C+Francisco%22">Riveros, Francisco</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Rojas-Morales%2C+Carlos+Eugenio%22">Rojas-Morales, Carlos Eugenio</searchLink><relatesTo>3</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Sepúlveda%2C+Erick%22">Sepúlveda, Erick</searchLink><relatesTo>3</relatesTo> (AUTHOR) – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Computer+Journal%22">Computer Journal</searchLink>. Jan2026, Vol. 69 Issue 1, p108-132. 25p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Data+structures%22">Data structures</searchLink><br /><searchLink fieldCode="DE" term="%22Run-length+encoding%22">Run-length encoding</searchLink><br /><searchLink fieldCode="DE" term="%22Natural+language+processing%22">Natural language processing</searchLink><br /><searchLink fieldCode="DE" term="%22Data+compression%22">Data compression</searchLink><br /><searchLink fieldCode="DE" term="%22Information+retrieval%22">Information retrieval</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: Large-alphabet strings, prevalent in information retrieval and natural language processing, pose unique storage and processing challenges. This paper explores the efficient implementation of the alphabet-partition approach, introducing a compressed data structure that efficiently supports the operations |${\mathsf{rank}}$| and |${\mathsf{select}}$|. Our implementation significantly outperforms existing methods, improving the |${\mathsf{select}}$| operation speed by 80% with only 11% additional space. We demonstrate the utility of our structure in various applications, including inverted list intersections, run-length compressed strings, and distributed computation of |${\mathsf{rank}}$| and |${\mathsf{select}}$|. Notably, for run-length compressed strings using the Burrows–Wheeler transform, our data structure requires only 0.98–1.09 times the space of state-of-the-art RLFM-indexes to achieve 1.23–2.33 times faster pattern occurrence counting while also providing better theoretical guarantees. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Computer Journal is the property of Oxford University Press / USA and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=191866089 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1093/comjnl/bxaf102 Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 25 StartPage: 108 Subjects: – SubjectFull: Data structures Type: general – SubjectFull: Run-length encoding Type: general – SubjectFull: Natural language processing Type: general – SubjectFull: Data compression Type: general – SubjectFull: Information retrieval Type: general Titles: – TitleFull: Engineering rank/select data structures for large-alphabet strings. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Arroyuelo, Diego – PersonEntity: Name: NameFull: Carmona, Gabriel – PersonEntity: Name: NameFull: Larrañaga, Héctor – PersonEntity: Name: NameFull: Riveros, Francisco – PersonEntity: Name: NameFull: Rojas-Morales, Carlos Eugenio – PersonEntity: Name: NameFull: Sepúlveda, Erick IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Text: Jan2026 Type: published Y: 2026 Identifiers: – Type: issn-print Value: 00104620 Numbering: – Type: volume Value: 69 – Type: issue Value: 1 Titles: – TitleFull: Computer Journal Type: main |
| ResultId | 1 |