Whistlerlib: a distributed computing library for exploratory data analysis on large social network datasets.
Saved in:
| Title: | Whistlerlib: a distributed computing library for exploratory data analysis on large social network datasets. |
|---|---|
| Authors: | Garcia-Robledo, Alberto1 (AUTHOR), Espejel-Trujillo, Angelina1 (AUTHOR) aespejel@centrogeo.edu.mx |
| Source: | Multimedia Tools & Applications. Nov2024, Vol. 83 Issue 39, p87071-87104. 34p. |
| Subjects: | Social network analysis, Computer workstation clusters, Social informatics, Distributed computing, Distributed algorithms |
| Abstract: | At least 350k posts are published on X, 510k comments are posted on Facebook, and 66k pictures and videos are shared on Instagram each minute. These large datasets require substantial processing power, even if only a percentage is collected for analysis and research. To face this challenge, data scientists can now use computer clusters deployed on various IaaS and PaaS services in the cloud. However, scientists still have to master the design of distributed algorithms and be familiar with using distributed computing programming frameworks. It is thus essential to generate tools that provide analysis methods to leverage the advantages of computer clusters for processing large amounts of social network text. This paper presents Whistlerlib, a new Python library for conducting exploratory analysis on large text datasets on social networks. Whistlerlib implements distributed versions of various social media, sentiment, and social network analysis methods that can run atop computer clusters. We experimentally demonstrate the scalability of the various Whistlerlib distributed methods when deployed on a public cloud platform. We also present a practical example of the analysis of posts on the social network X about the Mexico City subway to showcase the features of Whistlerlib in scenarios where social network analysis tools are needed to address issues with a social dimension. [ABSTRACT FROM AUTHOR] |
| Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| FullText | Links: – Type: pdflink Text: Availability: 1 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 180990417 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Whistlerlib: a distributed computing library for exploratory data analysis on large social network datasets. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Garcia-Robledo%2C+Alberto%22">Garcia-Robledo, Alberto</searchLink><relatesTo>1</relatesTo> (AUTHOR)<br /><searchLink fieldCode="AR" term="%22Espejel-Trujillo%2C+Angelina%22">Espejel-Trujillo, Angelina</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> aespejel@centrogeo.edu.mx</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22Multimedia+Tools+%26+Applications%22">Multimedia Tools & Applications</searchLink>. Nov2024, Vol. 83 Issue 39, p87071-87104. 34p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Social+network+analysis%22">Social network analysis</searchLink><br /><searchLink fieldCode="DE" term="%22Computer+workstation+clusters%22">Computer workstation clusters</searchLink><br /><searchLink fieldCode="DE" term="%22Social+informatics%22">Social informatics</searchLink><br /><searchLink fieldCode="DE" term="%22Distributed+computing%22">Distributed computing</searchLink><br /><searchLink fieldCode="DE" term="%22Distributed+algorithms%22">Distributed algorithms</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: At least 350k posts are published on X, 510k comments are posted on Facebook, and 66k pictures and videos are shared on Instagram each minute. These large datasets require substantial processing power, even if only a percentage is collected for analysis and research. To face this challenge, data scientists can now use computer clusters deployed on various IaaS and PaaS services in the cloud. However, scientists still have to master the design of distributed algorithms and be familiar with using distributed computing programming frameworks. It is thus essential to generate tools that provide analysis methods to leverage the advantages of computer clusters for processing large amounts of social network text. This paper presents Whistlerlib, a new Python library for conducting exploratory analysis on large text datasets on social networks. Whistlerlib implements distributed versions of various social media, sentiment, and social network analysis methods that can run atop computer clusters. We experimentally demonstrate the scalability of the various Whistlerlib distributed methods when deployed on a public cloud platform. We also present a practical example of the analysis of posts on the social network X about the Mexico City subway to showcase the features of Whistlerlib in scenarios where social network analysis tools are needed to address issues with a social dimension. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=180990417 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s11042-024-19827-z Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 34 StartPage: 87071 Subjects: – SubjectFull: Social network analysis Type: general – SubjectFull: Computer workstation clusters Type: general – SubjectFull: Social informatics Type: general – SubjectFull: Distributed computing Type: general – SubjectFull: Distributed algorithms Type: general Titles: – TitleFull: Whistlerlib: a distributed computing library for exploratory data analysis on large social network datasets. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Garcia-Robledo, Alberto – PersonEntity: Name: NameFull: Espejel-Trujillo, Angelina IsPartOfRelationships: – BibEntity: Dates: – D: 28 M: 11 Text: Nov2024 Type: published Y: 2024 Identifiers: – Type: issn-print Value: 13807501 Numbering: – Type: volume Value: 83 – Type: issue Value: 39 Titles: – TitleFull: Multimedia Tools & Applications Type: main |
| ResultId | 1 |
