Multi-modal RGB-Depth-Thermal Human Body Segmentation.
Saved in:
| Title: | Multi-modal RGB-Depth-Thermal Human Body Segmentation. |
|---|---|
| Authors: | Palmero, Cristina c.palmero.cantarino@gmail.com, Clapés, Albert aclapes@cvc.uab.cat, Bahnsen, Chris1 cb@create.aau.dk, Møgelmose, Andreas1 am@create.aau.dk, Moeslund, Thomas1 tbmg@create.aau.dk, Escalera, Sergio sergio@maia.ub.es |
| Source: | International Journal of Computer Vision. Jun2016, Vol. 118 Issue 2, p217-239. 23p. |
| Subjects: | Human body, Mathematical models of human behavior, Human behavior models, Supervised learning, Boosting algorithms, Mathematical models |
| Abstract: | This work addresses the problem of human body segmentation from multi-modal visual cues as a first stage of automatic human behavior analysis. We propose a novel RGB-depth-thermal dataset along with a multi-modal segmentation baseline. The several modalities are registered using a calibration device and a registration algorithm. Our baseline extracts regions of interest using background subtraction, defines a partitioning of the foreground regions into cells, computes a set of image features on those cells using different state-of-the-art feature extractions, and models the distribution of the descriptors per cell using probabilistic models. A supervised learning algorithm then fuses the output likelihoods over cells in a stacked feature vector representation. The baseline, using Gaussian mixture models for the probabilistic modeling and Random Forest for the stacked learning, is superior to other state-of-the-art methods, obtaining an overlap above 75 % on the novel dataset when compared to the manually annotated ground-truth of human segmentations. [ABSTRACT FROM AUTHOR] |
| Copyright of International Journal of Computer Vision is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
| FullText | Links: – Type: pdflink Text: Availability: 0 |
|---|---|
| Header | DbId: egs DbLabel: Engineering Source An: 115900370 AccessLevel: 6 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 0 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: Multi-modal RGB-Depth-Thermal Human Body Segmentation. – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Palmero%2C+Cristina%22">Palmero, Cristina</searchLink><i> c.palmero.cantarino@gmail.com</i><br /><searchLink fieldCode="AR" term="%22Clapés%2C+Albert%22">Clapés, Albert</searchLink><i> aclapes@cvc.uab.cat</i><br /><searchLink fieldCode="AR" term="%22Bahnsen%2C+Chris%22">Bahnsen, Chris</searchLink><relatesTo>1</relatesTo><i> cb@create.aau.dk</i><br /><searchLink fieldCode="AR" term="%22Møgelmose%2C+Andreas%22">Møgelmose, Andreas</searchLink><relatesTo>1</relatesTo><i> am@create.aau.dk</i><br /><searchLink fieldCode="AR" term="%22Moeslund%2C+Thomas%22">Moeslund, Thomas</searchLink><relatesTo>1</relatesTo><i> tbmg@create.aau.dk</i><br /><searchLink fieldCode="AR" term="%22Escalera%2C+Sergio%22">Escalera, Sergio</searchLink><i> sergio@maia.ub.es</i> – Name: TitleSource Label: Source Group: Src Data: <searchLink fieldCode="JN" term="%22International+Journal+of+Computer+Vision%22">International Journal of Computer Vision</searchLink>. Jun2016, Vol. 118 Issue 2, p217-239. 23p. – Name: Subject Label: Subjects Group: Su Data: <searchLink fieldCode="DE" term="%22Human+body%22">Human body</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+models+of+human+behavior%22">Mathematical models of human behavior</searchLink><br /><searchLink fieldCode="DE" term="%22Human+behavior+models%22">Human behavior models</searchLink><br /><searchLink fieldCode="DE" term="%22Supervised+learning%22">Supervised learning</searchLink><br /><searchLink fieldCode="DE" term="%22Boosting+algorithms%22">Boosting algorithms</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematical+models%22">Mathematical models</searchLink> – Name: Abstract Label: Abstract Group: Ab Data: This work addresses the problem of human body segmentation from multi-modal visual cues as a first stage of automatic human behavior analysis. We propose a novel RGB-depth-thermal dataset along with a multi-modal segmentation baseline. The several modalities are registered using a calibration device and a registration algorithm. Our baseline extracts regions of interest using background subtraction, defines a partitioning of the foreground regions into cells, computes a set of image features on those cells using different state-of-the-art feature extractions, and models the distribution of the descriptors per cell using probabilistic models. A supervised learning algorithm then fuses the output likelihoods over cells in a stacked feature vector representation. The baseline, using Gaussian mixture models for the probabilistic modeling and Random Forest for the stacked learning, is superior to other state-of-the-art methods, obtaining an overlap above 75 % on the novel dataset when compared to the manually annotated ground-truth of human segmentations. [ABSTRACT FROM AUTHOR] – Name: AbstractSuppliedCopyright Label: Group: Ab Data: <i>Copyright of International Journal of Computer Vision is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.) |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=115900370 |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.1007/s11263-016-0901-x Languages: – Code: eng Text: English PhysicalDescription: Pagination: PageCount: 23 StartPage: 217 Subjects: – SubjectFull: Human body Type: general – SubjectFull: Mathematical models of human behavior Type: general – SubjectFull: Human behavior models Type: general – SubjectFull: Supervised learning Type: general – SubjectFull: Boosting algorithms Type: general – SubjectFull: Mathematical models Type: general Titles: – TitleFull: Multi-modal RGB-Depth-Thermal Human Body Segmentation. Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Palmero, Cristina – PersonEntity: Name: NameFull: Clapés, Albert – PersonEntity: Name: NameFull: Bahnsen, Chris – PersonEntity: Name: NameFull: Møgelmose, Andreas – PersonEntity: Name: NameFull: Moeslund, Thomas – PersonEntity: Name: NameFull: Escalera, Sergio IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 06 Text: Jun2016 Type: published Y: 2016 Identifiers: – Type: issn-print Value: 09205691 Numbering: – Type: volume Value: 118 – Type: issue Value: 2 Titles: – TitleFull: International Journal of Computer Vision Type: main |
| ResultId | 1 |