An information fusion framework for person localization via body pose in spectator crowds.

Saved in:
Bibliographic Details
Title: An information fusion framework for person localization via body pose in spectator crowds.
Authors: Shaban, Muhammad1,2 (AUTHOR) m.shaban@warwick.ac.uk, Mahmood, Arif1,2,3 (AUTHOR) arif.mahmood@itu.edu.pk, Al-Maadeed, Somaya Ali2 (AUTHOR) s_alali@qu.edu.qa, Rajpoot, Nasir1 (AUTHOR) n.m.rajpoot@warwick.ac.uk
Source: Information Fusion. Nov2019, Vol. 51, p178-188. 11p.
Subjects: Spectators, Crowds, Anomaly detection (Computer security), Artificial neural networks
Abstract: • In low resolution crowd images, each person is localized and segmented. • For head detection in crowds, a novel Deep-CNN based head detector (DHD) is proposed. • DPM pose detection algorithm is modified to detect upper body poses in crowds. • DHD and modified DPM are integrated using a novel fusion framework. • Information fusion improved person pose detection and segmentation results. Person localization or segmentation in low resolution crowded scenes is important for person tracking and recognition, action detection and anomaly identification. Due to occlusion and lack of inter-person space, person localization becomes a difficult task. In this work, we propose a novel information fusion framework to integrate a Deep Head Detector and a body pose detector. A more accurate body pose showing limb positions will result in more accurate person localization. We propose a novel Deep Head Detector (DHD) to detect person heads in crowds. The proposed DHD is a fully convolutional neural network and it has shown improved head detection performance in crowds. We modify Deformable Parts Model (DPM) pose detector to detect multiple upper body poses in crowds. We efficiently fuse the information obtained by the proposed DHD and the modified DPM to obtain a more accurate person pose detector. The proposed framework is named as Fusion DPM (FDPM) and it has exhibited improved body pose detection performance on spectator crowds. The detected body poses are then used for more accurate person localization by segmenting each person in the crowd. [ABSTRACT FROM AUTHOR]
Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database: Engineering Source
FullText Text:
  Availability: 0
Header DbId: egs
DbLabel: Engineering Source
An: 136242308
AccessLevel: 6
PubType: Academic Journal
PubTypeId: academicJournal
PreciseRelevancyScore: 0
IllustrationInfo
Items – Name: Title
  Label: Title
  Group: Ti
  Data: An information fusion framework for person localization via body pose in spectator crowds.
– Name: Author
  Label: Authors
  Group: Au
  Data: <searchLink fieldCode="AR" term="%22Shaban%2C+Muhammad%22">Shaban, Muhammad</searchLink><relatesTo>1,2</relatesTo> (AUTHOR)<i> m.shaban@warwick.ac.uk</i><br /><searchLink fieldCode="AR" term="%22Mahmood%2C+Arif%22">Mahmood, Arif</searchLink><relatesTo>1,2,3</relatesTo> (AUTHOR)<i> arif.mahmood@itu.edu.pk</i><br /><searchLink fieldCode="AR" term="%22Al-Maadeed%2C+Somaya+Ali%22">Al-Maadeed, Somaya Ali</searchLink><relatesTo>2</relatesTo> (AUTHOR)<i> s_alali@qu.edu.qa</i><br /><searchLink fieldCode="AR" term="%22Rajpoot%2C+Nasir%22">Rajpoot, Nasir</searchLink><relatesTo>1</relatesTo> (AUTHOR)<i> n.m.rajpoot@warwick.ac.uk</i>
– Name: TitleSource
  Label: Source
  Group: Src
  Data: <searchLink fieldCode="JN" term="%22Information+Fusion%22">Information Fusion</searchLink>. Nov2019, Vol. 51, p178-188. 11p.
– Name: Subject
  Label: Subjects
  Group: Su
  Data: <searchLink fieldCode="DE" term="%22Spectators%22">Spectators</searchLink><br /><searchLink fieldCode="DE" term="%22Crowds%22">Crowds</searchLink><br /><searchLink fieldCode="DE" term="%22Anomaly+detection+%28Computer+security%29%22">Anomaly detection (Computer security)</searchLink><br /><searchLink fieldCode="DE" term="%22Artificial+neural+networks%22">Artificial neural networks</searchLink>
– Name: Abstract
  Label: Abstract
  Group: Ab
  Data: • In low resolution crowd images, each person is localized and segmented. • For head detection in crowds, a novel Deep-CNN based head detector (DHD) is proposed. • DPM pose detection algorithm is modified to detect upper body poses in crowds. • DHD and modified DPM are integrated using a novel fusion framework. • Information fusion improved person pose detection and segmentation results. Person localization or segmentation in low resolution crowded scenes is important for person tracking and recognition, action detection and anomaly identification. Due to occlusion and lack of inter-person space, person localization becomes a difficult task. In this work, we propose a novel information fusion framework to integrate a Deep Head Detector and a body pose detector. A more accurate body pose showing limb positions will result in more accurate person localization. We propose a novel Deep Head Detector (DHD) to detect person heads in crowds. The proposed DHD is a fully convolutional neural network and it has shown improved head detection performance in crowds. We modify Deformable Parts Model (DPM) pose detector to detect multiple upper body poses in crowds. We efficiently fuse the information obtained by the proposed DHD and the modified DPM to obtain a more accurate person pose detector. The proposed framework is named as Fusion DPM (FDPM) and it has exhibited improved body pose detection performance on spectator crowds. The detected body poses are then used for more accurate person localization by segmenting each person in the crowd. [ABSTRACT FROM AUTHOR]
– Name: AbstractSuppliedCopyright
  Label:
  Group: Ab
  Data: <i>Copyright of Information Fusion is the property of Elsevier B.V. and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract.</i> (Copyright applies to all Abstracts.)
PLink https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=egs&AN=136242308
RecordInfo BibRecord:
  BibEntity:
    Identifiers:
      – Type: doi
        Value: 10.1016/j.inffus.2018.11.011
    Languages:
      – Code: eng
        Text: English
    PhysicalDescription:
      Pagination:
        PageCount: 11
        StartPage: 178
    Subjects:
      – SubjectFull: Spectators
        Type: general
      – SubjectFull: Crowds
        Type: general
      – SubjectFull: Anomaly detection (Computer security)
        Type: general
      – SubjectFull: Artificial neural networks
        Type: general
    Titles:
      – TitleFull: An information fusion framework for person localization via body pose in spectator crowds.
        Type: main
  BibRelationships:
    HasContributorRelationships:
      – PersonEntity:
          Name:
            NameFull: Shaban, Muhammad
      – PersonEntity:
          Name:
            NameFull: Mahmood, Arif
      – PersonEntity:
          Name:
            NameFull: Al-Maadeed, Somaya Ali
      – PersonEntity:
          Name:
            NameFull: Rajpoot, Nasir
    IsPartOfRelationships:
      – BibEntity:
          Dates:
            – D: 01
              M: 11
              Text: Nov2019
              Type: published
              Y: 2019
          Identifiers:
            – Type: issn-print
              Value: 15662535
          Numbering:
            – Type: volume
              Value: 51
          Titles:
            – TitleFull: Information Fusion
              Type: main
ResultId 1