Joint sparse matrix regression and nonnegative spectral analysis for two-dimensional unsupervised feature selection.
Saved in:
| Title: | Joint sparse matrix regression and nonnegative spectral analysis for two-dimensional unsupervised feature selection. |
|---|---|
| Authors: | Yuan, Haoliang1 hunteryuan@126.com, Li, Junyu1, Lai, Loi Lei1 l.l.lai@gdut.edu.cn, Tang, Yuan Yan2,3 |
| Source: | Pattern Recognition. May2019, Vol. 89, p119-133. 15p. |
| Subjects: | Sparse matrix software, Spectrum analysis, Matrix analytic methods, Labels, Classification |
| Abstract: | Highlights • We propose a novel two-dimensional unsupervised feature selection model to directly conduct the feature selection on the matrix data. For sparse matrix regression under unsupervised case, the key point is to connect the matrix and its cluster label. In this work, we utilize a nonnegative spectral clustering to compute a cluster label matrix. To integrate the merits of both sparse matrix regression and nonnegative spectral clustering, we joint these two techniques as a whole optimization model for feature selection. • Our JSMRNS extends the SMR model to its unsupervised case. Although JSMRNS is the combination of sparse matrix regression and nonnegative spectral clustering, our JSMRNS can be viewed as the two-dimensional extension of the NDFS model through theoretical analysis, which ensures that our JSMRNS works. Moreover, in certain situation, JSMRNS can approximate the vector-based regression model, i.e., NDFS. • We devise an efficient optimization strategy to solve this joint sparse matrix regression and nonnegative spectral analysis optimization problem. Some theoretical discussions are presented to show the convergence behavior and computational complexity of the optimization strategy. Moreover, we give the detailed discussions to compare with the subspace learning and some relevant models. Extensive experimental results also confirm the effectiveness of our proposed method. Abstract Unsupervised feature selection is a challenging task to gain relevant features for improving learning performance due to lack of the label information. Traditional unsupervised feature selection methods are often vector-based, which may ignore the location information of original matrix element. In this paper, we propose a joint sparse matrix regression and nonnegative spectral analysis model for two-dimensional unsupervised feature selection. To obtain proper label information under unsupervised condition, we adopt a nonnegative spectral clustering technique to yield the clustering labels as the pseudo class labels. To directly select the relevant feature on matrix data, we construct a regression relationship between matrix data and the pseudo class labels by deploying left and right regression matrices. Our proposed method can integrate the merits of both sparse matrix regression and nonnegative spectral clustering for feature selection. An efficient optimization algorithm is designed to solve our proposed optimization problem. Extensive experimental results on clustering and classification demonstrate the effectiveness of our proposed method. [ABSTRACT FROM AUTHOR] |
| Copyright of Pattern Recognition is the property of Pergamon Press - An Imprint of Elsevier Science and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
Be the first to leave a comment!
