Leverage triple relational structures via low-rank feature reduction for multi-output regression.

Saved in:

Bibliographic Details
Title:	Leverage triple relational structures via low-rank feature reduction for multi-output regression.
Authors:	Zhang, Shichao¹ zhangsc@mailbox.gxnu.edu.cn, Yang, Lifeng¹, Deng, Zhenyun¹, Cheng, Debo¹, Li, Yonggang¹
Source:	Multimedia Tools & Applications. Aug2017, Vol. 76 Issue 16, p17461-17477. 17p.
Subjects:	Feature selection, Regression analysis data processing, Orthogonal functions, Data mining, Multimedia cartography
Abstract:	Multi-output regression aims at learning a mapping from feature variables to multiple output variables. It is significant to utilize variety of inherent relational structure information of observations to conduct multi-output regression task when learning a best mapping from high-dimensional data. In this paper, we propose a new multi-output regression method, which simultaneously takes advantage of the low-rank constraint, sample selection, and feature selection in a unified framework. We first take the effect of low-rank constraint to search the correlation of output variables and impose ℓ -norm regularization on the coefficient matrix to capture the correlation between features and outputs. And then, the ℓ -norm on the loss function is designed to discover the correlation between samples, so as to select those informative samples to learn the model for improving predictive capacity. Thirdly, orthogonal subspace learning is exploited to ensure multi-output variables share the same low-rank structure of data by rotating the results of feature selection. In addition, to get the optimal solution of the objective function, we propose an effective iterative optimization algorithm. Finally, we conduct sets of experimental results on real datasets, and show the proposed method outperforms the state-of-the-art methods in terms of aCC and aRMSE. [ABSTRACT FROM AUTHOR]
	Copyright of Multimedia Tools & Applications is the property of Springer Nature and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Database:	Engineering Source

Description
Abstract:	Multi-output regression aims at learning a mapping from feature variables to multiple output variables. It is significant to utilize variety of inherent relational structure information of observations to conduct multi-output regression task when learning a best mapping from high-dimensional data. In this paper, we propose a new multi-output regression method, which simultaneously takes advantage of the low-rank constraint, sample selection, and feature selection in a unified framework. We first take the effect of low-rank constraint to search the correlation of output variables and impose ℓ -norm regularization on the coefficient matrix to capture the correlation between features and outputs. And then, the ℓ -norm on the loss function is designed to discover the correlation between samples, so as to select those informative samples to learn the model for improving predictive capacity. Thirdly, orthogonal subspace learning is exploited to ensure multi-output variables share the same low-rank structure of data by rotating the results of feature selection. In addition, to get the optimal solution of the objective function, we propose an effective iterative optimization algorithm. Finally, we conduct sets of experimental results on real datasets, and show the proposed method outperforms the state-of-the-art methods in terms of aCC and aRMSE. [ABSTRACT FROM AUTHOR]
ISSN:	13807501
DOI:	10.1007/s11042-016-3980-3