Learning Internal Representations of 3D Transformations From 2D Projected Inputs.
Saved in:
| Title: | Learning Internal Representations of 3D Transformations From 2D Projected Inputs. |
|---|---|
| Authors: | Connor, Marissa1 (AUTHOR) marissa.c.connor@gmail.com, Olshausen, Bruno2 (AUTHOR) baolshausen@berkeley.edu, Rozell, Christopher1 (AUTHOR) crozell@gatech.edu |
| Source: | Neural Computation. Nov2024, Vol. 36 Issue 11, p2505-2539. 35p. |
| Subjects: | Lie groups, Generators of groups, Transformation groups, Biological systems, Task performance |
| Abstract: | We describe a computational model for inferring 3D structure from the motion of projected 2D points in an image, with the aim of understanding how biological vision systems learn and internally represent 3D transformations from the statistics of their input. The model uses manifold transport operators to describe the action of 3D points in a scene as they undergo transformation. We show that the model can learn the generator of the Lie group for these transformations from purely 2D input, providing a proof-of-concept demonstration for how biological systems could adapt their internal representations based on sensory input. Focusing on a rotational model, we evaluate the ability of the model to infer depth from moving 2D projected points and to learn rotational transformations from 2D training stimuli. Finally, we compare the model performance to psychophysical performance on structure-from-motion tasks. [ABSTRACT FROM AUTHOR] |
| Copyright of Neural Computation is the property of MIT Press and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
|
Full text is not displayed to guests.
Login for full access.
|
|
| Abstract: | We describe a computational model for inferring 3D structure from the motion of projected 2D points in an image, with the aim of understanding how biological vision systems learn and internally represent 3D transformations from the statistics of their input. The model uses manifold transport operators to describe the action of 3D points in a scene as they undergo transformation. We show that the model can learn the generator of the Lie group for these transformations from purely 2D input, providing a proof-of-concept demonstration for how biological systems could adapt their internal representations based on sensory input. Focusing on a rotational model, we evaluate the ability of the model to infer depth from moving 2D projected points and to learn rotational transformations from 2D training stimuli. Finally, we compare the model performance to psychophysical performance on structure-from-motion tasks. [ABSTRACT FROM AUTHOR] |
|---|---|
| ISSN: | 08997667 |
| DOI: | 10.1162/neco_a_01695 |
