Art

J-GLOBAL ID：201902255366345491   Reference number：19A2843818

Statistical neurodynamics of deep networks: geometry of signal spaces

深いネットワークの統計的神経力学:信号空間の幾何学

Author (5)： Amari Shun-ichi (RIKEN CBS) ,  Amari Shun-ichi (Araya Inc.) ,  Karakida Ryo (AIST) ,  Oizumi Masafumi (Araya Inc.) ,  Oizumi Masafumi (The University of Tokyo)
Material： Nonlinear Theory and Its Applications, IEICE (Web)  (Nonlinear Theory Its Appl IEICE (Web))
Volume： 10  Issue： 4  Page： 322-336(J-STAGE)  Publication year： 2019 
JST Material Number： U0219A  ISSN： 2185-4106  Document type： Article
Article type： 原著論文  Country of issue： Japan (JPN)  Language： ENGLISH (EN)

Thesaurus term： *neural network(biomodel) ,  *mechanics ,  *neuron ,  manifold(tube) ,  *information processing ,  size effect ,  signal conversion
Semi thesaurus term： feedforward network ,  *neurodynamics ,  finite size effect

Author keywords (4)： statistical neurodynamics ,  metric ,  curvature ,  signal transformation in deep networks

JST classification (2)： Artificial intelligence  (JE08000Z) ,  Other information processing  (JE15050M)

Reference (9)：

• [1] S. Amari, “A method of statistical neurodynamics,” Kybernetik, vol. 14, pp. 201-215, (Heft 4) April 1974.
• [2] S. Amari, H. Ando, T. Toyoizumi, and N. Masuda, “State concentration exponent as a measure of quickness in Kauffman-type networks,” Physical Review E, vol. 87, 022814, 2013.
• [3] S. Amari, R. Karakida, and M. Oizumi, “Fisher information and natural gradient learning of random deep networks,” in Proc. AISTAT, pp. 694-702, 2019.
• [4] S. Amari, K. Yoshida, and K. Kanatani, “A mathematical foundation for statistical neurodynamics,” SIAM J. Appl. Math., vol. 33, pp. 95-126, 1977.
• [5] B. Poole, S. Lahiri, M. Raghu, J. Sohl-Dickstein, and S. Ganguli, “Exponential expressivity in deep neural network through transient chaos,” in Advances in Neural Information Processing (NIPS), pp. 3360-3368, 2016.

Terms in the title (3)： 統計 ,  神経力学 ,  幾何学