skip to main content
Idioma:

Statistical Mechanics of Deep Learning

Bahri, Yasaman ; Kadmon, Jonathan ; Pennington, Jeffrey ; Schoenholz, Sam S ; Sohl-Dickstein, Jascha ; Ganguli, Surya

Annual review of condensed matter physics, 2020-03, Vol.11 (1), p.501-528 [Periódico revisado por pares]

Annual Reviews

Texto completo disponível

Citações Citado por
  • Título:
    Statistical Mechanics of Deep Learning
  • Autor: Bahri, Yasaman ; Kadmon, Jonathan ; Pennington, Jeffrey ; Schoenholz, Sam S ; Sohl-Dickstein, Jascha ; Ganguli, Surya
  • Assuntos: chaos ; dynamical phase transitions ; interacting particle systems ; jamming ; machine learning ; neural networks ; nonequilibrium statistical mechanics ; random matrix theory ; spin glasses
  • É parte de: Annual review of condensed matter physics, 2020-03, Vol.11 (1), p.501-528
  • Descrição: The recent striking success of deep neural networks in machine learning raises profound questions about the theoretical principles underlying their success. For example, what can such deep networks compute? How can we train them? How does information propagate through them? Why can they generalize? And how can we teach them to imagine? We review recent work in which methods of physical analysis rooted in statistical mechanics have begun to provide conceptual insights into these questions. These insights yield connections between deep learning and diverse physical and mathematical topics, including random landscapes, spin glasses, jamming, dynamical phase transitions, chaos, Riemannian geometry, random matrix theory, free probability, and nonequilibrium statistical mechanics. Indeed, the fields of statistical mechanics and machine learning have long enjoyed a rich history of strongly coupled interactions, and recent advances at the intersection of statistical mechanics and deep learning suggest these interactions will only deepen going forward.
  • Editor: Annual Reviews
  • Idioma: Inglês
Voltar para lista de resultados

  • Realização: ABCD-USP USP   Logos de Redes Sociais: Freepik

Buscando em bases de dados remotas. Favor aguardar.