PIRSA:21050001

How to represent part-whole hierarchies in a neural net

Hinton, G. (2021). How to represent part-whole hierarchies in a neural net. Perimeter Institute. https://pirsa.org/21050001

Hinton, Geoffrey. How to represent part-whole hierarchies in a neural net. Perimeter Institute, May. 05, 2021, https://pirsa.org/21050001 

          @misc{ pirsa_PIRSA:21050001,
            doi = {10.48660/21050001},
            url = {https://pirsa.org/21050001},
            author = {Hinton, Geoffrey},
            keywords = {Other},
            language = {en},
            title = {How to represent part-whole hierarchies in a neural net},
            publisher = {Perimeter Institute},
            year = {2021},
            month = {may},
            note = {PIRSA:21050001 see, \url{https://pirsa.org}}
          }

Geoffrey Hinton

University of Toronto

Talk number
PIRSA:21050001
Collection
Talk Type
Subject
Abstract

I will present a single idea about representation which allows several recent advances in neural networks  to be combined into an imaginary system called GLOM.  GLOM answers the question: How can a neural network with a fixed architecture parse an image into a part-whole hierarchy which has a different structure for each image? The idea is simply to use islands of identical vectors to represent the nodes in the parse tree. The talk will discuss the many ramifications of this idea.  If GLOM can be made to work, it should significantly improve the interpretability of the representations produced by neural nets when applied to vision or language.