Talks by Geoffrey Hinton

How to represent part-whole hierarchies in a neural net

Geoffrey Hinton University of Toronto

I will present a single idea about representation which allows several recent advances in neural networks  to be combined into an imaginary system called GLOM.  GLOM answers the question: How can a neural network with a fixed architecture parse an image into a part-whole hierarchy which has a different structure for each image? The idea is simply to use islands of identical vectors to represent the nodes in the parse tree.