Machine Learning Initiative

In this talk, I will survey recent developments about the connection between neural networks and models of quantum mechanics and quantum field theory. Previous work has shown that the neural network - Gaussian process correspondence can be interpreted as the statement that large-width neural…

We present a tensorization algorithm for constructing tensor train representations of functions, drawing on sketching and cross interpolation ideas. The method only requires black-box access to the target function and a small set of sample points defining the domain of interest. Thus, it is…

In this talk I will give updates on two projects: Firstly, Perimeter and Two Small Fish Ventures are currently supporting a group of five PSI alumni in writing a play themed around quantum science & technology, with the goal of enriching public discourse on these fields. On the one hand, we aim to…

Pairwise difference learning (PDL) has recently been introduced as a new meta-learning technique for regression by Wetzel et al. Instead of learning a mapping from instances to outcomes in the standard way, the key idea is to learn a function that takes two instances as input and predicts the…

The physics of strongly correlated systems offers some of the most intriguing physics challenges such as competing orders or the emergence of dynamical composite degrees of freedom. Often, the resolution of these physics challenges is computationally hard, but can be simplified by a formulation in…

We develop a Machine-Learning Renormalization Group (MLRG) algorithm to explore and analyze many-body lattice models in statistical physics. Using the representation learning capability of generative modeling, MLRG automatically learns the optimal renormalization group (RG) transformations from self…

Large neural networks are often studied analytically through scaling limits: regimes in which some structural network parameters (e.g. depth, width, number of training datapoints, and so on) tend to infinity. Such limits are challenging to identify and study in part because the limits as these…

Both the social and natural world are replete with complex structure that often has a probabilistic interpretation. In the former, we may seek to model, for example, the distribution of natural images or language, for which there are copious amounts of real world data. In the latter, we are given…

Ultra-cold Fermi gases exhibit a rich array of quantum mechanical properties, including the transition from a fermionic superfluid Bardeen-Cooper-Schrieffer (BCS) state to a bosonic superfluid Bose-Einstein condensate (BEC), which can be precisely probed experimentally. However, accurately…

Neural Network Field Theories (NNFTs) are field theories defined via output ensembles of initialized Neural Network (NN) architectures, the backbones of current state-of-the-art Deep Learning techniques. Different limits of NN architectures correspond to free, weakly interacting, and non…

I introduce a unified framework for interpreting neural network classifiers tailored toward automated scientific discovery. In contrast to neural network-based regression, for classification, it is in general impossible to find a one-to-one mapping from the neural network to a symbolic equation even…