The Geometry of Linear Convolutional Networks

Location: Zoom
Date(s): Wednesday 15th February 2023 (10:00-11:00)
Contact: Event Convenor Contact: A.M.Kasprzyk@nottingham.ac.uk
Description: Speaker's Name: Kathlén Kohn
Speaker's Affiliation: KTH
Speaker's Research Theme(s): Symbolic computational mathematics,Computational statistics and machine learning
Abstract:
We discuss linear convolutional neural networks (LCNs) and their critical points. We observe that the function space (i.e., the set of functions represented by LCNs) can be identified with polynomials that admit certain factorizations, and we use this perspective to describe the impact of the network’s architecture on the geometry of the function space. For instance, for LCNs with one-dimensional convolutions having stride one and arbitrary filter sizes, we provide a full description of the boundary of the function space. We further study the optimization of an objective function over such LCNs: We characterize the relations between critical points in function space and in parameter space and show that there do exist spurious critical points. We compute an upper bound on the number of critical points in function space using Euclidean distance degrees and describe dynamical invariants for gradient descent. This talk is based on joint work with Thomas Merkh, Guido Montúfar, and Matthew Trager.

Venue: Zoom
Online Conference Link: https://us06web.zoom.us/j/82923258565?pwd=UHBxS3NvUWdNdzBpRm82Z3ZkTldkUT09

School of Mathematical Sciences

The University of Nottingham
University Park
Nottingham, NG7 2RD

For all enquiries please visit:
www.nottingham.ac.uk/enquire