DMS Applied Mathematics Seminar

Speaker: Wenjing Liao, Georgia Tech

Title: Statistical learning theory of deep neural networks for data with low-dimensional structures

Abstract: In the past decade, deep learning has made astonishing breakthroughs in various real-world applications. It is a common belief that deep neural networks are good at learning various geometric structures hidden in data sets, such as rich local regularities, global symmetries, or repetitive patterns. One of the central interests in deep learning theory is to understand why deep neural networks are successful and how they utilize low-dimensional data structures. In this talk, I will present some statistical learning theory for deep ReLU networks where data exhibit low-dimensional structures, such as lying on a low-dimensional manifold. The learning tasks include regression, classification, and learning operators between Hilbert spaces. When data are sampled on a low-dimensional manifold, the sample complexity crucially depends on the intrinsic dimension of the manifold instead of the ambient dimension of the data. These results demonstrate that deep neural networks are adaptive to low-dimensional geometric structures of data sets.