Maths Seminar Series: Andreas Stathopoulos, College of William and Mary – State-of-the-art SVD for Big Data

Friday 14 February 2020 – 10:00am – 11:00am

The Mathematics Research welcomes Andreas Stathopoulos from College of William and Mary to present his research (part of a double session).


The singular value decomposition (SVD) is one of the core computations of today’s scien- ti􏰏ic applications and data analysis tools. The main goal is to compute a compact representation of a high dimensional operator, a matrix, or a set of data that best resembles the original in its most important features. Thus, the SVD is widely used in scienti􏰏ic computing and machine learning, including low rank factorizations, graph learning, unsupervised learning, matrix completion, compression and analysis of images and text. The popularity of the SVD has resulted in an increased diversity of methods and im- plementations that exploit speci􏰏ic features of the input data (e.g., dense/sparse matrix, data distributed among the computing devices, data from queries or batch access, spectral decay) and certain constraints on the computed solutions (e.g., few/many number of singular values and singular vectors computed, targeted part of the spectrum, accuracy). The use of the proper method and the customization of the settings can signi􏰏icantly reduce the cost. In this talk, we overview the most relevant methods in terms of computing cost and accuracy (direct methods, iterative methods, online methods), including the most recent advances in randomized and online SVD solvers. For iterative methods, the stopping criterion has arguably the biggest impact in terms of cost and quality of the solution. We present two case studies where custom stopping criteria reduce computational cost drastically over the traditional criteria used in iterative software. Finally, we discuss the current state of the software on widely used platforms (MAT- LAB, Python’s numpy/scipy and R) as well as high-performance solvers with support for multicore, GPU, and distributed memory.



Andreas Stathopoulos is a Professor of Computer Science at the College of William and Mary in Virginia. He was awarded an NSF CISE Postdoctoral Fellowship after receiving his Ph.D. and M.S. in Com- puter Science from Vanderbilt University; he also completed a B.S. in Mathematics from the University of Athens in Greece. Dr. Stathopoulos’ research interests include numerical analysis and high performance computing; methods for large eigenvalue problems and linear systems of equations; and related applica- tions from materials science and quantum chromodynamics. He co-developed PRIMME (Preconditioned Iterative MultiMethod Eigensolver), one of the foremost eigenvalue packages, several other signi􏰏icant software tools, and has published numerous journal articles and conference papers in computational sci- ences and applications. He is a member of IEEE, IEEE Computer, and SIAM, and the Section Editor for Software and HPC in SIAM Journal on Scienti􏰏ic Computing.

Category list: Seminars

Join the conversation

Your email address will not be published. Required fields are marked *

back to top