Linear Algebra and Optimization for Machine Learning

Charu C. Aggarwal is a Distinguished Research Staff Member (DRSM) at the IBM T. J. Watson Research Center in Yorktown Heights, New York. He completed his undergraduate degree in Computer Science from the Indian Institute of Technology at Kanpur in 1993 and his Ph.D. in Operations Research from the Massachusetts Institute of Technology in 1996. He has published more than 400 papers in refereed conferences and journals and has applied for or been granted more than 80 patents. He is author or editor of 19 books, including textbooks on data mining, neural networks, machine learning (for text), recommender systems, and outlier analysis. Because of the commercial value of his patents, he has thrice been designated a Master Inventor at IBM. He has received several internal and external awards, including the EDBT Test-of-Time Award (2014), the IEEE ICDM Research Contributions Award (2015), and the ACM SIGKDD Innovation Award (2019). He has served as editor-in-chief of the ACM SIGKDD Explorations, and is currently serving as an editor-in-chief of the ACM Transactions on Knowledge Discovery from Data. He is a fellow of the SIAM, ACM, and the IEEE, for “contributions to knowledge discovery and data mining algorithms.”

“Based on the topics covered and the excellent presentation, I would recommend Aggarwal's book over these other books for an advanced undergraduate or beginning graduate course on mathematics for data science.” (Brian Borchers, MAA Reviews, March 28, 2021)“This book should be of interest to graduate students in engineering, applied mathematics, and other fields requiring an understanding of the mathematical underpinnings of machine learning.” (IEEE Control Systems Magazine, Vol. 40 (6), December, 2020)

• Preface.- 1 Linear Algebra and Optimization: An Introduction.- 2 Linear Transformations and Linear Systems.- 3 Eigenvectors and Diagonalizable Matrices.- 4 Optimization Basics: A Machine Learning View.- 5 Advanced Optimization Solutions.- 6 Constrained Optimization and Duality.- 7 Singular Value Decomposition.- 8 Matrix Factorization.- 9 The Linear Algebra of Similarity.- 10 The Linear Algebra of Graphs.- 11 Optimization in Computational Graphs.- Index.