Introduction to Statistical Machine Learning

Masashi Sugiyama received the degrees of Bachelor of Engineering, Master of Engineering, and Doctor of Engineering in Computer Science from Tokyo Institute of Technology, Japan in 1997, 1999, and 2001, respectively. In 2001, he was appointed Assistant Professor in the same institute, and he was promoted to Associate Professor in 2003. He moved to the University of Tokyo as Professor in 2014. He received an Alexander von Humboldt Foundation Research Fellowship and researched at Fraunhofer Institute, Berlin, Germany, from 2003 to 2004. In 2006, he received a European Commission Program Erasmus Mundus Scholarship and researched at the University of Edinburgh, Edinburgh, UK. He received the Faculty Award from IBM in 2007 for his contribution to machine learning under non-stationarity, the Nagao Special Researcher Award from the Information Processing Society of Japan in 2011 and the Young Scientists' Prize from the Commendation for Science and Technology by the Minister of Education, Culture, Sports, Science and Technology Japan for his contribution to the density-ratio paradigm of machine learning. His research interests include theories and algorithms of machine learning and data mining, and a wide range of applications such as signal processing, image processing, and robot control.

"The probabilistic and statistical background is well presented, providing the reader with a complete coverage of the generative approach to statistical pattern recognition and the discriminative approach to statistical machine learning." --Zentralblatt MATH

• Part I: Introduction to Statistics and Probability1. Random variables and probability distributions2. Examples of discrete probability distributions3. Examples of continuous probability distributions4. Multi-dimensional probability distributions5. Examples of multi-dimensional probability distributions6. Random sample generation from arbitrary probability distributions7. Probability distributions of the sum of independent random variables8. Probability inequalities9. Statistical inference10. Hypothesis testingPart II: Generative Approach to Statistical Pattern Recognition11. Fundamentals of statistical pattern recognition12. Criteria for developing classifiers13. Maximum likelihood estimation14. Theoretical properties of maximum likelihood estimation15. Linear discriminant analysis16. Model selection for maximum likelihood estimation17. Maximum likelihood estimation for Gaussian mixture model18. Bayesian inference19. Numerical computation in Bayesian inference20. Model selection in Bayesian inference21. Kernel density estimation22. Nearest neighbor density estimationPart III: Discriminative Approach to Statistical Machine Learning23. Fundamentals of statistical machine learning24. Learning Models25. Least-squares regression26. Constrained least-squares regression27. Sparse regression28. Robust regression29. Least-squares classification30. Support vector classification31. Ensemble classification32. Probabilistic classification33. Structured classificationPart IV: Further Topics34. Outlier detection35. Unsupervised dimensionality reduction36. Clustering37. Online learning38. Semi-supervised learning39. Supervised dimensionality reduction40. Transfer learning41. Multi-task learning