Johan A.K. Suykens - Böcker

Regularization, Optimization, Kernels, and Support Vector Machines offers a snapshot of the current state of the art of large-scale machine learning, providing a single multidisciplinary source for the latest research and advances in regularization, sparsity, compressed sensing, convex and large-scale optimization, kernel methods, and support vector machines. Consisting of 21 chapters authored by leading researchers in machine learning, this comprehensive reference:Covers the relationship between support vector machines (SVMs) and the LassoDiscusses multi-layer SVMsExplores nonparametric feature selection, basis pursuit methods, and robust compressive sensingDescribes graph-based regularization methods for single- and multi-task learningConsiders regularized methods for dictionary learning and portfolio selectionAddresses non-negative matrix factorizationExamines low-rank matrix and tensor-based modelsPresents advanced kernel methods for batch and online machine learning, system identification, domain adaptation, and image processingTackles large-scale algorithms including conditional gradient methods, (non-convex) proximal techniques, and stochastic gradient descentRegularization, Optimization, Kernels, and Support Vector Machines is ideal for researchers in machine learning, pattern recognition, data mining, signal processing, statistical learning, and related areas.

Topics contained in this text on nonlinear modelling include: neural nets and related model structures for nonlinear system identification; enhanced multi-stream Kalman filter training for recurrent networks; the support vector method of function estimation; parametric density estimation for the classification of acoustic feature vectors in speech recognition; wavelet-based modelling of nonlinear systems; nonlinear identification based on fuzzy models; statistical learning in control and matrix theory; and nonlinear time-series analysis. It also contains the results of the K.U. Leuven time series prediction competition, held within the framework of an international workshop at the K.U. Leuven, Belgium in July 1998.

Artificial neural networks possess several properties that make them particularly attractive for applications to modelling and control of complex non-linear systems. Among these properties are their universal approximation ability, their parallel network structure and the availability of on- and off-line learning methods for the interconnection weights. However, dynamic models that contain neural network architectures might be highly non-linear and difficult to analyze as a result. This work investigates the subject from a system theoretical point of view. However the mathematical theory that is required from the reader is limited to matrix calculus, basic analysis, differential equations and basic linear system theory. No preliminary knowledge of neural networks is explicitly required. The book presents both classical and novel network architectures and learning algorithms for modelling and control. Topics include non-linear system identification, neural optimal control, top-down model based neural control design and stability analysis of neural control systems.A major contribution of this book is to introduce NLq Theory as an extension towards modern control theory, in order to analyze and synthesize non-linear systems that contain linear together with static non-linear operators that satisfy a sector condition: neural state space control systems are an example. Moreover, it turns out that NLq Theory is unifying with respect to many problems arising in neural networks, systems and control.

Artificial neural networks possess several properties that make them particularly attractive for applications to modelling and control of complex non-linear systems. Among these properties are their universal approximation ability, their parallel network structure and the availability of on- and off-line learning methods for the interconnection weights. However, dynamic models that contain neural network architectures might be highly non-linear and difficult to analyse as a result. Artificial Neural Networks for Modelling and Control of Non-Linear Systems investigates the subject from a system theoretical point of view. However the mathematical theory that is required from the reader is limited to matrix calculus, basic analysis, differential equations and basic linear system theory. No preliminary knowledge of neural networks is explicitly required. The book presents both classical and novel network architectures and learning algorithms for modelling and control. Topics include non-linear system identification, neural optimal control, top-down model based neural control design and stability analysis of neural control systems.A major contribution of this book is to introduce NLq Theory as an extension towards modern control theory, in order to analyze and synthesize non-linear systems that contain linear together with static non-linear operators that satisfy a sector condition: neural state space control systems are an example. Moreover, it turns out that NLq Theory is unifying with respect to many problems arising in neural networks, systems and control. Examples show that complex non-linear systems can be modelled and controlled within NLq theory, including mastering chaos. The didactic flavor of this book makes it suitable for use as a text for a course on Neural Networks. In addition, researchers and designers will find many important new techniques, in particular NLq Theory, that have applications in control theory, system theory, circuit theory and Time Series Analysis.

Nonlinear Modeling: Advanced Black-Box Techniques discusses methods on Neural nets and related model structures for nonlinear system identification; Enhanced multi-stream Kalman filter training for recurrent networks; The support vector method of function estimation; Parametric density estimation for the classification of acoustic feature vectors in speech recognition; Wavelet-based modeling of nonlinear systems; Nonlinear identification based on fuzzy models; Statistical learning in control and matrix theory; Nonlinear time-series analysis. It also contains the results of the K.U. Leuven time series prediction competition, held within the framework of an international workshop at the K.U. Leuven, Belgium in July 1998.