Synthesis Lectures on Signal Processing – serie

Spectral estimation is important in many fields including astronomy, meteorology, seismology, communications, economics, speech analysis, medical imaging, radar, sonar, and underwater acoustics. Most existing spectral estimation algorithms are devised for uniformly sampled complete-data sequences. However, the spectral estimation for data sequences with missing samples is also important in many applications ranging from astronomical time series analysis to synthetic aperture radar imaging with angular diversity. For spectral estimation in the missing-data case, the challenge is how to extend the existing spectral estimation techniques to deal with these missing-data samples. Recently, nonparametric adaptive filtering based techniques have been developed successfully for various missing-data problems. Collectively, these algorithms provide a comprehensive toolset for the missing-data problem based exclusively on the nonparametric adaptive filter-bank approaches, which are robust and accurate, and can provide high resolution and low sidelobes. In this book, we present these algorithms for both one-dimensional and two-dimensional spectral estimation problems.

The purpose of this lecture book is to present the state of the art in nonlinear blind source separation, in a form appropriate for students, researchers and developers. Source separation deals with the problem of recovering sources that are observed in a mixed condition. When we have little knowledge about the sources and about the mixture process, we speak of blind source separation. Linear blind source separation is a relatively well studied subject, however nonlinear blind source separation is still in a less advanced stage, but has seen several significant developments in the last few years.This publication reviews the main nonlinear separation methods, including the separation of post-nonlinear mixtures, and the MISEP, ensemble learning and kTDSEP methods for generic mixtures. These methods are studied with a significant depth. A historical overview is also presented, mentioning most of the relevant results, on nonlinear blind source separation, that have been presented over the years.

Linear prediction theory has had a profound impact in the field of digital signal processing. Although the theory dates back to the early 1940s, its influence can still be seen in applications today. The theory is based on very elegant mathematics and leads to many beautiful insights into statistical signal processing. Although prediction is only a part of the more general topics of linear estimation, filtering, and smoothing, this book focuses on linear prediction. This has enabled detailed discussion of a number of issues that are normally not found in texts. For example, the theory of vector linear prediction is explained in considerable detail and so is the theory of line spectral processes. This focus and its small size make the book different from many excellent texts which cover the topic, including a few that are actually dedicated to linear prediction. There are several examples and computer-based demonstrations of the theory. Applications are mentioned wherever appropriate, but the focus is not on the detailed development of these applications. The writing style is meant to be suitable for self-study as well as for classroom use at the senior and first-year graduate levels. The text is self-contained for readers with introductory exposure to signal processing, random processes, and the theory of matrices, and a historical perspective and detailed outline are given in the first chapter.Table of Contents: Introduction / The Optimal Linear Prediction Problem / Levinson's Recursion / Lattice Structures for Linear Prediction / Autoregressive Modeling / Prediction Error Bound and Spectral Flatness / Line Spectral Processes / Linear Prediction Theory for Vector Processes / Appendix A: Linear Estimation of Random Variables / B: Proof of a Property of Autocorrelations / C: Stability of the Inverse Filter / Recursion Satisfied by AR Autocorrelations

This book is Volume I of the series DSP for MATLAB™ and LabVIEW™. The entire series consists of four volumes that collectively cover basic digital signal processing in a practical and accessible manner, but which nonetheless include all essential foundation mathematics. As the series title implies, the scripts (of which there are more than 200) described in the text and supplied in code form here will run on both MATLAB and LabVIEW. Volume I consists of four chapters. The first chapter gives a brief overview of the field of digital signal processing. This is followed by a chapter detailing many useful signals and concepts, including convolution, recursion, difference equations, LTI systems, etc. The third chapter covers conversion from the continuous to discrete domain and back (i.e., analog-to-digital and digital-to-analog conversion), aliasing, the Nyquist rate, normalized frequency, conversion from one sample rate to another, waveform generation at various sample rates from stored wave data, and Mu-law compression. The fourth and final chapter of the present volume introduces the reader to many important principles of signal processing, including correlation, the correlation sequence, the Real DFT, correlation by convolution, matched filtering, simple FIR filters, and simple IIR filters. Chapter 4, in particular, provides an intuitive or "first principle" understanding of how digital filtering and frequency transforms work, preparing the reader for Volumes II and III, which provide, respectively, detailed coverage of discrete frequency transforms (including the Discrete Time Fourier Transform, the Discrete Fourier Transform, and the z-Transform) and digital filter design (FIR design using Windowing, Frequency Sampling, and Optimum Equiripple techniques, and Classical IIR design). Volume IV, the culmination of the series, is an introductory treatment of LMS Adaptive Filtering and applications. The text for all volumes contains many examples, and many useful computational scripts, augmented by demonstration scripts and LabVIEW Virtual Instruments (VIs) that can be run to illustrate various signal processing concepts graphically on the user's computer screen.Table of Contents: An Overview of DSP / Discrete Signals and Concepts / Sampling and Binary Representation / Transform and Filtering Principles

This book is Volume II of the series DSP for MATLAB™ and LabVIEW™. This volume provides detailed coverage of discrete frequency transforms, including a brief overview of common frequency transforms, both discrete and continuous, followed by detailed treatments of the Discrete Time Fourier Transform (DTFT), the z -Transform (including definition and properties, the inverse z -transform, frequency response via z-transform, and alternate filter realization topologies (including Direct Form, Direct Form Transposed, Cascade Form, Parallel Form, and Lattice Form), and the Discrete Fourier Transform (DFT) (including Discrete Fourier Series, the DFT-IDFT pair, DFT of common signals, bin width, sampling duration and sample rate, the FFT, the Goertzel Algorithm, Linear, Periodic, and Circular convolution, DFT Leakage, and computation of the Inverse DFT). The entire series consists of four volumes that collectively cover basic digital signal processing in a practical and accessible manner, but which nonetheless include all essential foundation mathematics. As the series title implies, the scripts (of which there are more than 200) described in the text and supplied in code form here will run on both MATLAB™ and LabVIEW™. The text for all volumes contains many examples, and many useful computational scripts, augmented by demonstration scripts and LabVIEW™ Virtual Instruments (VIs) that can be run to illustrate various signal processing concepts graphically on the user's computer. Volume I consists of four chapters that collectively set forth a brief overview of the field of digital signal processing, useful signals and concepts (including convolution, recursion, difference equations, LTI systems, etc), conversion from the continuous to discrete domain and back (i.e., analog-to-digital and digital-to-analog conversion), aliasing, the Nyquist rate, normalized frequency, sample rate conversion and Mu-law compression, and signal processing principles including correlation, the correlation sequence, the Real DFT, correlation by convolution, matched filtering, simple FIR filters, and simple IIR filters. Chapter 4 of Volume I, in particular, provides an intuitive or ""first principle"" understanding of how digital filtering and frequency transforms work, preparing the reader for the present volume (Volume II). Volume III of the series covers digital filter design (FIR design using Windowing, Frequency Sampling, and Optimum Equiripple techniques, and Classical IIR design) and Volume IV, the culmination of the series, is an introductory treatment of LMS Adaptive Filtering and applications.Table of Contents: The Discrete Time Fourier Transform / The z-Transform / The DFT

This book is Volume III of the series DSP for MATLAB™ and LabVIEW™. Volume III covers digital filter design, including the specific topics of FIR design via windowed-ideal-lowpass filter, FIR highpass, bandpass, and bandstop filter design from windowed-ideal lowpass filters, FIR design using the transition-band-optimized Frequency Sampling technique (implemented by Inverse-DFT or Cosine/Sine Summation Formulas), design of equiripple FIRs of all standard types including Hilbert Transformers and Differentiators via the Remez Exchange Algorithm, design of Butterworth, Chebyshev (Types I and II), and Elliptic analog prototype lowpass filters, conversion of analog lowpass prototype filters to highpass, bandpass, and bandstop filters, and conversion of analog filters to digital filters using the Impulse Invariance and Bilinear Transform techniques. Certain filter topologies specific to FIRs are also discussed, as are two simple FIR types, the Comb and Moving Average filters. The entire series consists of four volumes that collectively cover basic digital signal processing in a practical and accessible manner, but which nonetheless include all essential foundation mathematics. As the series title implies, the scripts (of which there are more than 200) described in the text and supplied in code form here will run on both MATLAB™ and LabVIEW™.The text for all volumes contains many examples, and many useful computational scripts, augmented by demonstration scripts and LabVIEW™ Virtual Instruments (VIs) that can be run to illustrate various signal processing concepts graphically on the user's computer screen. Volume I consists of four chapters that collectively set forth a brief overview of the field of digital signal processing, useful signals and concepts (including convolution, recursion, difference equations, LTI systems, etc), conversion from the continuous to discrete domain and back (i.e., analog-to-digital and digital-to-analog conversion), aliasing, the Nyquist rate, normalized frequency, sample rate conversion and Mu-law compression, and signal processing principles including correlation, the correlation sequence, the Real DFT, correlation by convolution, matched filtering, simple FIR filters, and simple IIR filters. Chapter four of Volume I, in particular, provides an intuitive or ""first principle"" understanding of how digital filtering and frequency transforms work. Volume II provides detailed coverage of discrete frequency transforms, including a brief overview of common frequency transforms, both discrete and continuous, followed by detailed treatments of the Discrete Time Fourier Transform (DTFT), the z-Transform (including definition and properties, the inverse z-transform, frequency response via z-transform, and alternate filter realization topologies including Direct Form, Direct Form Transposed, Cascade Form, Parallel Form, and Lattice Form), and the Discrete Fourier Transform (DFT) (including Discrete Fourier Series, the DFT-IDFT pair, DFT of common signals, bin width, sampling duration, and sample rate, the FFT, the Goertzel Algorithm, Linear, Periodic, and Circular convolution, DFT Leakage, and computation of the Inverse DFT). Volume IV, the culmination of the series, is an introductory treatment of LMS Adaptive Filtering and applications, and covers cost functions, performance surfaces, coefficient perturbation to estimate the gradient, the LMS algorithm, response of the LMS algorithm to narrow-band signals, and various topologies such as ANC (Active Noise Cancelling) or system modeling, Periodic Signal Removal/Prediction/Adaptive Line Enhancement (ALE), Interference Cancellation, Echo Cancellation (with single- and dual-H topologies), and Inverse Filtering/Deconvolution/Equalization.Table of Contents: Principles

This book is Volume IV of the series DSP for MATLAB™ and LabVIEW™. Volume IV is an introductory treatment of LMS Adaptive Filtering and applications, and covers cost functions, performance surfaces, coefficient perturbation to estimate the gradient, the LMS algorithm, response of the LMS algorithm to narrow-band signals, and various topologies such as ANC (Active Noise Cancelling) or system modeling, Noise Cancellation, Interference Cancellation, Echo Cancellation (with single- and dual-H topologies), and Inverse Filtering/Deconvolution. The entire series consists of four volumes that collectively cover basic digital signal processing in a practical and accessible manner, but which nonetheless include all essential foundation mathematics. As the series title implies, the scripts here will run on both MATLAB™ and LabVIEW™. The text for all volumes contains many examples, and many useful computational scripts, augmented by demonstration scripts and LabVIEW™ Virtual Instruments (VIs) that can be run to illustrate various signal processing concepts graphically on the user's computer screen. Volume I consists of four chapters that collectively set forth a brief overview of the field of digital signal processing, useful signals and concepts (including convolution, recursion, difference equations, LTI systems, etc), conversion from the continuous to discrete domain and back (i.e., analog-to-digital and digital-to-analog conversion), aliasing, the Nyquist rate, normalized frequency, sample rate conversion and Mu-law compression, and signal processing principles including correlation, the correlation sequence, the Real DFT, correlation by convolution, matched filtering, simple FIR filters, and simple IIR filters. Chapter 4 of Volume I, in particular, provides an intuitive or "first principle" understanding of how digital filtering and frequency transforms work. Volume II provides detailed coverage of discrete frequency transforms, including a brief overview of common frequency transforms, both discrete and continuous, followed by detailed treatments of the Discrete Time Fourier Transform (DTFT), the z-Transform (including definition and properties, the inverse z-transform, frequency response via z-transform, and alternate filter realization topologies including Direct Form, Direct Form Transposed, Cascade Form, Parallel Form, and Lattice Form), and the Discrete Fourier Transform (DFT) (including Discrete Fourier Series, the DFT-IDFT pair, DFT of common signals, bin width, sampling duration, and sample rate, the FFT, the Goertzel Algorithm, Linear, Periodic, and Circular convolution, DFT Leakage, and computation of the Inverse DFT). Volume III covers digital filter design, including the specific topics of FIR design via windowed-ideal-lowpass filter, FIR highpass, bandpass, and bandstop filter design from windowed-ideal lowpass filters, FIR design using the transition-band-optimized Frequency Sampling technique (implemented by Inverse-DFT or Cosine/Sine Summation Formulas), design of equiripple FIRs of all standard types including Hilbert Transformers and Differentiators via the Remez Exchange Algorithm, design of Butterworth, Chebyshev (Types I and II), and Elliptic analog prototype lowpass filters, conversion of analog lowpass prototype filters to highpass, bandpass, and bandstop filters, and conversion of analog filters to digital filters using the Impulse Invariance and Bilinear Transform techniques. Certain filter topologies specific to FIRs are also discussed, as are two simple FIR types, the Comb and Moving Average filters.Table of Contents: Introduction To LMS Adaptive Filtering / Applied Adaptive Filtering

Adaptive detection of signals embedded in correlated Gaussian noise has been an active field of research in the last decades. This topic is important in many areas of signal processing such as, just to give some examples, radar, sonar, communications, and hyperspectral imaging. Most of the existing adaptive algorithms have been designed following the lead of the derivation of Kelly's detector which assumes perfect knowledge of the target steering vector. However, in realistic scenarios, mismatches are likely to occur due to both environmental and instrumental factors. When a mismatched signal is present in the data under test, conventional algorithms may suffer severe performance degradation. The presence of strong interferers in the cell under test makes the detection task even more challenging. An effective way to cope with this scenario relies on the use of "tunable" detectors, i.e., detectors capable of changing their directivity through the tuning of proper parameters. The aim of this book is to present some recent advances in the design of tunable detectors and the focus is on the so-called two-stage detectors, i.e., adaptive algorithms obtained cascading two detectors with opposite behaviors. We derive exact closed-form expressions for the resulting probability of false alarm and the probability of detection for both matched and mismatched signals embedded in homogeneous Gaussian noise. It turns out that such solutions guarantee a wide operational range in terms of tunability while retaining, at the same time, an overall performance in presence of matched signals commensurate with Kelly's detector.Table of Contents: Introduction / Adaptive Radar Detection of Targets / Adaptive Detection Schemes for Mismatched Signals / Enhanced Adaptive Sidelobe Blanking Algorithms / Conclusions

This book is intended to fill the gap between the ""ideal precision"" digital signal processing (DSP) that is widely taught, and the limited precision implementation skills that are commonly required in fixed-point processors and field programmable gate arrays (FPGAs). These skills are often neglected at the university level, particularly for undergraduates. We have attempted to create a resource both for a DSP elective course and for the practicing engineer with a need to understand fixed-point implementation. Although we assume a background in DSP, Chapter 2 contains a review of basic theory and Chapter 3 reviews random processes to support the noise model of quantization error. Chapter 4 details the binary arithmetic that underlies fixed-point processors and then introduces fractional format for binary numbers. Chapter 5 covers the noise model for quantization error and the effects of coefficient quantization in filters. Because of the numerical sensitivity of IIR filters, they are used extensively as an example system in both Chapters 5 and 6. Fortunately, the principles of dealing with limited precision can be applied to a wide variety of numerically sensitive systems, not just IIR filters. Chapter 6 discusses the problems of product roundoff error and various methods of scaling to avoid overflow. Chapter 7 discusses limit cycle effects and a few common methods for minimizing them.There are a number of simple exercises integrated into the text to allow you to test your understanding. Answers to the exercises are included in the footnotes. A number of MATLAB examples are provided in the text. They generally assume access to the Fixed-Point Toolbox. If you lack access to this software, consider either purchasing or requesting an evaluation license from The Mathworks. The code listed in the text and other helpful MATLAB code is also available at http://www.morganclaypool.com/page/padgett and http://www.rose-hulman.edu/padgett/fpsp. You will also find MATLAB exercises designed to demonstrate each of the four types of error discussed in Chapters 5 and 6. Simulink examples are also provided on the web site.Table of Contents: Getting Started / DSP Concepts / Random Processes and Noise / Fixed Point Numbers / Quantization Effects: Data and Coefficients / Quantization Effects - Round-Off Noise and Overflow / Limit Cycles

This short book is for students, professors and professionals interested in signal processing of seismic data using MATLAB™. The step-by-step demo of the full reflection seismic data processing workflow using a complete real seismic data set places itself as a very useful feature of the book. This is especially true when students are performing their projects, and when professors and researchers are testing their new developed algorithms in MATLAB™ for processing seismic data. The book provides the basic seismic and signal processing theory required for each chapter and shows how to process the data from raw field records to a final image of the subsurface all using MATLAB™. The MATLAB™ codes and seismic data can be downloaded here.Table of Contents: Seismic Data Processing: A Quick Overview / Examination of A Real Seismic Data Set / Quality Control of Real Seismic Data / Seismic Noise Attenuation / Seismic Deconvolution / Carrying the Processing Forward / Static Corrections / Seismic Migration / Concluding Remarks

In these notes, we introduce particle filtering as a recursive importance sampling method that approximates the minimum-mean-square-error (MMSE) estimate of a sequence of hidden state vectors in scenarios where the joint probability distribution of the states and the observations is non-Gaussian and, therefore, closed-form analytical expressions for the MMSE estimate are generally unavailable.We begin the notes with a review of Bayesian approaches to static (i.e., time-invariant) parameter estimation. In the sequel, we describe the solution to the problem of sequential state estimation in linear, Gaussian dynamic models, which corresponds to the well-known Kalman (or Kalman-Bucy) filter. Finally, we move to the general nonlinear, non-Gaussian stochastic filtering problem and present particle filtering as a sequential Monte Carlo approach to solve that problem in a statistically optimal way.We review several techniques to improve the performance of particle filters, including importance function optimization, particle resampling, Markov Chain Monte Carlo move steps, auxiliary particle filtering, and regularized particle filtering. We also discuss Rao-Blackwellized particle filtering as a technique that is particularly well-suited for many relevant applications such as fault detection and inertial navigation. Finally, we conclude the notes with a discussion on the emerging topic of distributed particle filtering using multiple processors located at remote nodes in a sensor network.Throughout the notes, we often assume a more general framework than in most introductory textbooks by allowing either the observation model or the hidden state dynamic model to include unknown parameters. In a fully Bayesian fashion, we treat those unknown parameters also as random variables. Using suitable dynamic conjugate priors, that approach can be applied then to perform joint state and parameter estimation.Table of Contents: Introduction / Bayesian Estimation of Static Vectors / The Stochastic Filtering Problem / Sequential Monte Carlo Methods / Sampling/Importance Resampling (SIR) Filter / Importance Function Selection / Markov Chain Monte Carlo Move Step / Rao-Blackwellized Particle Filters / Auxiliary Particle Filter / Regularized Particle Filters / Cooperative Filtering with Multiple Observers / Application Examples / Summary

The Kalman filter is the Bayesian optimum solution to the problem of sequentially estimating the states of a dynamical system in which the state evolution and measurement processes are both linear and Gaussian. Given the ubiquity of such systems, the Kalman filter finds use in a variety of applications, e.g., target tracking, guidance and navigation, and communications systems. The purpose of this book is to present a brief introduction to Kalman filtering. The theoretical framework of the Kalman filter is first presented, followed by examples showing its use in practical applications. Extensions of the method to nonlinear problems and distributed applications are discussed. A software implementation of the algorithm in the MATLAB programming language is provided, as well as MATLAB code for several example applications discussed in the manuscript.

Compressed sensing (CS) allows signals and images to be reliably inferred from undersampled measurements. Exploiting CS allows the creation of new types of high-performance sensors including infrared cameras and magnetic resonance imaging systems. Advances in computer vision and deep learning have enabled new applications of automated systems. In this book, we introduce reconstruction-free compressive vision, where image processing and computer vision algorithms are embedded directly in the compressive domain, without the need for first reconstructing the measurements into images or video. Reconstruction of CS images is computationally expensive and adds to system complexity. Therefore, reconstruction-free compressive vision is an appealing alternative particularly for power-aware systems and bandwidth-limited applications that do not have on-board post-processing computational capabilities. Engineers must balance maintaining algorithm performance while minimizing both the number of measurements needed and the computational requirements of the algorithms. Our study explores the intersection of compressed sensing and computer vision, with the focus on applications in surveillance and autonomous navigation. Other applications are also discussed at the end and a comprehensive list of references including survey papers are given for further reading.

A typical undergraduate electrical engineering curriculum incorporates a signals and systems course. The widely used approach for the laboratory component of such courses involves the utilization of MATLAB to implement signals and systems concepts. This book presents a newly developed laboratory paradigm where MATLAB codes are made to run on smartphones which are possessed by nearly all students. As a result, this laboratory paradigm provides an anywhere-anytime hardware platform or processing board for students to learn implementation aspects of signals and systems concepts. The book covers the laboratory experiments that are normally covered in signals and systems courses and discusses how to run MATLAB codes for these experiments as apps on both Android and iOS smartphones, thus enabling a truly mobile laboratory paradigm. A zipped file of the codes discussed in the book can be acquired via the website http://sites.fastspring.com/bookcodes/product/SignalsSystemsBookcodesThirdEdition

Real-time or applied digital signal processing courses are offered as follow-ups to conventional or theory-oriented digital signal processing courses in many engineering programs for the purpose of teaching students the technical know-how for putting signal processing algorithms or theory into practical use. These courses normally involve access to a teaching laboratory that is equipped with hardware boards, in particular DSP boards, together with their supporting software. A number of textbooks have been written discussing how to achieve real-time implementation on these hardware boards. This book discusses how to use smartphones as hardware boards for real-time implementation of signal processing algorithms, thus providing an alternative to the hardware boards that are used in signal processing laboratory courses. The fact that mobile devices, in particular smartphones, have become powerful processing platforms led to the development of this book to enable students to use their own smartphones to run signal processing algorithms in real-time considering that these days nearly all students possess smartphones. Changing the hardware platforms that are currently used in applied or real-time signal processing courses to smartphones creates a truly flexible laboratory experience or environment for students. In addition, it relieves the cost burden associated with using dedicated signal processing boards noting that the software development tools for smartphones are free of charge and are well-maintained by smartphone manufacturers. This book is written in such a way that it can be used as a textbook for real-time or applied digital signal processing courses offered at many universities. Ten lab experiments that are commonly encountered in such courses are covered in the book. It is written primarily for those who are already familiar with signal processing concepts and are interested in their real-time and practical aspects. Similar to existing real-time courses, knowledge of C programming is assumed. This book can also be used as a self-study guide for those who wish to become familiar with signal processing app development on either Android or iOS smartphones/tablets.

Linear algebra is one of the most basic foundations of a wide range of scientific domains, and most textbooks of linear algebra are written by mathematicians. However, this book is specifically intended to students and researchers of pattern information processing, analyzing signals such as images and exploring computer vision and computer graphics applications. The author himself is a researcher of this domain.Such pattern information processing deals with a large amount of data, which are represented by high-dimensional vectors and matrices. There, the role of linear algebra is not merely numerical computation of large-scale vectors and matrices. In fact, data processing is usually accompanied with "geometric interpretation." For example, we can think of one data set being "orthogonal" to another and define a "distance" between them or invoke geometric relationships such as "projecting" some data onto some space. Such geometric concepts not only help us mentally visualize abstracthigh-dimensional spaces in intuitive terms but also lead us to find what kind of processing is appropriate for what kind of goals.First, we take up the concept of "projection" of linear spaces and describe "spectral decomposition," "singular value decomposition," and "pseudoinverse" in terms of projection. As their applications, we discuss least-squares solutions of simultaneous linear equations and covariance matrices of probability distributions of vector random variables that are not necessarily positive definite. We also discuss fitting subspaces to point data and factorizing matrices in high dimensions in relation to motion image analysis. Finally, we introduce a computer vision application of reconstructing the 3D location of a point from three camera views to illustrate the role of linear algebra in dealing with data with noise. This book is expected to help students and researchers of pattern information processing deepen the geometric understanding of linear algebra.

This book is designed for use as a textbook for a one semester Signals and Systems class. It is sufficiently user friendly to be used for self study as well. It begins with a gentle introduction to the idea of abstraction by looking at numbers—the one highly abstract concept we use all the time. It then introduces some special functions that are useful for analyzing signals and systems. It then spends some time discussing some of the properties of systems; the goal being to introduce the idea of a linear time-invariant system which is the focus of the rest of the book. Fourier series, discrete and continuous time Fourier transforms are introduced as tools for the analysis of signals. The concepts of sampling and modulation which are very much a part of everyday life are discussed as applications of the these tools. Laplace transform and Z transform are then introduced as tools to analyze systems. The notions of stability of systems and feedback are analyzed using these tools.The book is divided into thirty bite-sized modules. Each module also links up with a video lecture through a QR code in each module. The video lectures are approximately thirty minutes long. There are a set of self study questions at the end of each module along with answers to help the reader reinforce the concepts in the module.

This book introduces basic machine learning concepts and applications for a broad audience that includes students, faculty, and industry practitioners. We begin by describing how machine learning provides capabilities to computers and embedded systems to learn from data. A typical machine learning algorithm involves training, and generally the performance of a machine learning model improves with more training data. Deep learning is a sub-area of machine learning that involves extensive use of layers of artificial neural networks typically trained on massive amounts of data. Machine and deep learning methods are often used in contemporary data science tasks to address the growing data sets and detect, cluster, and classify data patterns. Although machine learning commercial interest has grown relatively recently, the roots of machine learning go back to decades ago. We note that nearly all organizations, including industry, government, defense, and health, are using machine learning toaddress a variety of needs and applications. The machine learning paradigms presented can be broadly divided into the following three categories: supervised learning, unsupervised learning, and semi-supervised learning. Supervised learning algorithms focus on learning a mapping function, and they are trained with supervision on labeled data. Supervised learning is further sub-divided into classification and regression algorithms. Unsupervised learning typically does not have access to ground truth, and often the goal is to learn or uncover the hidden pattern in the data. Through semi-supervised learning, one can effectively utilize a large volume of unlabeled data and a limited amount of labeled data to improve machine learning model performances. Deep learning and neural networks are also covered in this book. Deep neural networks have attracted a lot of interest during the last ten years due to the availability of graphics processing units (GPU) computational power, big data, and new software platforms. They have strong capabilities in terms of learning complex mapping functions for different types of data. We organize the book as follows. The book starts by introducing concepts in supervised, unsupervised, and semi-supervised learning. Several algorithms and their inner workings are presented within these three categories. We then continue with a brief introduction to artificial neural network algorithms and their properties. In addition, we cover an array of applications and provide extensive bibliography. The book ends with a summary of the key machine learning concepts.

This book teaches the fundamentals and mathematical formulas of reversible transformations (or transforms) that are used in many source coding and signal processing systems. These mathematical transforms are often necessary or crucial toward reduction of data storage and transmission rate requirements. The author emphasizes the wavelet transform as it is the preferred transform for practical application in many coding and signal processing systems. The book also covers the tap (coefficient) values for some of those filters that satisfy the perfect reconstruction property. Examples of the use of filter-based and matrix-based transforms are also provided. This self-contained work contains insight gained through research and practice, which makes it a valuable reference and tutorial for readers interested in the subject of mathematical transforms.This book:Teaches the fundamentals and mathematical formulas of reversible transformations, as well as theirapplicationsHighlights the wavelet transformation, which is the preferred transform for many practical applicationsContains insight gained through research and practice, making it a valuable resource those interested in the topic