Jingdong Chen - Böcker

Speech enhancement is a classical problem in signal processing, yet still largely unsolved. Two of the conventional approaches for solving this problem are linear filtering, like the classical Wiener filter, and subspace methods. These approaches have traditionally been treated as different classes of methods and have been introduced in somewhat different contexts. Linear filtering methods originate in stochastic processes, while subspace methods have largely been based on developments in numerical linear algebra and matrix approximation theory.

This book bridges the gap between these two classes of methods by showing how the ideas behind subspace methods can be incorporated into traditional linear filtering. In the context of subspace methods, the enhancement problem can then be seen as a classical linear filter design problem. This means that various solutions can more easily be compared and their performance bounded and assessed in terms of noise reduction and speech distortion. The book shows how various filter designs can be obtained in this framework, including the maximum SNR, Wiener, LCMV, and MVDR filters, and how these can be applied in various contexts, like in single-channel and multichannel speech enhancement, and in both the time and frequency domains.

First short book treating subspace approaches in a unified way for time and frequency domains, single-channel, multichannel, as well as binaural, speech enhancement Bridges the gap between optimal filtering methods and subspace approaches Includes original presentation of subspace methods from different perspectives

A comprehensive guide to the theory and practice of signal enhancement and array signal processing, including matlab codes, exercises and instructor and solution manuals   Systematically introduces the fundamental principles, theory and applications of signal enhancement and array signal processing in an accessible mannerOffers an updated and relevant treatment of array signal processing with rigor and concisionFeatures a companion website that includes presentation files with lecture notes, homework exercises, course projects, solution manuals, instructor manuals, and Matlab codes for the examples in the book

The focus of this book is on array processing and beamforming with Kronecker products.

This book studies the link between differential beamforming and differential equations which in turn enables the study of fundamental theory and methods of beamforming from a different perspective, leading to new insights into the problem and new methods to solve the problem. The book first presents a brief overview of the problems and methods for beamforming and some performance measures popularly used either to evaluate beamformers or to derive optimal beamformers. Then, first-order, second-order, and general high-order linear difference equations are discussed, based on which the authors show how to formulate the beamforming problem and derive different beamforming methods, including fixed and adaptive ones. Furthermore, the authors show how to apply the theory of difference equations to the general problem of speech enhancement, and deduce a number of noise reduction filters, including the maximum SNR filter, the Wiener filter, the MVDR filter, etc. Also covered in the book are thedifference equations and differential beamforming from the spectral graph perspective.Presents basic concepts, fundamental principles, and methods for beamforming from the perspective of linear difference equations;Provides formulation and methods of conventional beamforming, and first-order, second-order, and general high-order linear difference equations for beamforming;Includes the applications of linear difference equations to the problem of noise reduction;Explains beamforming based on difference equations with graphs.

This book studies the link between differential beamforming and differential equations which in turn enables the study of fundamental theory and methods of beamforming from a different perspective, leading to new insights into the problem and new methods to solve the problem. The book first presents a brief overview of the problems and methods for beamforming and some performance measures popularly used either to evaluate beamformers or to derive optimal beamformers. Then, first-order, second-order, and general high-order linear difference equations are discussed, based on which the authors show how to formulate the beamforming problem and derive different beamforming methods, including fixed and adaptive ones. Furthermore, the authors show how to apply the theory of difference equations to the general problem of speech enhancement, and deduce a number of noise reduction filters, including the maximum SNR filter, the Wiener filter, the MVDR filter, etc. Also covered in the book are thedifference equations and differential beamforming from the spectral graph perspective.Presents basic concepts, fundamental principles, and methods for beamforming from the perspective of linear difference equations;Provides formulation and methods of conventional beamforming, and first-order, second-order, and general high-order linear difference equations for beamforming;Includes the applications of linear difference equations to the problem of noise reduction;Explains beamforming based on difference equations with graphs.

This book is devoted to the study of the problem of speech enhancement whose objective is the recovery of a signal of interest (i.e., speech) from noisy observations. Typically, the recovery process is accomplished by passing the noisy observations through a linear filter (or a linear transformation). Since both the desired speech and undesired noise are filtered at the same time, the most critical issue of speech enhancement resides in how to design a proper optimal filter that can fully take advantage of the difference between the speech and noise statistics to mitigate the noise effect as much as possible while maintaining the speech perception identical to its original form. The optimal filters can be designed either in the time domain or in a transform space. As the title indicates, this book will focus on developing and analyzing optimal filters in the Karhunen-Loève expansion (KLE) domain. We begin by describing the basic problem of speech enhancement and the fundamental principles to solve it in the time domain. We then explain how the problem can be equivalently formulated in the KLE domain. Next, we divide the general problem in the KLE domain into four groups, depending on whether interframe and interband information is accounted for, leading to four linear models for speech enhancement in the KLE domain. For each model, we introduce signal processing measures to quantify the performance of speech enhancement, discuss the formation of different cost functions, and address the optimization of these cost functions for the derivation of different optimal filters. Both theoretical analysis and experiments will be provided to study the performance of these filters and the links between the KLE-domain and time-domain optimal filters will be examined. Table of Contents: Introduction / Problem Formulation / Optimal Filters in the Time Domain / Linear Models for Signal Enhancement in the KLE Domain / Optimal Filters in the KLE Domain with Model 1 / Optimal Filtersin the KLE Domain with Model 2 / Optimal Filters in the KLE Domain with Model 3 / Optimal Filters in the KLE Domain with Model 4 / Experimental Study

This book explains the motivation for using microphone arrays as opposed to using a single sensor for sound acquisition. The book then goes on to summarize the most useful ideas, concepts, results, and new algorithms therein. The material presented in this work includes analysis of the advantages of using microphone arrays, including dimensionality reduction to remove the redundancy while preserving the variability of the array signals using the principal component analysis (PCA). The authors also discuss benefits such as beamforming with low-rank approximations, fixed, adaptive, and robust distortionless beamforming, differential beamforming, and a new form of binaural beamforming that takes advantage of both beamforming and human binaural hearing properties to improve speech intelligibility. The book makes the microphone array signal processing theory and applications available in a complete and self-contained text. The authors attempt to explain the main ideas in a clear and rigorous way so that the reader can easily capture the potentials, opportunities, challenges, and limitations of microphone array signal processing. This book is written for those who work on the topics of microphone arrays, noise reduction, speech enhancement, speech communication, and human-machine speech interfaces.

This book explains the motivation for using microphone arrays as opposed to using a single sensor for sound acquisition.

Though noise reduction and speech enhancement problems have been studied for at least five decades, advances in our understanding and the development of reliable algorithms are more important than ever, as they support the design of tailored solutions for clearly defined applications. In this work, the authors propose a conceptual framework that can be applied to the many different aspects of noise reduction, offering a uniform approach to monaural and binaural noise reduction problems, in the time domain and in the frequency domain, and involving a single or multiple microphones. Moreover, the derivation of optimal filters is simplified, as are the performance measures used for their evaluation.

Recently, we proposed a completely novel and efficient way to design differential beamforming algorithms for linear microphone arrays. Thanks to this very flexible approach, any order of differential arrays can be designed. Moreover, they can be made robust against white noise amplification, which is the main inconvenience in these types of arrays. The other well-known problem with linear arrays is that electronic steering is not really feasible.In this book, we extend all these fundamental ideas to circular microphone arrays and show that we can design small and compact differential arrays of any order that can be electronically steered in many different directions and offer a good degree of control of the white noise amplification problem, high directional gain, and frequency-independent response. We also present a number of practical examples, demonstrating that differential beamforming with circular microphone arrays is likely one of the best candidates for applications involving speech enhancement (i.e., noise reduction and dereverberation). Nearly all of the material presented is new and will be of great interest to engineers, students, and researchers working with microphone arrays and their applications in all types of telecommunications, security and surveillance contexts.

Recently, we proposed a completely novel and efficient way to design differential beamforming algorithms for linear microphone arrays. Thanks to this very flexible approach, any order of differential arrays can be designed. Moreover, they can be made robust against white noise amplification, which is the main inconvenience in these types of arrays. The other well-known problem with linear arrays is that electronic steering is not really feasible.In this book, we extend all these fundamental ideas to circular microphone arrays and show that we can design small and compact differential arrays of any order that can be electronically steered in many different directions and offer a good degree of control of the white noise amplification problem, high directional gain, and frequency-independent response. We also present a number of practical examples, demonstrating that differential beamforming with circular microphone arrays is likely one of the best candidates for applications involving speech enhancement (i.e., noise reduction and dereverberation). Nearly all of the material presented is new and will be of great interest to engineers, students, and researchers working with microphone arrays and their applications in all types of telecommunications, security and surveillance contexts.

We live in a noisy world! In all applications (telecommunications, hands-free communications, recording, human-machine interfaces, etc.) that require at least one microphone, the signal of interest is usually contaminated by noise and reverberation. As a result, the microphone signal has to be "cleaned" with digital signal processing tools before it is played out, transmitted, or stored.This book is about speech enhancement. Different well-known and state-of-the-art methods for noise reduction, with one or multiple microphones, are discussed. By speech enhancement, we mean not only noise reduction but also dereverberation and separation of independent signals. These topics are also covered in this book. However, the general emphasis is on noise reduction because of the large number of applications that can benefit from this technology.The goal of this book is to provide a strong reference for researchers, engineers, and graduate students who are interested in the problem of signal and speech enhancement. To do so, we invited well-known experts to contribute chapters covering the state of the art in this focused field.

Telecommunication systems and human-machine interfaces start employing multiple microphones and loudspeakers in order to make conversations and interactions more lifelike, hence more efficient. This development gives rise to a variety of acoustic signal processing problems under multiple-input multiple-output (MIMO) scenarios, encompassing distant speech acquisition, sound source localization and tracking, echo and noise control, source separation and speech dereverberation, and many others. Acoustic MIMO Signal Processing is divided into two major parts - the theoretical and the practical. The authors begin by introducing an acoustic MIMO paradigm, establishing the fundamental of the field, and linking acoustic MIMO signal processing with the concepts of classical signal processing and communication theories in terms of system identification, equalization, and adaptive algorithms. In the second part of the book, a novel and penetrating analysis of aforementioned acoustic applications is carried out in the paradigm to reinforce the fundamental concepts of acoustic MIMO signal processing.Acoustic MIMO Signal Processing is a timely and important professional reference for researchers and practitioners from universities and a wide range of industries. It is also an excellent text for graduate students who are interested in this exciting field.

While there are many manuscripts on antenna arrays from a narrowband perspective (narrowband signals and narrowband processing), the literature is quite scarce when it comes to s- sor arrays explained from a truly broadband perspective.

Noise is everywhere and in most applications that are related to audio and speech, such as human-machine interfaces, hands-free communications, voice over IP (VoIP), hearing aids, teleconferencing/telepresence/telecollaboration systems, and so many others, the signal of interest (usually speech) that is picked up by a microphone is generally contaminated by noise. As a result, the microphone signal has to be cleaned up with digital signal processing tools before it is stored, analyzed, transmitted, or played out. This cleaning process is often called noise reduction and this topic has attracted a considerable amount of research and engineering attention for several decades. One of the objectives of this book is to present in a common framework an overview of the state of the art of noise reduction algorithms in the single-channel (one microphone) case. The focus is on the most useful approaches, i.e., filtering techniques (in different domains) and spectral enhancement methods. The other objective of Noise Reduction in Speech Processing is to derive all these well-known techniques in a rigorous way and prove many fundamental and intuitive results often taken for granted. This book is especially written for graduate students and research engineers who work on noise reduction for speech and audio applications and want to understand the subtle mechanisms behind each approach. Many new and interesting concepts are presented in this text that we hope the readers will find useful and inspiring.

We live in a noisy world! In all applications (telecommunications, hands-free communications, recording, human-machine interfaces, etc.) that require at least one microphone, the signal of interest is usually contaminated by noise and reverberation. As a result, the microphone signal has to be "cleaned" with digital signal processing tools before it is played out, transmitted, or stored.This book is about speech enhancement. Different well-known and state-of-the-art methods for noise reduction, with one or multiple microphones, are discussed. By speech enhancement, we mean not only noise reduction but also dereverberation and separation of independent signals. These topics are also covered in this book. However, the general emphasis is on noise reduction because of the large number of applications that can benefit from this technology.The goal of this book is to provide a strong reference for researchers, engineers, and graduate students who are interested in the problem of signal and speech enhancement. To do so, we invited well-known experts to contribute chapters covering the state of the art in this focused field.

Telecommunication systems and human-machine interfaces start employing multiple microphones and loudspeakers in order to make conversations and interactions more lifelike, hence more efficient. This development gives rise to a variety of acoustic signal processing problems under multiple-input multiple-output (MIMO) scenarios, encompassing distant speech acquisition, sound source localization and tracking, echo and noise control, source separation and speech dereverberation, and many others. Acoustic MIMO Signal Processing is divided into two major parts - the theoretical and the practical. The authors begin by introducing an acoustic MIMO paradigm, establishing the fundamental of the field, and linking acoustic MIMO signal processing with the concepts of classical signal processing and communication theories in terms of system identification, equalization, and adaptive algorithms. In the second part of the book, a novel and penetrating analysis of aforementioned acoustic applications is carried out in the paradigm to reinforce the fundamental concepts of acoustic MIMO signal processing.Acoustic MIMO Signal Processing is a timely and important professional reference for researchers and practitioners from universities and a wide range of industries. It is also an excellent text for graduate students who are interested in this exciting field.

In the past few years we have written and edited several books in the area of acousticandspeechsignalprocessing. Thereasonbehindthisendeavoristhat there were almost no books available in the literature when we ?rst started while there was (and still is) a real need to publish manuscripts summarizing the most useful ideas, concepts, results, and state-of-the-art algorithms in this important area of research. According to all the feedback we have received so far, we can say that we were right in doing this. Recently, several other researchers have followed us in this journey and have published interesting books with their own visions and perspectives. The idea of writing a book on Microphone Array Signal Processing comes from discussions we have had with many colleagues and friends. As a c- sequence of these discussions, we came up with the conclusion that, again, there is an urgent need for a monograph that carefully explains the theory and implementation of microphone arrays. While there are many manuscripts on antenna arrays from a narrowband perspective (narrowband signals and narrowband processing), the literature is quite scarce when it comes to s- sor arrays explained from a truly broadband perspective. Many algorithms for speech applications were simply borrowed from narrowband antenna - rays. However, a direct application of narrowband ideas to broadband speech processing may not be necessarily appropriate and can lead to many m- understandings.

Noise is everywhere and in most applications that are related to audio and speech, such as human-machine interfaces, hands-free communications, voice over IP (VoIP), hearing aids, teleconferencing/telepresence/telecollaboration systems, and so many others, the signal of interest (usually speech) that is picked up by a microphone is generally contaminated by noise. As a result, the microphone signal has to be cleaned up with digital signal processing tools before it is stored, analyzed, transmitted, or played out. This cleaning process is often called noise reduction and this topic has attracted a considerable amount of research and engineering attention for several decades. One of the objectives of this book is to present in a common framework an overview of the state of the art of noise reduction algorithms in the single-channel (one microphone) case. The focus is on the most useful approaches, i.e., filtering techniques (in different domains) and spectral enhancement methods. The other objective of Noise Reduction in Speech Processing is to derive all these well-known techniques in a rigorous way and prove many fundamental and intuitive results often taken for granted. This book is especially written for graduate students and research engineers who work on noise reduction for speech and audio applications and want to understand the subtle mechanisms behind each approach. Many new and interesting concepts are presented in this text that we hope the readers will find useful and inspiring.

Additive noise is ubiquitous in acoustics environments and can affect the intelligibility and quality of speech signals. Therefore, a so-called noise reduction algorithm is required to mitigate the effect of the noise that is picked up by the microphones. This work proposes a general framework in the time domain for the single and multiple microphone cases, from which it is very convenient to derive, study, and analyze all kind of optimal noise reduction filters. Not only that all known algorithms can be deduced from this approach, shedding more light on how they function, but new ones can be discovered as well.

This work addresses this problem in the short-time Fourier transform (STFT) domain. We divide the general problem into five basic categories depending on the number of microphones being used and whether the interframe or interband correlation is considered. The first category deals with the single-channel problem where STFT coefficients at different frames and frequency bands are assumed to be independent. In this case, the noise reduction filter in each frequency band is basically a real gain. Since a gain does not improve the signal-to-noise ratio (SNR) for any given subband and frame, the noise reduction is basically achieved by liftering the subbands and frames that are less noisy while weighing down on those that are more noisy. The second category also concerns the single-channel problem. The difference is that now the interframe correlation is taken into account and a filter is applied in each subband instead of just a gain. The advantage of using the interframe correlation is that we can improve not only the long-time fullband SNR, but the frame-wise subband SNR as well. The third and fourth classes discuss the problem of multichannel noise reduction in the STFT domain with and without interframe correlation, respectively. In the last category, we consider the interband correlation in the design of the noise reduction filters. We illustrate the basic principle for the single-channel case as an example, while this concept can be generalized to other scenarios. In all categories, we propose different optimization cost functions from which we derive the optimal filters and we also define the performance measures that help analyzing them.

Microphone arrays have attracted a lot of interest over the last few decades since they have the potential to solve many important problems such as noise reduction/speech enhancement, source separation, dereverberation, spatial sound recording, and source localization/tracking, to name a few. However, the design and implementation of microphone arrays with beamforming algorithms is not a trivial task when it comes to processing broadband signals such as speech. Indeed, in most sensor arrangements, the beamformer output tends to have a frequency-dependent response. One exception, perhaps, is the family of differential microphone arrays (DMAs) who have the promise to form frequency-independent responses. Moreover, they have the potential to attain high directional gains with small and compact apertures. As a result, this type of microphone arrays has drawn much research and development attention recently. This book is intended to provide a systematic study of DMAs from a signal processing perspective. The primary objective is to develop a rigorous but yet simple theoryfor the design, implementation, and performance analysis of DMAs. The theory includes some signal processing techniques for the design of commonly used first-order, second-order, third-order, and also the general Nth-order DMAs. For each order, particular examples are given on how to form standard directional patterns such as the dipole, cardioid, supercardioid, hypercardioid, subcardioid, and quadrupole. The study demonstrates the performance of the different order DMAs in terms of beampattern, directivity factor, white noise gain, and gain for point sources. The inherent relationship between differential processing and adaptive beamforming is discussed, which provides a better understanding of DMAs and why they can achieve high directional gain. Finally, we show how to design DMAs that can be robust against white noise amplification.

Microphone arrays have attracted a lot of interest over the last few decades since they have the potential to solve many important problems such as noise reduction/speech enhancement, source separation, dereverberation, spatial sound recording, and source localization/tracking, to name a few. However, the design and implementation of microphone arrays with beamforming algorithms is not a trivial task when it comes to processing broadband signals such as speech. Indeed, in most sensor arrangements, the beamformer output tends to have a frequency-dependent response. One exception, perhaps, is the family of differential microphone arrays (DMAs) who have the promise to form frequency-independent responses. Moreover, they have the potential to attain high directional gains with small and compact apertures. As a result, this type of microphone arrays has drawn much research and development attention recently. This book is intended to provide a systematic study of DMAs from a signal processing perspective. The primary objective is to develop a rigorous but yet simple theoryfor the design, implementation, and performance analysis of DMAs. The theory includes some signal processing techniques for the design of commonly used first-order, second-order, third-order, and also the general Nth-order DMAs. For each order, particular examples are given on how to form standard directional patterns such as the dipole, cardioid, supercardioid, hypercardioid, subcardioid, and quadrupole. The study demonstrates the performance of the different order DMAs in terms of beampattern, directivity factor, white noise gain, and gain for point sources. The inherent relationship between differential processing and adaptive beamforming is discussed, which provides a better understanding of DMAs and why they can achieve high directional gain. Finally, we show how to design DMAs that can be robust against white noise amplification.