Jacob Benesty - Böcker

Speech enhancement is a classical problem in signal processing, yet still largely unsolved. Two of the conventional approaches for solving this problem are linear filtering, like the classical Wiener filter, and subspace methods. These approaches have traditionally been treated as different classes of methods and have been introduced in somewhat different contexts. Linear filtering methods originate in stochastic processes, while subspace methods have largely been based on developments in numerical linear algebra and matrix approximation theory.

This book bridges the gap between these two classes of methods by showing how the ideas behind subspace methods can be incorporated into traditional linear filtering. In the context of subspace methods, the enhancement problem can then be seen as a classical linear filter design problem. This means that various solutions can more easily be compared and their performance bounded and assessed in terms of noise reduction and speech distortion. The book shows how various filter designs can be obtained in this framework, including the maximum SNR, Wiener, LCMV, and MVDR filters, and how these can be applied in various contexts, like in single-channel and multichannel speech enhancement, and in both the time and frequency domains.

First short book treating subspace approaches in a unified way for time and frequency domains, single-channel, multichannel, as well as binaural, speech enhancement Bridges the gap between optimal filtering methods and subspace approaches Includes original presentation of subspace methods from different perspectives

Presents a unified framework of far-field and near-field array techniques for noise source identification and sound field visualization, from theory to application.Acoustic Array Systems: Theory, Implementation, and Application provides an overview of microphone array technology with applications in noise source identification and sound field visualization. In the comprehensive treatment of microphone arrays, the topics covered include an introduction to the theory, far-field and near-field array signal processing algorithms, practical implementations, and common applications: vehicles, computing and communications equipment, compressors, fans, and household appliances, and hands-free speech. The author concludes with other emerging techniques and innovative algorithms. Encompasses theoretical background, implementation considerations and application know-howShows how to tackle broader problems in signal processing, control, and transudcersCovers both farfield and nearfield techniques in a balanced wayIntroduces innovative algorithms including equivalent source imaging (NESI) and high-resolution nearfield arraysSelected code examples available for download for readers to practice on their ownPresentation slides available for instructor useA valuable resource for Postgraduates and researchers in acoustics, noise control engineering, audio engineering, and signal processing.

The ongoing revolution in electronic switching and transport technologies promises a dramatic increase in user satisfaction levels for future telecommunications networks. However, unless there is a corresponding improvement in the technologies of the acoustics of telecommunications, this promise will prove empty. The sense of presence that people feel when together in a room is largely due to the psycho-acoustic cues they sense from the human binaural hearing system evolved over thousands of years. Modern acoustic signal processing is just now beginning to be able to deliver that same experience to users in seperate locations. This includes the ability to communicate in full duplex with wider bandwidths and multiple audio streams (for instance stereo and 3D audio). It also involves locating and separating audio sources, suppressing noise, and using sound to automatically steer video cameras. This text presents digital signal processing techniques for telecommunications acoustics that are both cutting-edge and practical. Each chapter presents concepts as yet unused, but easily realizable with today's technology.To this end, both new theory and new implementation techniques are presented. Topics include new adaptive filtering algorithms, multi-channel acoustic echo cancellation, noise control, virtual sound, sound source localization for camera tracking, source separation, and microphone arrays.

A comprehensive guide to the theory and practice of signal enhancement and array signal processing, including matlab codes, exercises and instructor and solution manuals   Systematically introduces the fundamental principles, theory and applications of signal enhancement and array signal processing in an accessible mannerOffers an updated and relevant treatment of array signal processing with rigor and concisionFeatures a companion website that includes presentation files with lecture notes, homework exercises, course projects, solution manuals, instructor manuals, and Matlab codes for the examples in the book

Audio Signal Processing for Next-Generation Multimedia Communication Systems presents cutting-edge digital signal processing theory and implementation techniques for problems including speech acquisition and enhancement using microphone arrays, new adaptive filtering algorithms, multichannel acoustic echo cancellation, sound source tracking and separation, audio coding, and realistic sound stage reproduction. This book's focus is almost exclusively on the processing, transmission, and presentation of audio and acoustic signals in multimedia communications for telecollaboration where immersive acoustics will play a great role in the near future.

158 2. Wiener Filtering 159 3. Speech Enhancement by Short-Time Spectral Modification 3. 1 Short-Time Fourier Analysis and Synthesis 159 160 3. 2 Short-Time Wiener Filter 161 3. 3 Power Subtraction 3. 4 Magnitude Subtraction 162 3. 5 Parametric Wiener Filtering 163 164 3. 6 Review and Discussion Averaging Techniques for Envelope Estimation 169 4. 169 4. 1 Moving Average 170 4. 2 Single-Pole Recursion 170 4. 3 Two-Sided Single-Pole Recursion 4. 4 Nonlinear Data Processing 171 5. Example Implementation 172 5. 1 Subband Filter Bank Architecture 172 173 5. 2 A-Posteriori-SNR Voice Activity Detector 5. 3 Example 175 6. Conclusion 175 Part IV Microphone Arrays 10 Superdirectional Microphone Arrays 181 Gary W. Elko 1. Introduction 181 2. Differential Microphone Arrays 182 3. Array Directional Gain 192 4. Optimal Arrays for Spherically Isotropic Fields 193 4. 1 Maximum Gain for Omnidirectional Microphones 193 4. 2 Maximum Directivity Index for Differential Microphones 195 4. 3 Maximimum Front-to-Back Ratio 197 4. 4 Minimum Peak Directional Response 200 4. 5 Beamwidth 201 5. Design Examples 201 5. 1 First-Order Designs 202 5. 2 Second-Order Designs 207 5. 3 Third-Order Designs 216 5. 4 Higher-Order designs 221 6. Optimal Arrays for Cylindrically Isotropic Fields 222 6. 1 Maximum Gain for Omnidirectional Microphones 222 6. 2 Optimal Weights for Maximum Directional Gain 224 6. 3 Solution for Optimal Weights for Maximum Front-to-Back Ratio for Cylindrical Noise 225 7. Sensitivity to Microphone Mismatch and Noise 230 8.

Audio Signal Processing for Next-Generation Multimedia Communication Systems presents cutting-edge digital signal processing theory and implementation techniques for problems including speech acquisition and enhancement using microphone arrays, new adaptive filtering algorithms, multichannel acoustic echo cancellation, sound source tracking and separation, audio coding, and realistic sound stage reproduction. This book's focus is almost exclusively on the processing, transmission, and presentation of audio and acoustic signals in multimedia communications for telecollaboration where immersive acoustics will play a great role in the near future.

The focus of this book is on array processing and beamforming with Kronecker products.

This book studies the link between differential beamforming and differential equations which in turn enables the study of fundamental theory and methods of beamforming from a different perspective, leading to new insights into the problem and new methods to solve the problem. The book first presents a brief overview of the problems and methods for beamforming and some performance measures popularly used either to evaluate beamformers or to derive optimal beamformers. Then, first-order, second-order, and general high-order linear difference equations are discussed, based on which the authors show how to formulate the beamforming problem and derive different beamforming methods, including fixed and adaptive ones. Furthermore, the authors show how to apply the theory of difference equations to the general problem of speech enhancement, and deduce a number of noise reduction filters, including the maximum SNR filter, the Wiener filter, the MVDR filter, etc. Also covered in the book are thedifference equations and differential beamforming from the spectral graph perspective.Presents basic concepts, fundamental principles, and methods for beamforming from the perspective of linear difference equations;Provides formulation and methods of conventional beamforming, and first-order, second-order, and general high-order linear difference equations for beamforming;Includes the applications of linear difference equations to the problem of noise reduction;Explains beamforming based on difference equations with graphs.

This book studies the link between differential beamforming and differential equations which in turn enables the study of fundamental theory and methods of beamforming from a different perspective, leading to new insights into the problem and new methods to solve the problem. The book first presents a brief overview of the problems and methods for beamforming and some performance measures popularly used either to evaluate beamformers or to derive optimal beamformers. Then, first-order, second-order, and general high-order linear difference equations are discussed, based on which the authors show how to formulate the beamforming problem and derive different beamforming methods, including fixed and adaptive ones. Furthermore, the authors show how to apply the theory of difference equations to the general problem of speech enhancement, and deduce a number of noise reduction filters, including the maximum SNR filter, the Wiener filter, the MVDR filter, etc. Also covered in the book are thedifference equations and differential beamforming from the spectral graph perspective.Presents basic concepts, fundamental principles, and methods for beamforming from the perspective of linear difference equations;Provides formulation and methods of conventional beamforming, and first-order, second-order, and general high-order linear difference equations for beamforming;Includes the applications of linear difference equations to the problem of noise reduction;Explains beamforming based on difference equations with graphs.

Adaptive filters with a large number of coefficients are usually involved in both network and acoustic echo cancellation. Consequently, it is important to improve the convergence rate and tracking of the conventional algorithms used for these applications. This can be achieved by exploiting the sparseness character of the echo paths. Identification of sparse impulse responses was addressed mainly in the last decade with the development of the so-called ``proportionate''-type algorithms. The goal of this book is to present the most important sparse adaptive filters developed for echo cancellation. Besides a comprehensive review of the basic proportionate-type algorithms, we also present some of the latest developments in the field and propose some new solutions for further performance improvement, e.g., variable step-size versions and novel proportionate-type affine projection algorithms. An experimental study is also provided in order to compare many sparse adaptive filters in different echo cancellation scenarios. Table of Contents: Introduction / Sparseness Measures / Performance Measures / Wiener and Basic Adaptive Filters / Basic Proportionate-Type NLMS Adaptive Filters / The Exponentiated Gradient Algorithms / The Mu-Law PNLMS and Other PNLMS-Type Algorithms / Variable Step-Size PNLMS Algorithms / Proportionate Affine Projection Algorithms / Experimental Study

This book is devoted to the study of the problem of speech enhancement whose objective is the recovery of a signal of interest (i.e., speech) from noisy observations. Typically, the recovery process is accomplished by passing the noisy observations through a linear filter (or a linear transformation). Since both the desired speech and undesired noise are filtered at the same time, the most critical issue of speech enhancement resides in how to design a proper optimal filter that can fully take advantage of the difference between the speech and noise statistics to mitigate the noise effect as much as possible while maintaining the speech perception identical to its original form. The optimal filters can be designed either in the time domain or in a transform space. As the title indicates, this book will focus on developing and analyzing optimal filters in the Karhunen-Loève expansion (KLE) domain. We begin by describing the basic problem of speech enhancement and the fundamental principles to solve it in the time domain. We then explain how the problem can be equivalently formulated in the KLE domain. Next, we divide the general problem in the KLE domain into four groups, depending on whether interframe and interband information is accounted for, leading to four linear models for speech enhancement in the KLE domain. For each model, we introduce signal processing measures to quantify the performance of speech enhancement, discuss the formation of different cost functions, and address the optimization of these cost functions for the derivation of different optimal filters. Both theoretical analysis and experiments will be provided to study the performance of these filters and the links between the KLE-domain and time-domain optimal filters will be examined. Table of Contents: Introduction / Problem Formulation / Optimal Filters in the Time Domain / Linear Models for Signal Enhancement in the KLE Domain / Optimal Filters in the KLE Domain with Model 1 / Optimal Filtersin the KLE Domain with Model 2 / Optimal Filters in the KLE Domain with Model 3 / Optimal Filters in the KLE Domain with Model 4 / Experimental Study

Table of Contents: Introduction / Problem Formulation / Performance Measures / Linear and Widely Linear Models / Optimal Filters with Model 1 / Optimal Filters with Model 2 / Optimal Filters with Model 3 / Optimal Filters with Model 4 / Experimental Study

This book explains the motivation for using microphone arrays as opposed to using a single sensor for sound acquisition. The book then goes on to summarize the most useful ideas, concepts, results, and new algorithms therein. The material presented in this work includes analysis of the advantages of using microphone arrays, including dimensionality reduction to remove the redundancy while preserving the variability of the array signals using the principal component analysis (PCA). The authors also discuss benefits such as beamforming with low-rank approximations, fixed, adaptive, and robust distortionless beamforming, differential beamforming, and a new form of binaural beamforming that takes advantage of both beamforming and human binaural hearing properties to improve speech intelligibility. The book makes the microphone array signal processing theory and applications available in a complete and self-contained text. The authors attempt to explain the main ideas in a clear and rigorous way so that the reader can easily capture the potentials, opportunities, challenges, and limitations of microphone array signal processing. This book is written for those who work on the topics of microphone arrays, noise reduction, speech enhancement, speech communication, and human-machine speech interfaces.

This book explains the motivation for using microphone arrays as opposed to using a single sensor for sound acquisition.

Though noise reduction and speech enhancement problems have been studied for at least five decades, advances in our understanding and the development of reliable algorithms are more important than ever, as they support the design of tailored solutions for clearly defined applications. In this work, the authors propose a conceptual framework that can be applied to the many different aspects of noise reduction, offering a uniform approach to monaural and binaural noise reduction problems, in the time domain and in the frequency domain, and involving a single or multiple microphones. Moreover, the derivation of optimal filters is simplified, as are the performance measures used for their evaluation.

Recently, we proposed a completely novel and efficient way to design differential beamforming algorithms for linear microphone arrays. Thanks to this very flexible approach, any order of differential arrays can be designed. Moreover, they can be made robust against white noise amplification, which is the main inconvenience in these types of arrays. The other well-known problem with linear arrays is that electronic steering is not really feasible.In this book, we extend all these fundamental ideas to circular microphone arrays and show that we can design small and compact differential arrays of any order that can be electronically steered in many different directions and offer a good degree of control of the white noise amplification problem, high directional gain, and frequency-independent response. We also present a number of practical examples, demonstrating that differential beamforming with circular microphone arrays is likely one of the best candidates for applications involving speech enhancement (i.e., noise reduction and dereverberation). Nearly all of the material presented is new and will be of great interest to engineers, students, and researchers working with microphone arrays and their applications in all types of telecommunications, security and surveillance contexts.

Recently, we proposed a completely novel and efficient way to design differential beamforming algorithms for linear microphone arrays. Thanks to this very flexible approach, any order of differential arrays can be designed. Moreover, they can be made robust against white noise amplification, which is the main inconvenience in these types of arrays. The other well-known problem with linear arrays is that electronic steering is not really feasible.In this book, we extend all these fundamental ideas to circular microphone arrays and show that we can design small and compact differential arrays of any order that can be electronically steered in many different directions and offer a good degree of control of the white noise amplification problem, high directional gain, and frequency-independent response. We also present a number of practical examples, demonstrating that differential beamforming with circular microphone arrays is likely one of the best candidates for applications involving speech enhancement (i.e., noise reduction and dereverberation). Nearly all of the material presented is new and will be of great interest to engineers, students, and researchers working with microphone arrays and their applications in all types of telecommunications, security and surveillance contexts.

This book focuses on the application of canonical correlation analysis (CCA) to speech enhancement using the filtering approach. The authors explain how to derive different classes of time-domain and time-frequency-domain noise reduction filters, which are optimal from the CCA perspective for both single-channel and multichannel speech enhancement. Enhancement of noisy speech has been a challenging problem for many researchers over the past few decades and remains an active research area. Typically, speech enhancement algorithms operate in the short-time Fourier transform (STFT) domain, where the clean speech spectral coefficients are estimated using a multiplicative gain function. A filtering approach, which can be performed in the time domain or in the subband domain, obtains an estimate of the clean speech sample at every time instant or time-frequency bin by applying a filtering vector to the noisy speech vector.Compared to the multiplicative gain approach, the filtering approach more naturally takes into account the correlation of the speech signal in adjacent time frames. In this study, the authors pursue the filtering approach and show how to apply CCA to the speech enhancement problem. They also address the problem of adaptive beamforming from the CCA perspective, and show that the well-known Wiener and minimum variance distortionless response (MVDR) beamformers are particular cases of a general class of CCA-based adaptive beamformers.

This book presents and develops several important concepts of speech enhancement in a simple but rigorous way. Many of the ideas are new; not only do they shed light on this old problem but they also offer valuable tips on how to improve on some well-known conventional approaches. The book unifies all aspects of speech enhancement, from single channel, multichannel, beamforming, time domain, frequency domain and time–frequency domain, to binaural in a clear and flexible framework. It starts with an exhaustive discussion on the fundamental best (linear and nonlinear) estimators, showing how they are connected to various important measures such as the coefficient of determination, the correlation coefficient, the conditional correlation coefficient, and the signal-to-noise ratio (SNR). It then goes on to show how to exploit these measures in order to derive all kinds of noise reduction algorithms that can offer an accurate and versatile compromise between noise reduction and speech distortion.

The goal of this book is to provide, for the first time, a reference to the most relevant applications of adaptive filtering techniques. Top researchers in the field contributed chapters addressing their specific topic of study. The topics are limited to acoustics, speech, wireless, and networking applications where research is still very active and open. The book is roughly organized into two parts. In the first part, several applications in acoustics and speech are developed. The second part focuses on wireless and networking applications. Some chapters are tutorial in nature ,while others present new research ideas, and all have in common, the use of adaptive algorithms to solve real-world problems.

We live in a noisy world! In all applications (telecommunications, hands-free communications, recording, human-machine interfaces, etc.) that require at least one microphone, the signal of interest is usually contaminated by noise and reverberation. As a result, the microphone signal has to be "cleaned" with digital signal processing tools before it is played out, transmitted, or stored.This book is about speech enhancement. Different well-known and state-of-the-art methods for noise reduction, with one or multiple microphones, are discussed. By speech enhancement, we mean not only noise reduction but also dereverberation and separation of independent signals. These topics are also covered in this book. However, the general emphasis is on noise reduction because of the large number of applications that can benefit from this technology.The goal of this book is to provide a strong reference for researchers, engineers, and graduate students who are interested in the problem of signal and speech enhancement. To do so, we invited well-known experts to contribute chapters covering the state of the art in this focused field.

Telecommunication systems and human-machine interfaces start employing multiple microphones and loudspeakers in order to make conversations and interactions more lifelike, hence more efficient. This development gives rise to a variety of acoustic signal processing problems under multiple-input multiple-output (MIMO) scenarios, encompassing distant speech acquisition, sound source localization and tracking, echo and noise control, source separation and speech dereverberation, and many others. Acoustic MIMO Signal Processing is divided into two major parts - the theoretical and the practical. The authors begin by introducing an acoustic MIMO paradigm, establishing the fundamental of the field, and linking acoustic MIMO signal processing with the concepts of classical signal processing and communication theories in terms of system identification, equalization, and adaptive algorithms. In the second part of the book, a novel and penetrating analysis of aforementioned acoustic applications is carried out in the paradigm to reinforce the fundamental concepts of acoustic MIMO signal processing.Acoustic MIMO Signal Processing is a timely and important professional reference for researchers and practitioners from universities and a wide range of industries. It is also an excellent text for graduate students who are interested in this exciting field.

While there are many manuscripts on antenna arrays from a narrowband perspective (narrowband signals and narrowband processing), the literature is quite scarce when it comes to s- sor arrays explained from a truly broadband perspective.

Noise is everywhere and in most applications that are related to audio and speech, such as human-machine interfaces, hands-free communications, voice over IP (VoIP), hearing aids, teleconferencing/telepresence/telecollaboration systems, and so many others, the signal of interest (usually speech) that is picked up by a microphone is generally contaminated by noise. As a result, the microphone signal has to be cleaned up with digital signal processing tools before it is stored, analyzed, transmitted, or played out. This cleaning process is often called noise reduction and this topic has attracted a considerable amount of research and engineering attention for several decades. One of the objectives of this book is to present in a common framework an overview of the state of the art of noise reduction algorithms in the single-channel (one microphone) case. The focus is on the most useful approaches, i.e., filtering techniques (in different domains) and spectral enhancement methods. The other objective of Noise Reduction in Speech Processing is to derive all these well-known techniques in a rigorous way and prove many fundamental and intuitive results often taken for granted. This book is especially written for graduate students and research engineers who work on noise reduction for speech and audio applications and want to understand the subtle mechanisms behind each approach. Many new and interesting concepts are presented in this text that we hope the readers will find useful and inspiring.

By adaptive signal processing, we mean, in general, adaptive ?ltering.In- known environments where we need to model, identify, or track time-varying channels, adaptive ?ltering has been proven to be an e?ective and powerful tool. As a result, this tool is now in use in many di?erent ?elds. Since the invention, by Widrow and Ho? in 1959, of one of the ?rst ad- tive ?lters, the so-called least-mean-square, many applications appeared to have the potential to use this fundamental concept. While the number of - plications (using adaptive algorithms) has been (and keeps) ?ourishing with time, thanks to several successes, the need for more sophisticated adaptive algorithms became obvious as real-world problems are more complex and more demanding. Even though the theory of adaptive ?ltering is already a well-established topic in signal processing, new and improved concepts are discovered every year by researchers. Some of these recent approaches are discussed in this book. The goal of this book is to provide, for the ?rst time, a reference to the hottest real-world applications where adaptive ?ltering techniques play an important role. To do so, we invited top researchers in di?erent ?elds to c- tribute chapters addressing their speci?c topic of study. Thousands of pages wouldprobablynotbe enoughto describeallthe practicalapplicationsutil- ing adaptive algorithms. Therefore, we limited the topics to some important applications in acoustics, speech, wireless, and networking, where research is still very active and open.

We live in a noisy world! In all applications (telecommunications, hands-free communications, recording, human-machine interfaces, etc.) that require at least one microphone, the signal of interest is usually contaminated by noise and reverberation. As a result, the microphone signal has to be "cleaned" with digital signal processing tools before it is played out, transmitted, or stored.This book is about speech enhancement. Different well-known and state-of-the-art methods for noise reduction, with one or multiple microphones, are discussed. By speech enhancement, we mean not only noise reduction but also dereverberation and separation of independent signals. These topics are also covered in this book. However, the general emphasis is on noise reduction because of the large number of applications that can benefit from this technology.The goal of this book is to provide a strong reference for researchers, engineers, and graduate students who are interested in the problem of signal and speech enhancement. To do so, we invited well-known experts to contribute chapters covering the state of the art in this focused field.

Telecommunication systems and human-machine interfaces start employing multiple microphones and loudspeakers in order to make conversations and interactions more lifelike, hence more efficient. This development gives rise to a variety of acoustic signal processing problems under multiple-input multiple-output (MIMO) scenarios, encompassing distant speech acquisition, sound source localization and tracking, echo and noise control, source separation and speech dereverberation, and many others. Acoustic MIMO Signal Processing is divided into two major parts - the theoretical and the practical. The authors begin by introducing an acoustic MIMO paradigm, establishing the fundamental of the field, and linking acoustic MIMO signal processing with the concepts of classical signal processing and communication theories in terms of system identification, equalization, and adaptive algorithms. In the second part of the book, a novel and penetrating analysis of aforementioned acoustic applications is carried out in the paradigm to reinforce the fundamental concepts of acoustic MIMO signal processing.Acoustic MIMO Signal Processing is a timely and important professional reference for researchers and practitioners from universities and a wide range of industries. It is also an excellent text for graduate students who are interested in this exciting field.