View source for Physics:3D sound localization

{{Short description|Acoustic technology to locate the source of a sound in three-dimensional space}}
'''3D sound localization''' refers to an [[Physics:Acoustical engineering|acoustic]] technology that is used to locate the source of a sound in a [[Three-dimensional space|three-dimensional space]]. The source location is usually determined by the direction of the incoming sound waves (horizontal and vertical angles) and the distance between the source and sensors. It involves the structure arrangement design of the sensors and [[Signal processing|signal processing]] techniques.

Most [[Biology:Mammal|mammal]]s (including humans) use binaural hearing to localize sound, by comparing the information received from each ear in a complex process that involves a significant amount of synthesis. It is difficult to localize using [[Physics:Monaural|monaural]] hearing, especially in 3D space.

==Technology==
Sound localization technology is used in some [[Engineering:Audio signal|audio]] and [[Physics:Acoustics|acoustics]] fields, such as hearing aids, surveillance<ref>{{cite book|last1=Keyrouz|first1=Fakheredine|last2=Diepold|first2=Klaus|last3=Keyrouz|first3=Shady|title=2007 IEEE Conference on Advanced Video and Signal Based Surveillance |chapter=High performance 3D sound localization for surveillance applications |date=September 2007|pages=563–6|doi=10.1109/AVSS.2007.4425372|isbn=978-1-4244-1695-0|s2cid=11238184|url=https://research.tue.nl/nl/publications/high-performance-3d-sound-localization-for-surveillance-applications(4e84634b-26f8-4424-8265-d5cd7c31a615).html}}</ref> and [[Earth:Navigation|navigation]]. Existing real-time passive sound localization systems are mainly based on the time-difference-of-arrival (TDOA) approach, limiting sound localization to [[Two-dimensional space|two-dimensional space]], and are not practical in noisy conditions.

==Applications==
[[File:Collecting Multibeam Sonar Data.jpg|thumb|Collecting Multibeam Sonar Data]]
Applications of sound source localization include sound source separation, sound source tracking, and speech enhancement. Sonar uses sound source localization techniques to identify the location of a target. 3D sound localization is also used for effective human-robot interaction. With the increasing demand for robotic hearing, some applications of 3D sound localization such as human-machine interface, handicapped aid, and military applications, are being explored.<ref>{{cite web |last1=Kjær |first1=Brüel |title=Noise Source Identification |url=https://www.bksv.com/en/knowledge/applications/noise-source-identification |website=bksv.com |publisher=Brüel & Kjær}}</ref>

==Cues for sound localization==
Localization cues<ref>{{cite book|first=E.Bruce|last=Goldstein|title=Sensation and Perception|publisher=Cengage Learning|pages=293–297|isbn= 978-0-495-60149-4|date=2009-02-13|edition=Eighth}}</ref> are features that help localize sound. Cues for sound localization include binaural and monoaural cues.
* Monoaural cues can be obtained via [[Spectrum#Spectrogram|spectral analysis]] and are generally used in vertical localization.
* Binaural cues are generated by the difference in hearing between the left and right ears. These differences include the [[Engineering:Interaural time difference|interaural time difference]] (ITD) and the interaural intensity difference (IID). Binaural cues are used mostly for horizontal localization.

==How does one localize sound?==
{{See also|Physics:Sound localization|Interaural time difference}}
The first clue our hearing uses is interaural time difference. Sound from a source directly in front of or behind us will arrive simultaneously at both ears. If the source moves to the left or right, our ears pick up the sound from the same source arriving at both ears - but with a certain delay. Another way of saying it could be, that the two ears pick up different phases of the same signal.<ref name="bksv">{{cite web |last1=Kjær |first1=Brüel |title=Listening in 3D |url=https://www.bksv.com/en/knowledge/blog/sound/sound-localization |website=Brüel & Kjær }}</ref>

==Methods==
There are many different methods of 3D sound localization. For instance:
* Different types of sensor structure, such as [[Engineering:Microphone array|microphone array]] and binaural hearing robot head.<ref name="binaural">{{cite book |doi=10.1109/ICSMC.2005.1571695|chapter=3D Sound Source Localization System Based on Learning of Binaural Hearing|title=2005 IEEE International Conference on Systems, Man and Cybernetics|volume=4|pages=3534–3539|year=2005|last1=Nakashima|first1=H.|last2=Mukai|first2=T.|isbn=0-7803-9298-1|s2cid=7446711}}</ref>
* Different techniques for optimal results, such as [[Neural network|neural network]], maximum likelihood and Multiple signal classification (MUSIC).
* Real-time methods using an Acoustic Vector Sensor (AVS) array <ref>{{cite journal|last2=Cui|first2=Zheng|last3=Zhao|first3=Shengkui|last4=Rupnow|first4=Kyle|last5=Zhang|first5=Yihao|last6=Jones|first6=Douglas L.|last7=Chen|first7=Deming|date=2012|title=Real-time implementation and performance optimization of 3D sound localization on GPUs|journal=Automation and Test in Europe Conference and Exhibition|pages=832–5|issn=1530-1591|last1=Liang|first1=Yun}}</ref>
* Scanning techniques<ref>{{cite journal|last1=Fernandez Comesana|first1=D.|last2=Steltenpool|first2=S.|last3=Korbasiewicz |first3=M.|last4=Tijs|first4=E.|date=2015|title=Direct acoustic vector field mapping: new scanning tools for measuring 3D sound intensity in 3D space|url=https://www.microflown.com/resources/scientific-papers/direct-acoustic-vector-field-mapping-new-scanning-tools-for-measuring-3d-sound-intensity-in-3d-space|journal=Proceedings of Euronoise|pages=891–895|issn=2226-5147}}</ref>
* Offline methods (according to timeliness)
* Microphone Array Approach

===Steered Beamformer Approach===
This approach utilizes eight microphones combined with a steered beamformer enhanced by the Reliability Weighted Phase Transform (RWPHAT). The final results are filtered through a [[Particle filter|particle filter]] that tracks sources and prevents false directions.

The motivation of using this method is that based on previous research. This method is used for multiple sound source tracking and localizing despite soundtracking and localization only apply for a single sound source.

====Beamformer-based Sound Localization====
To maximize the output energy of a delay-and-sum beamformer in order to find the maximum value of the output of a beamformer steered in all possible directions.
Using the Reliability Weighted Phase Transform (RWPHAT) method,
The output energy of M-microphone delay-and-sum beamformer is
:<math>E = K + 2\sum_{{m}_{1}=1}^{M-1} \sum_{{m}_{2}=0}^{{m}_{1}-1}{{R}^\text{RWPHAT}}_{i,j}\left({\tau}_{{m}_{1}}-{\tau}_{{m}_{2}} \right)</math>

Where E indicates the energy, and K is a constant, <math>{{R}^\text{RWPHAT}}_{i,j}\left({\tau}_{{m}_{1}}-{\tau}_{{m}_{2}} \right)</math> is the microphone pairs [[Cross-correlation|cross-correlation]] defined by Reliability Weighted Phase Transform:
:<math>{{R}^\text{RWPHAT}}_{i,j}\left(\tau  \right) = \sum_{k=0}^{L-1}\frac{{\zeta }_{i}\left(k \right){X}_{i}\left(k \right){\zeta }_{j}\left(k \right){{X}_{j}}^{*}\left(k \right)}{\left|{X}_{i}\left(k \right) \right|\left|{X}_{j}\left(k \right) \right|}{e}^{j2\pi k\tau /L}</math>
the weighted factor <math>{{\zeta}^{n}}_{i}\left(k \right)</math> reflect the reliability of each frequency component, and defined as the Wiener Filter gain <math>{{\zeta}^{n}}_{i}\left(k \right) = \frac{{{\xi }^{n}}_{i}\left(k \right)}{{{\xi }^{n}}_{i}\left(k \right)+1}</math>, where <math>{{\xi }^{n}}_{i}\left(k \right)</math> is an estimate of a prior SNR at <math>i^{th}</math> microphone, at time frame <math>n</math>, for frequency <math>k</math>, computed using the decision-directed approach.<ref>{{cite journal|last1=Ephraim|first1=Y.|last2=Malah|first2=D.|title= Speech enhancement using a minimum-mean square error short-time spectral amplitude estimator|journal= IEEE Transactions on Acoustics, Speech, and Signal Processing|date=Dec 1984|volume=32|issue=6|pages=1109–21|doi=10.1109/TASSP.1984.1164453|issn=0096-3518}}</ref>

The <math>x_{m_n}</math> is the signal from <math>{m}^{th}</math> microphone and  <math>{\tau}_{{m}_{n}}</math> is the delay of arrival for that microphone. The more specific procedure of this method is proposed by Valin and Michaud<ref>{{cite book|last1=Valin|first1=J.M.|last2=Michaud|first2=F.|last3=Rouat|first3=Jean|title=2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings|chapter=Robust 3D Localization and Tracking of Sound Sources Using Beamforming and Particle Filtering|date=14–19 May 2006|volume=4|page=IV|doi=10.1109/ICASSP.2006.1661100|issn=1520-6149|arxiv=1604.01642|isbn=978-1-4244-0469-8|s2cid=557491}}</ref>

The advantage of this method is that it detects the direction of the sound and derives the distance of sound sources. The main drawback of the beamforming approach is the imperfect nature of sound localization accuracy and capability, versus the neural network approach, which uses moving speakers.

===Collocated Microphone Array Approach===
This method relates to the technique of Real-Time sound localization utilizing an Acoustic Vector Sensor (AVS) array, which measures all three components of the acoustic particle velocity, as well as the sound pressure, unlike conventional acoustic [[Engineering:Sensor array|sensor array]]s that only utilize the pressure information and delays in the propagating acoustic field. Exploiting this extra information, AVS arrays are able to significantly improve the accuracy of source localization.

====Acoustic Vector Array====
[[File:Acoustic Vector Sensor.jpg|thumb|Picture of a 3D Acoustic Vector Sensor (air)]]
• Contains three orthogonally placed acoustic particle velocity sensors (shown as X, Y and Z array) and one omnidirectional acoustic microphone (O).

• Commonly used both in air <ref>{{Cite journal|last1=Pérez Cabo| first1= Daniel| last2=de Bree|first2 =Hans Elias | last3=Fernandez Comesaña|first3=Daniel| last4= Sobreira Seoane | first4=Manuel | title=Real life harmonic source localization using a network of acoustic vector sensors|journal=EuroNoise 2015|url=https://www.microflown.com/resources/scientific-papers/real-life-harmonic-source-localization-using-a-network-of-acoustic-vector-sensors}}</ref> and underwater.

• Can be used in combination with the Offline Calibration Process<ref>{{cite journal|last1=Salas Natera|first1=M.A.|last2=Martinez Rodriguez-Osorio|first2=R.|last3=de Haro Ariet|first3=L.|last4=Sierra Perez|first4=M.|title=Calibration Proposal for New Antenna Array Architectures and Technologies for Space Communications|journal=IEEE Antennas and Wireless Propagation Letters|date=2012|volume=11|pages=1129–32|doi=10.1109/LAWP.2012.2215952|issn=1536-1225|bibcode=2012IAWPL..11.1129S|url=http://oa.upm.es/16395/}}</ref> to measure and interpolate the impulse response of X, Y, Z and O arrays, to obtain their steering vector.

A sound signal is first windowed using a rectangular window, then each resulting segment signal is created as a frame. 4 parallel frames are detected from XYZO array and used for DOA estimation. The 4 frames are split into small blocks with equal size, then the Hamming window and FFT are used to convert each block from a time domain to a frequency domain. Then the output of this system is represented by a horizontal angle and a vertical angle of the sound sources which is found by the peak in the combined 3D spatial spectrum.

The advantages of this array, compared with past microphone array, are that this device has a high performance even if the aperture is small, and it can localize multiple [[Physics:Low frequency|low frequency]] and [[Physics:High frequency|high frequency]] wide band sound sources simultaneously. Applying an O array can make more available acoustic information, such as amplitude and time difference. Most importantly, XYZO array has a better performance with a tiny size.

The AVS is one kind of collocated multiple microphone array, it makes use of a multiple microphone array approach for estimating the sound directions by multiple arrays and then finds the locations by using reflection information such as where the direction is detected where different arrays cross.

====Motivation of the Advanced Microphone array====
Sound reflections always occur in an actual environment and microphone arrays<ref>{{cite book|last1=Ishi|first1=C.T.|last2=Even|first2=J.|last3=Hagita|first3=N.|title=2013 IEEE/RSJ International Conference on Intelligent Robots and Systems |chapter=Using multiple microphone arrays and reflections for 3D localization of sound sources |date=November 2013|pages=3937–42|doi=10.1109/IROS.2013.6696919|isbn=978-1-4673-6358-7|s2cid=16043629}}</ref> cannot avoid observing those reflections. This multiple array approach was tested using fixed arrays in the ceiling; the performance of the moving scenario still need to be tested.

====Learning how to apply Multiple Microphone Array====
Angle uncertainty (AU) will occur when estimating direction, and position uncertainty (PU) will also aggravate with increasing distance between the array and the source.
We know that:
:<math>PU \left(r \right)= \frac{\pm AU}{360 } \times 2 \pi \times r</math>
Where r is the distance between array center to source, and AU is angle uncertainly.
Measurement is used for judging whether two directions cross at some location or not.
Minimum distance between two lines:
:<math>dist \left(dir_1,dir_2 \right)=\frac{ \left( \overrightarrow{v_1} \times \overrightarrow{v_2} \right) \times \overrightarrow{p_1 p_2}}{ \left| \overrightarrow{v_1} \times \overrightarrow{v_2} \right|}</math>
where <math>dir_1</math> and <math>dir_2</math> are two directions, <math>v_i </math> are vectors parallel to detected direction, and <math>p_i </math> are the position of arrays.

If
:<math>dist(dir_1,dir_2)<abs(PU_1(r_1))+abs(PU_2(r_2))</math>
Two lines are judged as crossing.
When two lines are crossing, we can compute the sound source location using the following:
:<math>\mathrm{POS}_{source} = \frac {\left( \mathrm{POS}_1 \times w_1 + \mathrm{POS}_2 \times w_2 \right)}{w_1 + w_2 } </math>
<math>\mathrm{POS}_{source} </math> is the estimation of sound source position, <math>\mathrm{POS}_n</math> is the position where each direction intersect the line with minimum distance, and <math>w_n</math> is the weighted factors. As the weighting factor <math>w_n</math>, we determined use <math>PU</math> or <math>r</math> from the array to the line with minimum distance.

===Scanning Techniques===
[[file:3D sound localization of a large compressor.png|thumb|3D sound localization of a large compressor<ref>{{cite web|title=Reducing noise emissions from Lontra's LP2 compressor|url=https://www.microflown.com/case-studies/reducing-noise-emissions-from-lontras-lp2-compressor}}</ref>]]
Scan-based techniques are a powerful tool for localizing and visualizing time-stationary sound sources, as they only require the use of a single sensor and a position tracking system. One popular method for achieving this is through the use of an Acoustic Vector Sensor (AVS), also known as a 3D Sound Intensity Probe, in combination with a 3D tracker.

The measurement procedure involves manually moving the AVS sensor around the sound source while a stereo camera is used to extract the instantaneous position of the sensor in three-dimensional space. The recorded signals are then split into multiple segments and assigned to a set of positions using a spatial discretization algorithm. This allows for the computation of a vector representation of the acoustic variations across the sound field, using combinations of the sound pressure and the three orthogonal acoustic particle velocities.

The results of the AVS analysis can be presented over a 3D sketch of the tested object, providing a visual representation of the sound distribution around a 3D mesh of the object or environment. This can be useful for localizing sound sources in a variety of fields, such as architectural acoustics, noise control, and audio engineering, as it allows for a detailed understanding of the sound distribution and its interactions with the surrounding environment. 

===Learning method for binaural hearing===
[[File:Binaural robot head2.png|thumb|upright|Structure of the binaural robot dummy head]]

Binaural hearing learning<ref name="binaural" /> is a [[Software:Bionic|bionic]] method. The sensor is a robot dummy head with 2 sensor microphones along with the artificial pinna (reflector). The robot head has 2 rotation axes and can rotate horizontally and vertically. The reflector causes the spectrum change into a certain pattern for incoming white noise sound wave and this pattern is used for the cue of the vertical localization. The cue for horizontal localization is ITD. The system makes use of a learning process using [[Neural networks|neural networks]] by rotating the head with a settled white noise sound source and analyzing the spectrum. Experiments show that the system can identify the direction of the source well in a certain range of angle of arrival. It cannot identify the sound coming outside the range due to the collapsed spectrum pattern of the reflector. Binaural hearing use only 2 microphones and is capable of concentrating on one source among multiple sources of noises.

===Head-related Transfer Function (HRTF)===
In the real sound localization, the robot head and the torso play a functional role, in addition to the two pinnae. This functions as spatial linear filtering and the filtering is always quantified in terms of Head-Related Transfer Function (HRTF).<ref>{{cite book|doi=10.1109/ISSPIT.2006.270883|chapter-url=https://zenodo.org/record/889300|chapter=An Enhanced Binaural 3D Sound Localization Algorithm|title=2006 IEEE International Symposium on Signal Processing and Information Technology|pages=662–665|year=2006|last1=Keyrouz|first1=Fakheredine|last2=Diepold|first2=Klaus|isbn=0-7803-9754-1|s2cid=14042947}}</ref> HRTF also uses the robot head sensor, which is the binaural hearing model. The HRTF can be derived based on various cues for localization. Sound localization with HRTF is filtering the input signal with a filter which is designed based on the HRTF. Instead of using the neural networks, a head-related transfer function is used and the localization is based on a simple correlation approach.

See more: [[Physics:Head-related transfer function|Head-related transfer function]].

===Cross-power spectrum phase (CSP) analysis===
CSP method<ref>{{cite conference|author1=Hyun-Don Kim |author2=Komatani, K. |author3=Ogata, T. |author4=Okuno,H.G. |title=Evaluation of Two-Channel-Based Sound Source Localization using 3D Moving Sound Creation Tool|conference=ICERI 2008|date=Jan 2008|doi=10.1109/ICKS.2008.25}}</ref> is also used for the binaural model. The idea is that the angle of arrival can be derived through the time delay of arrival (TDOA) between two microphones, and TDOA can be estimated by finding the maximum coefficients of CSP. CSP coefficients are derived by:<br />
:<math>csp_{ij}(k)=\text{IFFT}\left \{ \frac{\text{FFT}[s_{i}(n)]\cdot \text{FFT}[s_{j}(n)]^*} {\left |\text{FFT}[s_{i}(n)]\right \vert \cdot \left |\text{FFT}[s_{j}(n)]\right \vert \quad} \right \} \quad
</math>
Where <math>s_{i}(n)</math> and <math>s_{j}(n)</math> are signals entering the microphone <math>i</math> and <math>j</math> respectively<br />
Time delay of arrival(<math>\tau</math>) then can be estimated by:<br />
:<math>{\tau}= \operatorname{arg} \max\{csp_{ij}(k)\}
</math>
Sound source direction is
:<math>{\theta}=\cos^{-1}\frac{v\cdot \tau}{d_{\max}\cdot F_{s}}
</math>
Where <math>v</math> is the sound propagation speed, <math>F_{s}</math> is the sampling frequency and <math>d_{max}</math> is the distance with maximum time delay between 2 microphones.

CPS method does not require the system impulse response data that HRTF needs. An expectation-maximization algorithm is also used for localizing several sound sources and reduce the localization errors. The system is capable of identifying several moving sound source using only two microphones.

===2D sensor line array===
[[File:2D array demo3.png|thumb|upright|Demonstration of 2d line sensor array]]
In order to estimate the location of a source in 3D space, two line sensor arrays can be placed horizontally and vertically. An example is a 2D line array used for underwater source localization.<ref>{{cite journal |author=Tabrikian,J. |author2=Messer,H. |date=Jan 1996 |title=Three-Dimensional Source Localization in a Waveguide |journal=IEEE Transactions on Signal Processing |volume=44 |issue=1 |pages=1–13 |bibcode=1996ITSP...44....1T |doi=10.1109/78.482007}}</ref> By processing the data from two arrays using the maximum likelihood method, the direction, range and depth of the source can be identified simultaneously. Unlike the binaural hearing model, this method is similar to the [[Spectrum#Spectrogram|spectral analysis]] method. The method can be used to localize a distant source.

===Self-rotating Bi-Microphone Array===
The rotation of the two-microphone array (also referred as bi-microphone array <ref>{{cite journal|author1=Gala, Deepak |author2=Lindsay, Nathan |author3=Sun, Liang |title=Realtime Active Sound Source Localization for Unmanned Ground Robots Using a Self-Rotational Bi-Microphone Array | journal=Journal of Intelligent & Robotic Systems |volume=95 |issue=3 |pages=935–954 |date=July 2018 |doi=10.1007/s10846-018-0908-3|arxiv=1804.03372 |s2cid=4745823 }}</ref>) leads to a sinusoidal inter-channel time difference (ICTD) signal for a stationary sound source present in a 3D environment. The phase shift of the resulting sinusoidal signal can be directly mapped to the azimuth angle of the sound source, and the amplitude of the ICTD signal can be represented as a function of the elevation angle of the sound source and the distance between the two microphones.<ref>{{cite conference|author1=Gala, Deepak |author2=Lindsay, Nathan |author3=Sun, Liang |title=Three-dimensional sound source localization for unmanned ground vehicles with a self-rotational two-microphone array | conference=CDSR 2018 | date=June 2018|doi=10.11159/cdsr18.104|doi-access=free }}</ref> In the case of multiple sources, the ICTD signal has data points forming multiple discontinuous sinusoidal waveforms. Machine learning techniques such as Random sample consensus (RANSAC) and Density-based spatial clustering of applications with noise (DBSCAN) can be applied to identify phase shifts (mapping to azimuths) and amplitudes (mapping to elevations) of each discontinuous sinusoidal waveform in the ICTD signal.<ref>{{cite conference|author1=Gala, Deepak |author2=Lindsay, Nathan |author3=Sun, Liang |title=Multi-Sound-Source Localization Using Machine Learning for Small Autonomous Unmanned Vehicles with a Self-Rotating Bi-Microphone Array | journal=Journal of Intelligent & Robotic Systems |date=Oct 2021 |volume=103 |issue=3 |doi=10.1007/s10846-021-01481-4|arxiv=1804.05111 }}</ref>

===Hierarchical Fuzzy Artificial Neural Networks Approach===
[[File:Azimuth Estimation.png|thumb|right|300px|Structure of How to derive the Azimuth Estimation]]
The Hierarchical Fuzzy Artificial Neural Networks Approach sound localization system was modeled on biologically binaural sound localization. Some primitive animals with two ears and small brains can perceive 3D space and process sounds, although the process is not fully understood. Some animals experience difficulty in 3D sound location due to small head size. Additionally, the wavelength of communication sound may be much larger than their head diameter, as is the case with frogs.

Based on previous binaural sound localization methods, a hierarchical fuzzy artificial neural network system combines [[Engineering:Interaural time difference|interaural time difference]](ITD-based) and interaural intensity difference(IID-based) sound localization methods for higher accuracy that is similar to that of humans. Hierarchical Fuzzy Artificial Neural Networks<ref>{{cite journal|last1=Keyrouz|first1=Fakheredine|last2=Diepold|first2=Klaus|title=A novel biologically inspired neural network solution for robotic 3D sound source sensing|journal=Soft Computing|date=May 2008|volume=12|issue=7|pages=721–9|doi=10.1007/s00500-007-0249-9|s2cid=30037380|issn=1432-7643}}</ref>  were used with the goal of the same sound localization accuracy as human ears.

IID-based or ITD-based sound localization methods have a main problem called Front-back confusion.<ref>{{cite journal|last1=Hill|first1=P.A.|last2=Nelson|first2=P.A.|last3=Kirkeby|first3=O.|last4=Hamada|first4=H.|title=Resolution of front-back confusion in virtual acoustic imaging systems|journal=Journal of the Acoustical Society of America|date=December 2000|volume=108|issue=6|pages=2901–10|doi=10.1121/1.1323235|pmid=11144583|issn=0001-4966|bibcode=2000ASAJ..108.2901H}}</ref> In this sound localization based on a hierarchical neural network system, to solve this issue, an IID estimation is with ITD estimation. This system was used for broadband sounds and be deployed for non-stationary scenarios.

==3D sound localization for monaural sound source==
Typically, sound localization is performed by using two (or more) microphones. By using the difference of arrival times of a sound at the two microphones, one can mathematically estimate the direction of the sound source. However, the accuracy with which an array of microphones can localize a sound (using [[Engineering:Interaural time difference|Interaural time difference]]) is fundamentally limited by the physical size of the array. If the array is too small, then the microphones are spaced too closely together so that they all record essentially the same sound (with ITF near zero), making it extremely difficult to estimate the orientation. Thus, it is not uncommon for microphone arrays to range from tens of centimeters in length (for desktop applications) to many tens of meters in length (for underwater localization). However, microphone arrays of this size then become impractical to use on small robots. even for large robots, such microphone arrays can be cumbersome to mount and to maneuver. In contrast, the ability to localize sound using a single microphone (which can be made extremely small) holds the potential of significantly more compact, as well as lower cost and power, devices for localization.

=== Conventional HRTF approach === 
A general way to implement 3d sound localization is to use the [[Physics:Head-related transfer function|head-related transfer function]] (HRTF). First, compute HRTFs for the 3D sound localization, by formulating two equations; one represents the signal of a given sound source and the other indicates the signal output from the robot head microphones for the sound transferred from the source. Monaural input data are processed by these HRTFs, and the results are output from stereo headphones. The disadvantage of this method is that many parametric operations are necessary for the whole set of filters to realize the 3D sound localization, resulting in high computational complexity.

=== DSP implementation of 3D sound localization === 
[[File:DSP implementation of 3D sound localization.png|thumb|dsp implementation of 3d sound localization]]
A DSP-based implementation of a realtime 3D sound localization approach with the use of an embedded DSP can reduce the [[Analysis of algorithms|computational complexity]] As shown in the figure, the implementation procedure of this realtime algorithm is divided into three phases, (i) Frequency Division, (ii) Sound Localization, and (iii) Mixing. In the case of 3D sound localization for a monaural sound source, the audio input data are divided into two: left and right channels and the audio input data in time series are processed one after another.<ref>{{cite book|last1=Noriaki|first1=Sakamoto|last2=wataru|first2=Kobayashi|last3=Takao|first3=Onoye|last4=Isao|first4=Shirakawa|title=ICECS 2001. 8th IEEE International Conference on Electronics, Circuits and Systems (Cat. No.01EX483) |chapter=DSP implementation of 3D sound localization algorithm for monaural sound source |volume=2|date=2001|pages=1061–1064 |isbn=978-0-7803-7057-9|doi=10.1109/ICECS.2001.957673|s2cid=60528168}}</ref>

A distinctive feature of this approach is that the audible frequency band is divided into three so that a distinct procedure of 3D sound localization can be exploited for each of the three subbands.

=== Single microphone approach ===
Monaural localization is made possible by the structure of the pinna (outer ear), which modifies the sound in a way that is dependent on its incident angle. A machine learning approach is adapted for monaural localization using only a single microphone and an “artificial pinna” (that distorts sound in a direction-dependent way). The approach models the typical distribution of natural and artificial sounds, as well as the direction-dependent changes to sounds induced by the pinna.<ref>{{Cite book |doi = 10.1109/ROBOT.2009.5152861|chapter = Learning sound location from a single microphone|title = 2009 IEEE International Conference on Robotics and Automation|pages = 1737–1742|year = 2009|last1 = Saxena|first1 = A.|last2 = Ng|first2 = A.Y.|isbn = 978-1-4244-2788-8|s2cid = 14665341}}</ref> The experimental results also show that the algorithm is able to fairly accurately localize a wide range of sounds, such as human speech, dog barking, waterfall, thunder, and so on. In contrast to microphone arrays, this approach also offers the potential of significantly more compact, as well as lower cost and power, devices for sound localization.

==See also==
* [[3D sound reconstruction|3D sound reconstruction]]
* Acoustic source localization
* [[Engineering:Binaural recording|Binaural recording]]
* [[Physics:Head-related transfer function|Head-related transfer function]]
* [[Perceptual-based 3D sound localization]]
* [[Physics:Sound localization|Sound localization]]
* Vertical sound localization

==References==
{{reflist}}

==External links==
* [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2885955/ 3-D Localization of Virtual Sound Sources]
* [https://www.microflown.com/products/standard-probes/usp-regular 3-D Acoustic Vector Sensor (air)]
{{Computer audition}}

[[Category:Acoustics]]

{{Sourceattribution|3D sound localization}}