Overlap–add method

This article is about the convolution method. For the "Weight, OverLap, Add" channelization method, see Sampling the DTFT.

In signal processing, the overlap–add method is an efficient way to evaluate the discrete convolution of a very long signal ${\displaystyle x[n]}$ with a finite impulse response (FIR) filter ${\displaystyle h[n]}$:

${\displaystyle y[n]=x[n]*h[n]\ \triangleq \ \sum _{m=-\infty }^{\infty }h[m]\cdot x[n-m]=\sum _{m=1}^{M}h[m]\cdot x[n-m],}$

Eq.1

where ${\displaystyle h[m]=0}$ for ${\displaystyle m}$ outside the region ${\displaystyle [1,M].}$  This article uses common abstract notations, such as ${\textstyle y(t)=x(t)*h(t),}$ or ${\textstyle y(t)={\mathcal {H}}\{x(t)\},}$ in which it is understood that the functions should be thought of in their totality, rather than at specific instants ${\textstyle t}$ (see Convolution#Notation).

Fig 1: A sequence of five plots depicts one cycle of the overlap-add convolution algorithm. The first plot is a long sequence of data to be processed with a lowpass FIR filter. The 2nd plot is one segment of the data to be processed in piecewise fashion. The 3rd plot is the filtered segment, including the filter rise and fall transients. The 4th plot indicates where the new data will be added with the result of previous segments. The 5th plot is the updated output stream. The FIR filter is a boxcar lowpass with ${\displaystyle M=16}$ samples, the length of the segments is ${\displaystyle L=100}$ samples and the overlap is 15 samples.

The concept is to divide the problem into multiple convolutions of ${\displaystyle h[n]}$ with short segments of ${\displaystyle x[n]}$:

${\displaystyle x_{k}[n]\ \triangleq \ {\begin{cases}x[n+kL],&n=1,2,\ldots ,L\\0,&{\text{otherwise}},\end{cases}}}$

where ${\displaystyle L}$ is an arbitrary segment length. Then:

${\displaystyle x[n]=\sum _{k}x_{k}[n-kL],\,}$

and ${\displaystyle y[n]}$ can be written as a sum of short convolutions:^[1]

${\displaystyle {\begin{aligned}y[n]=\left(\sum _{k}x_{k}[n-kL]\right)*h[n]&=\sum _{k}\left(x_{k}[n-kL]*h[n]\right)\\&=\sum _{k}y_{k}[n-kL],\end{aligned}}}$

where the linear convolution ${\displaystyle y_{k}[n]\ \triangleq \ x_{k}[n]*h[n]\,}$ is zero outside the region ${\displaystyle [1,L+M-1].}$ And for any parameter ${\displaystyle N\geq L+M-1,\,}$^[A] it is equivalent to the ${\displaystyle N}$-point circular convolution of ${\displaystyle x_{k}[n]\,}$ with ${\displaystyle h[n]\,}$ in the region ${\displaystyle [1,N].}$  The advantage is that the circular convolution can be computed more efficiently than linear convolution, according to the circular convolution theorem:

${\displaystyle y_{k}[n]\ =\ \scriptstyle {\text{IDFT}}_{N}\displaystyle (\ \scriptstyle {\text{DFT}}_{N}\displaystyle (x_{k}[n])\cdot \ \scriptstyle {\text{DFT}}_{N}\displaystyle (h[n])\ ),}$

Eq.2

where:

• DFT_N and IDFT_N refer to the Discrete Fourier transform and its inverse, evaluated over ${\displaystyle N}$ discrete points, and
• ${\displaystyle L}$ is customarily chosen such that ${\displaystyle N=L+M-1}$ is an integer power-of-2, and the transforms are implemented with the FFT algorithm, for efficiency.

Pseudocode

The following is a pseudocode of the algorithm:

(Overlap-add algorithm for linear convolution)
h = FIR_filter
M = length(h)
Nx = length(x)
N = 8 × 2^ceiling( log2(M) )     (8 times the smallest power of two bigger than filter length M.  See next section for a slightly better choice.)
step_size = N - (M-1)  (L in the text above)
H = DFT(h, N)
position = 0
y(1 : Nx + M-1) = 0

while position + step_size ≤ Nx do
    y(position+(1:N)) = y(position+(1:N)) + IDFT(DFT(x(position+(1:step_size)), N) × H)
    position = position + step_size
end

Efficiency considerations

Fig 2: A graph of the values of N (an integer power of 2) that minimize the cost function ${\displaystyle {\tfrac {N\left(\log _{2}N+1\right)}{N-M+1}}}$

When the DFT and IDFT are implemented by the FFT algorithm, the pseudocode above requires about N (log₂(N) + 1) complex multiplications for the FFT, product of arrays, and IFFT.^[B] Each iteration produces N-M+1 output samples, so the number of complex multiplications per output sample is about:

${\displaystyle {\frac {N(\log _{2}(N)+1)}{N-M+1}}.\,}$

Eq.3

For example, when ${\displaystyle M=201}$ and ${\displaystyle N=1024,}$ Eq.3 equals ${\displaystyle 13.67,}$ whereas direct evaluation of Eq.1 would require up to ${\displaystyle 201}$ complex multiplications per output sample, the worst case being when both ${\displaystyle x}$ and ${\displaystyle h}$ are complex-valued. Also note that for any given ${\displaystyle M,}$ Eq.3 has a minimum with respect to ${\displaystyle N.}$ Figure 2 is a graph of the values of ${\displaystyle N}$ that minimize Eq.3 for a range of filter lengths (${\displaystyle M}$).

Instead of Eq.1, we can also consider applying Eq.2 to a long sequence of length ${\displaystyle N_{x}}$ samples. The total number of complex multiplications would be:

${\displaystyle N_{x}\cdot (\log _{2}(N_{x})+1).}$

Comparatively, the number of complex multiplications required by the pseudocode algorithm is:

${\displaystyle N_{x}\cdot (\log _{2}(N)+1)\cdot {\frac {N}{N-M+1}}.}$

Hence the cost of the overlap–add method scales almost as ${\displaystyle O\left(N_{x}\log _{2}N\right)}$ while the cost of a single, large circular convolution is almost ${\displaystyle O\left(N_{x}\log _{2}N_{x}\right)}$. The two methods are also compared in Figure 3, created by Matlab simulation. The contours are lines of constant ratio of the times it takes to perform both methods. When the overlap-add method is faster, the ratio exceeds 1, and ratios as high as 3 are seen.

Fig 3: Gain of the overlap-add method compared to a single, large circular convolution. The axes show values of signal length N_x and filter length N_h.

See also

• Overlap–save method
• Circular_convolution#Example

Notes

1. This condition implies that the ${\displaystyle x_{k}}$ segment has at least ${\displaystyle M-1}$ appended zeros, which prevents circular overlap of the output rise and fall transients.
2. Cooley–Tukey FFT algorithm for N=2^k needs (N/2) log₂(N) – see FFT – Definition and speed

References

1. Rabiner, Lawrence R.; Gold, Bernard (1975). "2.25". Theory and application of digital signal processing. Englewood Cliffs, N.J.: Prentice-Hall. pp. 63–65. ISBN 0-13-914101-4.

Further reading

• Oppenheim, Alan V.; Schafer, Ronald W. (1975). Digital signal processing. Englewood Cliffs, N.J.: Prentice-Hall. ISBN 0-13-214635-5.
• Hayes, M. Horace (1999). Digital Signal Processing. Schaum's Outline Series. New York: McGraw Hill. ISBN 0-07-027389-8.
• Senobari, Nader Shakibay; Funning, Gareth J.; Keogh, Eamonn; Zhu, Yan; Yeh, Chin-Chia Michael; Zimmerman, Zachary; Mueen, Abdullah (2019). "Super-Efficient Cross-Correlation (SEC-C): A Fast Matched Filtering Code Suitable for Desktop Computers" (PDF). Seismological Research Letters. 90 (1): 322–334. doi:10.1785/0220180122. ISSN 0895-0695.