Bilinear time–frequency distribution

Bilinear time–frequency distributions, or quadratic time–frequency distributions, arise in a sub-field of signal analysis and signal processing called time–frequency signal processing, and, in the statistical analysis of time series data. Such methods are used where one needs to deal with a situation where the frequency composition of a signal may be changing over time;^[1] this sub-field used to be called time–frequency signal analysis, and is now more often called time–frequency signal processing due to the progress in using these methods to a wide range of signal-processing problems.

Background

Methods for analysing time series, in both signal analysis and time series analysis, have been developed as essentially separate methodologies applicable to, and based in, either the time or the frequency domain. A mixed approach is required in time–frequency analysis techniques which are especially effective in analyzing non-stationary signals, whose frequency distribution and magnitude vary with time. Examples of these are acoustic signals. Classes of "quadratic time-frequency distributions" (or bilinear time–frequency distributions") are used for time–frequency signal analysis. This class is similar in formulation to Cohen's class distribution function that was used in 1966 in the context of quantum mechanics. This distribution function is mathematically similar to a generalized time–frequency representation which utilizes bilinear transformations. Compared with other time–frequency analysis techniques, such as short-time Fourier transform (STFT), the bilinear-transformation (or quadratic time–frequency distributions) may not have higher clarity for most practical signals, but it provides an alternative framework to investigate new definitions and new methods. While it does suffer from an inherent cross-term contamination when analyzing multi-component signals, by using a carefully chosen window function(s), the interference can be significantly mitigated, at the expense of resolution. All these bilinear distributions are inter-convertible to each other, cf. transformation between distributions in time–frequency analysis.

Wigner–Ville distribution

Main article: Wigner distribution function

The Wigner–Ville distribution is a quadratic form that measures a local time-frequency energy given by:

${\displaystyle P_{V}f(u,\xi )=\int _{-\infty }^{\infty }f\left(u+{\tfrac {\tau }{2}}\right)f^{*}\left(u-{\tfrac {\tau }{2}}\right)e^{-i\tau \xi }\,d\tau }$

The Wigner–Ville distribution remains real as it is the fourier transform of f(u + τ/2)·f*(u − τ/2), which has Hermitian symmetry in τ. It can also be written as a frequency integration by applying the Parseval formula:

${\displaystyle P_{V}f(u,\xi )={\frac {1}{2\pi }}\int _{-\infty }^{\infty }{\hat {f}}\left(\xi +{\tfrac {\gamma }{2}}\right){\hat {f}}^{*}\left(\xi -{\tfrac {\gamma }{2}}\right)e^{i\gamma u}\,d\gamma }$

Proposition 1. for any f in L²(R)

${\displaystyle \int _{-\infty }^{\infty }P_{V}f(u,\xi )\,du=|{\hat {f}}(\xi )|^{2}}$

${\displaystyle \int _{-\infty }^{\infty }P_{V}f(u,\xi )\,d\xi =2\pi |f(u)|^{2}}$

Moyal Theorem. For f and g in L²(R),

${\displaystyle 2\pi \left|\int _{-\infty }^{\infty }f(t)g^{*}(t)\,dt\right|^{2}=\iint {P_{V}f(u,\xi )}P_{V}g(u,\xi )\,du\,d\xi }$

Proposition 2 (time-frequency support). If f has a compact support, then for all ξ the support of ${\displaystyle P_{V}f(u,\xi )}$ along u is equal to the support of f. Similarly, if ${\displaystyle {\hat {f}}}$ has a compact support, then for all u the support of ${\displaystyle P_{V}f(u,\xi )}$ along ξ is equal to the support of ${\displaystyle {\hat {f}}}$.

Proposition 3 (instantaneous frequency). If ${\displaystyle f_{a}(t)=a(t)e^{i\phi (t)}}$ then

${\displaystyle \phi '(u)={\frac {\int _{-\infty }^{\infty }\xi P_{V}f_{a}(u,\xi )d\xi }{\int _{-\infty }^{\infty }P_{V}f_{a}(u,\xi )d\xi }}}$

Interference

Let ${\displaystyle f=f_{1}+f_{2}}$ be a composite signal. We can then write,

${\displaystyle P_{V}f=P_{V}f_{1}+P_{V}f_{2}+P_{V}\left[f_{1},f_{2}\right]+P_{V}\left[f_{2},f_{1}\right]}$

where

${\displaystyle P_{V}[h,g](u,\xi )=\int _{-\infty }^{\infty }h\left(u+{\tfrac {\tau }{2}}\right)g^{*}\left(u-{\tfrac {\tau }{2}}\right)e^{-i\tau \xi }d\tau }$

is the cross Wigner–Ville distribution of two signals. The interference term

${\displaystyle I[f_{1},f_{2}]=P_{V}[f_{1},f_{2}]+P_{V}[f_{2},f_{1}]}$

is a real function that creates non-zero values at unexpected locations (close to the origin) in the ${\displaystyle (u,\xi )}$ plane. Interference terms present in a real signal can be avoided by computing the analytic part ${\displaystyle f_{a}(t)}$.

Positivity and smoothing kernel

The interference terms are oscillatory since the marginal integrals vanish and can be partially removed by smoothing ${\displaystyle P_{V}f}$ with a kernel θ

${\displaystyle P_{\theta }f(u,\xi )=\int _{-\infty }^{\infty }{\int _{-\infty }^{\infty }{P_{V}f(u',\xi ')}}\theta (u,u',\xi ,\xi ')\,du'\,d\xi '}$

The time-frequency resolution of this distribution depends on the spread of kernel θ in the neighborhood of ${\displaystyle (u,\xi )}$. Since the interferences take negative values, one can guarantee that all interferences are removed by imposing that

${\displaystyle P_{\theta }f(u,\xi )\geq 0,\qquad \forall (u,\xi )\in {{\mathbf {R} }^{2}}}$

The spectrogram and scalogram are examples of positive time-frequency energy distributions. Let a linear transform ${\displaystyle Tf(\gamma )=\left\langle f,\phi _{\gamma }\right\rangle }$ be defined over a family of time-frequency atoms ${\displaystyle \left\{\phi _{\gamma }\right\}_{\gamma \in \Gamma }}$. For any ${\displaystyle (u,\xi )}$ there exists a unique atom ${\displaystyle \phi _{\gamma (u,\xi )}}$ centered in time-frequency at ${\displaystyle (u,\xi )}$. The resulting time-frequency energy density is

${\displaystyle P_{T}f(u,\xi )=\left|\left\langle f,\phi _{\gamma (u,\xi )}\right\rangle \right|^{2}}$

From the Moyal formula,

${\displaystyle P_{T}f(u,\xi )={\frac {1}{2\pi }}\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }P_{V}f(u',\xi ')P_{V}\phi _{\gamma (u,\xi )}(u',\xi ')\,du'\,d\xi '}$

which is the time frequency averaging of a Wigner–Ville distribution. The smoothing kernel thus can be written as

${\displaystyle \theta (u,u',\xi ,\xi ')={\frac {1}{2\pi }}P_{V}\phi _{\gamma (u,\xi )}(u',\xi ')}$

The loss of time-frequency resolution depends on the spread of the distribution ${\displaystyle P_{V}\phi _{\gamma (u,\xi )}(u',\xi ')}$ in the neighborhood of ${\displaystyle (u,\xi )}$.

Example 1

A spectrogram computed with windowed fourier atoms,

${\displaystyle \phi _{\gamma (u,\xi )}(t)=g(t-u)e^{i\xi t}}$

${\displaystyle \theta (u,u',\xi ,\xi ')={\frac {1}{2\pi }}P_{V}\phi _{\gamma (u,\xi )}(u',\xi ')={\frac {1}{2\pi }}P_{V}g(u'-u,\xi '-\xi )}$

For a spectrogram, the Wigner–Ville averaging is therefore a 2-dimensional convolution with ${\displaystyle P_{V}g}$. If g is a Gaussian window,${\displaystyle P_{V}g}$ is a 2-dimensional Gaussian. This proves that averaging ${\displaystyle P_{V}f}$ with a sufficiently wide Gaussian defines positive energy density. The general class of time-frequency distributions obtained by convolving ${\displaystyle P_{V}f}$ with an arbitrary kernel θ is called a Cohen's class, discussed below.

Wigner Theorem. There is no positive quadratic energy distribution Pf that satisfies the following time and frequency marginal integrals:

${\displaystyle \int _{-\infty }^{\infty }Pf(u,\xi )\,d\xi =2\pi |f(u)|^{2}}$

${\displaystyle \int _{-\infty }^{\infty }Pf(u,\xi )\,du=|{\hat {f}}(\xi )|^{2}}$

Mathematical definition

The definition of Cohen's class of bilinear (or quadratic) time–frequency distributions is as follows:

${\displaystyle C_{x}(t,f)=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }A_{x}(\eta ,\tau )\Phi (\eta ,\tau )\exp(j2\pi (\eta t-\tau f))\,d\eta \,d\tau ,}$

where ${\displaystyle A_{x}(\eta ,\tau )}$ is the ambiguity function (AF), which will be discussed later; and ${\displaystyle \Phi (\eta ,\tau )}$ is Cohen's kernel function, which is often a low-pass function, and normally serves to mask out the interference. In the original Wigner representation, ${\displaystyle \Phi \equiv 1}$.

An equivalent definition relies on a convolution of the Wigner distribution function (WD) instead of the AF :

${\displaystyle C_{x}(t,f)=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }W_{x}(\theta ,\nu )\Pi (t-\theta ,f-\nu )\,d\theta \,d\nu =[W_{x}\ast \Pi ](t,f)}$

where the kernel function ${\displaystyle \Pi (t,f)}$ is defined in the time-frequency domain instead of the ambiguity one. In the original Wigner representation, ${\displaystyle \Pi =\delta _{(0,0)}}$. The relationship between the two kernels is the same as the one between the WD and the AF, namely two successive Fourier transforms (cf. diagram).

${\displaystyle \Phi ={\mathcal {F}}_{t}{\mathcal {F}}_{f}^{-1}\Pi }$

i.e.

${\displaystyle \Phi (\eta ,\tau )=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\Pi (t,f)\exp(-j2\pi (t\eta -f\tau ))\,dt\,df,}$

or equivalently

${\displaystyle \Pi (t,f)=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\Phi (\eta ,\tau )\exp(j2\pi (\eta t-\tau f))\,d\eta \,d\tau .}$

Ambiguity function

Main article: Ambiguity function

The class of bilinear (or quadratic) time–frequency distributions can be most easily understood in terms of the ambiguity function, an explanation of which follows.

Consider the well known power spectral density ${\displaystyle P_{x}(f)}$ and the signal auto-correlation function ${\displaystyle R_{x}(\tau )}$ in the case of a stationary process. The relationship between these functions is as follows:

${\displaystyle P_{x}(f)=\int _{-\infty }^{\infty }R_{x}(\tau )e^{-j2\pi f\tau }\,d\tau ,}$

${\displaystyle R_{x}(\tau )=\int _{-\infty }^{\infty }x\left(t+{\tfrac {\tau }{2}}\right)x^{*}\left(t-{\tfrac {\tau }{2}}\right)\,dt.}$

For a non-stationary signal ${\displaystyle x(t)}$, these relations can be generalized using a time-dependent power spectral density or equivalently the famous Wigner distribution function of ${\displaystyle x(t)}$ as follows:

${\displaystyle W_{x}(t,f)=\int _{-\infty }^{\infty }R_{x}(t,\tau )e^{-j2\pi f\tau }\,d\tau ,}$

${\displaystyle R_{x}(t,\tau )=x\left(t+{\tfrac {\tau }{2}}\right)x^{*}\left(t-{\tfrac {\tau }{2}}\right).}$

If the Fourier transform of the auto-correlation function is taken with respect to t instead of τ, we get the ambiguity function as follows:

${\displaystyle A_{x}(\eta ,\tau )=\int _{-\infty }^{\infty }x\left(t+{\tfrac {\tau }{2}}\right)x^{*}\left(t-{\tfrac {\tau }{2}}\right)e^{j2\pi t\eta }\,dt.}$

The relationship between the Wigner distribution function, the auto-correlation function and the ambiguity function can then be illustrated by the following figure.

By comparing the definition of bilinear (or quadratic) time–frequency distributions with that of the Wigner distribution function, it is easily found that the latter is a special case of the former with ${\displaystyle \Phi (\eta ,\tau )=1}$. Alternatively, bilinear (or quadratic) time–frequency distributions can be regarded as a masked version of the Wigner distribution function if a kernel function ${\displaystyle \Phi (\eta ,\tau )\neq 1}$ is chosen. A properly chosen kernel function can significantly reduce the undesirable cross-term of the Wigner distribution function.

What is the benefit of the additional kernel function? The following figure shows the distribution of the auto-term and the cross-term of a multi-component signal in both the ambiguity and the Wigner distribution function.

For multi-component signals in general, the distribution of its auto-term and cross-term within its Wigner distribution function is generally not predictable, and hence the cross-term cannot be removed easily. However, as shown in the figure, for the ambiguity function, the auto-term of the multi-component signal will inherently tend to close the origin in the ητ-plane, and the cross-term will tend to be away from the origin. With this property, the cross-term in can be filtered out effortlessly if a proper low-pass kernel function is applied in ητ-domain. The following is an example that demonstrates how the cross-term is filtered out.

Kernel properties

The Fourier transform of ${\displaystyle \theta (u,\xi )}$ is

${\displaystyle {\hat {\theta }}(\tau ,\gamma )=\int _{-\infty }^{\infty }\int _{-\infty }^{\infty }\theta (u,\xi )e^{-i(u\gamma +\xi \tau )}\,du\,d\xi }$

The following proposition gives necessary and sufficient conditions to ensure that ${\displaystyle P_{\theta }}$ satisfies marginal energy properties like those of the Wigner–Ville distribution.

Proposition: The marginal energy properties

${\displaystyle \int _{-\infty }^{\infty }P_{\theta }f(u,\xi )\,d\xi =2\pi |f(u)|^{2},}$

${\displaystyle \int _{-\infty }^{\infty }P_{\theta }f(u,\xi )\,du=|{\hat {f}}(\xi )|^{2}}$

are satisfied for all ${\displaystyle f\in L^{2}(\mathbf {R} )}$ if and only if

${\displaystyle \forall (\tau ,\gamma )\in \mathbf {R} ^{2}:\qquad {\hat {\theta }}(\tau ,0)={\hat {\theta }}(0,\gamma )=1}$

Some time-frequency distributions

Wigner distribution function

Aforementioned, the Wigner distribution function is a member of the class of quadratic time-frequency distributions (QTFDs) with the kernel function ${\displaystyle \Phi (\eta ,\tau )=1}$. The definition of Wigner distribution is as follows:

${\displaystyle W_{x}(t,f)=\int _{-\infty }^{\infty }x\left(t+{\tfrac {\tau }{2}}\right)x^{*}\left(t-{\tfrac {\tau }{2}}\right)e^{-j2\pi f\tau }\,d\tau .}$

Modified Wigner distribution functions

Main article: Modified Wigner distribution function

Affine invariance

We can design time-frequency energy distributions that satisfy the scaling property

${\displaystyle {\frac {1}{\sqrt {s}}}f\left({\tfrac {t}{s}}\right)\longleftrightarrow P_{V}f\left({\tfrac {u}{s}},s\xi \right)}$

as does the Wigner–Ville distribution. If

${\displaystyle g(t)={\frac {1}{\sqrt {s}}}f\left({\tfrac {t}{s}}\right)}$

then

${\displaystyle P_{\theta }g(u,\xi )=P_{\theta }f\left({\tfrac {u}{s}},s\xi \right).}$

This is equivalent to imposing that

${\displaystyle \forall s\in \mathbf {R} ^{+}:\qquad \theta \left(su,{\tfrac {\xi }{s}}\right)=\theta (u,\xi ),}$

and hence

${\displaystyle \theta (u,\xi )=\theta (u\xi ,1)=\beta (u\xi )}$

The Rihaczek and Choi–Williams distributions are examples of affine invariant Cohen's class distributions.

Choi–Williams distribution function

The kernel of Choi–Williams distribution is defined as follows:

${\displaystyle \Phi (\eta ,\tau )=\exp(-\alpha (\eta \tau )^{2}),}$

where α is an adjustable parameter.

Rihaczek distribution function

The kernel of Rihaczek distribution is defined as follows:

${\displaystyle \Phi (\eta ,\tau )=\exp \left(-i2\pi {\frac {\eta \tau }{2}}\right),}$

With this particular kernel a simple calculation proves that

${\displaystyle C_{x}(t,f)=x(t){\hat {x}}^{*}(f)e^{i2\pi tf}}$

Cone-shape distribution function

Main article: Cone-shape distribution function

The kernel of cone-shape distribution function is defined as follows:

${\displaystyle \Phi (\eta ,\tau )={\frac {\sin(\pi \eta \tau )}{\pi \eta \tau }}\exp \left(-2\pi \alpha \tau ^{2}\right),}$

where α is an adjustable parameter. See Transformation between distributions in time-frequency analysis. More such QTFDs and a full list can be found in, e.g., Cohen's text cited.

Spectrum of non-stationary processes

A time-varying spectrum for non-stationary processes is defined from the expected Wigner–Ville distribution. Locally stationary processes appear in many physical systems where random fluctuations are produced by a mechanism that changes slowly in time. Such processes can be approximated locally by a stationary process. Let ${\displaystyle X(t)}$ be a real valued zero-mean process with covariance

${\displaystyle R(t,s)=E[X(t)X(s)]}$

The covariance operator K is defined for any deterministic signal ${\displaystyle f\in L^{2}(\mathbf {R} )}$ by

${\displaystyle Kf(t)=\int _{-\infty }^{\infty }R(t,s)f(s)\,ds}$

For locally stationary processes, the eigenvectors of K are well approximated by the Wigner–Ville spectrum.

Wigner–Ville spectrum

The properties of the covariance ${\displaystyle R(t,s)}$ are studied as a function of ${\displaystyle \tau =t-s}$ and ${\displaystyle u={\frac {t+s}{2}}}$:

${\displaystyle R(t,s)=R\left(u+{\tfrac {\tau }{2}},u-{\tfrac {\tau }{2}}\right)=C(u,\tau )}$

The process is wide-sense stationary if the covariance depends only on ${\displaystyle \tau =t-s}$:

${\displaystyle Kf(t)=\int _{-\infty }^{\infty }C(t-s)f(s)\,ds=C*f(t)}$

The eigenvectors are the complex exponentials ${\displaystyle e^{i\omega t}}$ and the corresponding eigenvalues are given by the power spectrum

${\displaystyle P_{X}(\omega )=\int _{-\infty }^{\infty }C(\tau )e^{-i\omega \tau }\,d\tau }$

For non-stationary processes, Martin and Flandrin have introduced a time-varying spectrum

${\displaystyle P_{X}(u,\xi )=\int _{-\infty }^{\infty }C(u,\tau )e^{-i\xi \tau }\,d\tau =\int _{-\infty }^{\infty }E\left[X\left(u+{\tfrac {\tau }{2}}\right)X\left(u-{\tfrac {\tau }{2}}\right)\right]e^{-i\xi \tau }\,d\tau }$

To avoid convergence issues we suppose that X has compact support so that ${\displaystyle C(u,\tau )}$ has compact support in ${\displaystyle \tau }$. From above we can write

${\displaystyle P_{X}(u,\xi )=E[P_{V}X(u,\xi )]}$

which proves that the time varying spectrum is the expected value of the Wigner–Ville transform of the process X. Here, the Wigner–Ville stochastic integral is interpreted as a mean-square integral:^[2]

${\displaystyle P_{V}(u,\xi )=\int _{-\infty }^{\infty }\left\{X\left(u+{\tfrac {\tau }{2}}\right)X\left(u-{\tfrac {\tau }{2}}\right)\right\}e^{-i\xi \tau }\,d\tau }$

References

1. E. Sejdić, I. Djurović, J. Jiang, "Time-frequency feature representation using energy concentration: An overview of recent advances," Digital Signal Processing, vol. 19, no. 1, pp. 153–183, January 2009.
2. a wavelet tour of signal processing, Stephane Mallat

• L. Cohen, Time-Frequency Analysis, Prentice-Hall, New York, 1995. ISBN 978-0135945322
• B. Boashash, editor, "Time-Frequency Signal Analysis and Processing – A Comprehensive Reference", Elsevier Science, Oxford, 2003.
• L. Cohen, "Time-Frequency Distributions—A Review," Proceedings of the IEEE, vol. 77, no. 7, pp. 941–981, 1989.
• S. Qian and D. Chen, Joint Time-Frequency Analysis: Methods and Applications, Chap. 5, Prentice Hall, N.J., 1996.
• H. Choi and W. J. Williams, "Improved time-frequency representation of multicomponent signals using exponential kernels," IEEE. Trans. Acoustics, Speech, Signal Processing, vol. 37, no. 6, pp. 862–871, June 1989.
• Y. Zhao, L. E. Atlas, and R. J. Marks, "The use of cone-shape kernels for generalized time-frequency representations of nonstationary signals," IEEE Trans. Acoustics, Speech, Signal Processing, vol. 38, no. 7, pp. 1084–1091, July 1990.
• B. Boashash, "Heuristic Formulation of Time-Frequency Distributions", Chapter 2, pp. 29–58, in B. Boashash, editor, Time-Frequency Signal Analysis and Processing: A Comprehensive Reference, Elsevier Science, Oxford, 2003.
• B. Boashash, "Theory of Quadratic TFDs", Chapter 3, pp. 59–82, in B. Boashash, editor, Time-Frequency Signal Analysis & Processing: A Comprehensive Reference, Elsevier, Oxford, 2003.