Weighing matrix

Not to be confused with Weight matrix.

In mathematics, a weighing matrix of order ${\displaystyle n}$ and weight ${\displaystyle w}$ is a matrix ${\displaystyle W}$ with entries from the set ${\displaystyle \{0,1,-1\}}$ such that:

${\displaystyle WW^{\mathsf {T}}=wI_{n}}$

Weighing matrices are so called because of their use in optimally measuring the individual weights of multiple objects.^[1][2]

Where ${\displaystyle W^{\mathsf {T}}}$ is the transpose of ${\displaystyle W}$ and ${\displaystyle I_{n}}$ is the identity matrix of order ${\displaystyle n}$. The weight ${\displaystyle w}$ is also called the degree of the matrix. For convenience, a weighing matrix of order ${\displaystyle n}$ and weight ${\displaystyle w}$ is often denoted by ${\displaystyle W(n,w)}$.^[3]

Weighing matrices are so called because of their use in optimally measuring the individual weights of multiple objects. When the weighing device is a balance scale, the statistical variance of the measurement can be minimized by weighing multiple objects at once, including some objects in the opposite pan of the scale where they subtract from the measurement.^[1][2]

Properties

Some properties are immediate from the definition. If ${\displaystyle W}$ is a ${\displaystyle W(n,w)}$, then:

• The rows of ${\displaystyle W}$ are pairwise orthogonal. Similarly, the columns are pairwise orthogonal.
• Each row and each column of ${\displaystyle W}$ has exactly ${\displaystyle w}$ non-zero elements.
• ${\displaystyle W^{\mathsf {T}}W=wI}$, since the definition means that ${\displaystyle W^{-1}=w^{-1}W^{\mathsf {T}}}$, where ${\displaystyle W^{-1}}$ is the inverse of ${\displaystyle W}$.
• ${\displaystyle \det W=\pm w^{n/2}}$ where ${\displaystyle \det W}$ is the determinant of ${\displaystyle W}$.

A weighing matrix is a generalization of Hadamard matrix, which does not allow zero entries.^[3] As two special cases, a ${\displaystyle W(n,n)}$ is a Hadamard matrix^[3] and a ${\displaystyle W(n,n-1)}$ is equivalent to a conference matrix.

Applications

Experiment design

See also: Design of experiments § Example

Weighing matrices take their name from the problem of measuring the weight of multiple objects. If a measuring device has a statistical variance of ${\displaystyle \sigma ^{2}}$, then measuring the weights of ${\displaystyle N}$ objects and subtracting the (equally imprecise) tare weight will result in a final measurement with a variance of ${\displaystyle 2\sigma ^{2}}$.^[4] It is possible to increase the accuracy of the estimated weights by measuring different subsets of the objects, especially when using a balance scale where objects can be put on the opposite measuring pan where they subtract their weight from the measurement.

An order ${\displaystyle n}$ matrix ${\displaystyle W}$ can be used to represent the placement of ${\displaystyle n}$ objects—including the tare weight—in ${\displaystyle n}$ trials. Suppose the left pan of the balance scale adds to the measurement and the right pan subtracts from the measurement. Each element of this matrix ${\displaystyle w_{ij}}$ will have:

${\displaystyle w_{ij}={\begin{cases}0&{\text{if on the }}i{\text{th trial the }}j{\text{th object was not measured}}\\1&{\text{if on the }}i{\text{th trial the }}j{\text{th object was placed in the left pan}}\\-1&{\text{if on the }}i{\text{th trial the }}j{\text{th object was placed in the right pan }}\\\end{cases}}}$

Let ${\displaystyle \mathbf {x} }$ be a column vector of the measurements of each of the ${\displaystyle n}$ trials, let ${\displaystyle \mathbf {e} }$ be the errors to these measurements each independent and identically distributed with variance ${\displaystyle \sigma ^{2}}$, and let ${\displaystyle \mathbf {y} }$ be a column vector of the true weights of each of the ${\displaystyle n}$ objects. Then we have:

${\displaystyle \mathbf {x} =W\mathbf {y} +\mathbf {e} }$

Assuming that ${\displaystyle W}$ is non-singular, we can use the method of least-squares to calculate an estimate of the true weights:

${\displaystyle \mathbf {y} =(W^{T}W)^{-1}W\mathbf {x} }$

The variance of the estimated ${\displaystyle \mathbf {y} }$ vector cannot be lower than ${\displaystyle \sigma ^{2}/n}$, and will be minimum if and only if ${\displaystyle W}$ is a weighing matrix.^[4][5]

Optical measurement

An optical mask (3) based on a weighing matrix is used in the measurement of the spectrum of incoming light (4). Depending on the corresponding element of the matrix, the light is either absorbed, or passed to one of two intensity detectors (1,2).^[6]

Weighing matrices appear in the engineering of spectrometers, image scanners,^[6] and optical multiplexing systems.^[5] The design of these instruments involve an optical mask and two detectors that measure the intensity of light. The mask can either transmit light to the first detector, absorb it, or reflect it toward the second detector. The measurement of the second detector is subtracted from the first, and so these three cases correspond to weighing matrix elements of 1, 0, and −1 respectively. As this is essentially the same measurement problem as in the previous section, the usefulness of weighing matrices also applies.^[6]

Orthogonal designs

An orthogonal design of order ${\displaystyle n}$ and type ${\displaystyle (s_{1},\dots ,s_{u})}$ where ${\displaystyle s_{i}}$ are positive integers, is an ${\displaystyle n\times n}$ matrix whose entries are in the set ${\displaystyle \{0,\pm x_{1},\dots ,\pm x_{u}\}}$, where ${\displaystyle x_{i}}$ are commuting variables. Additionally, an orthogonal design must satisfy:

${\displaystyle XX^{T}=\sum _{i=0}^{u}s_{i}x_{i}^{2}}$

This constraint is also equivalent to the rows of ${\displaystyle X}$ being orthogonal and each row having exactly ${\displaystyle s_{i}}$ occurrences of ${\displaystyle x_{i}}$.^[7] An orthogonal design can be denoted as ${\displaystyle \mathrm {OD} (n;s_{1},\dots ,s_{u})}$.^[8] An orthogonal design of one variable is a weighing matrix, and so the two fields of study are connected.^[7] Because of this connection, new orthogonal designs can be discovered by way of weighing matrices.^[9]

Examples

Note that when weighing matrices are displayed, the symbol ${\displaystyle -}$ is used to represent −1. Here are some examples:

This is a ${\displaystyle W(2,2)}$:

${\displaystyle {\begin{pmatrix}1&1\\1&-\end{pmatrix}}}$

This is a ${\displaystyle W(4,3)}$:

${\displaystyle {\begin{pmatrix}1&1&1&0\\1&-&0&1\\1&0&-&-\\0&1&-&1\end{pmatrix}}}$

This is a ${\displaystyle W(7,4)}$:

${\displaystyle {\begin{pmatrix}1&1&1&1&0&0&0\\1&-&0&0&1&1&0\\1&0&-&0&-&0&1\\1&0&0&-&0&-&-\\0&1&-&0&0&1&-\\0&1&0&-&1&0&1\\0&0&1&-&-&1&0\end{pmatrix}}}$

Another ${\displaystyle W(7,4)}$:

${\displaystyle {\begin{pmatrix}-&1&1&0&1&0&0\\0&-&1&1&0&1&0\\0&0&-&1&1&0&1\\1&0&0&-&1&1&0\\0&1&0&0&-&1&1\\1&0&1&0&0&-&1\\1&1&0&1&0&0&-\end{pmatrix}}}$

Which is circulant, i.e. each row is a cyclic shift of the previous row. Such a matrix is called a ${\displaystyle CW(n,k)}$ and is determined by its first row. Circulant weighing matrices are of special interest since their algebraic structure makes them easier for classification. Indeed, we know that a circulant weighing matrix of order ${\displaystyle n}$ and weight ${\displaystyle k}$ must be of square weight. So, weights ${\displaystyle 1,4,9,16,...}$ are permissible and weights ${\displaystyle k\leq 25}$ have been completely classified.^[10] Two special (and actually, extreme) cases of circulant weighing matrices are (A) circulant Hadamard matrices which are conjectured not to exist unless their order is less than 5. This conjecture, the circulant Hadamard conjecture first raised by Ryser, is known to be true for many orders but is still open. (B) ${\displaystyle CW(n,k)}$ of weight ${\displaystyle k=s^{2}}$ and minimal order ${\displaystyle n}$ exist if ${\displaystyle s}$ is a prime power and such a circulant weighing matrix can be obtained by signing the complement of a finite projective plane. Since all ${\displaystyle CW(n,k)}$ for ${\displaystyle k\leq 25}$ have been classified, the first open case is ${\displaystyle CW(105,36)}$. The first open case for a general weighing matrix (certainly not a circulant) is ${\displaystyle W(35,25)}$.

Equivalence

Two weighing matrices are considered to be equivalent if one can be obtained from the other by a series of permutations and negations of the rows and columns of the matrix. The classification of weighing matrices is complete for cases where ${\displaystyle w\leq 5}$ as well as all cases where ${\displaystyle n\leq 15}$ are also completed.^[11] However, very little has been done beyond this with exception to classifying circulant weighing matrices.^[12][13]

Existence

One major open question about weighing matrices is their existence: for which values of ${\displaystyle n}$ and ${\displaystyle w}$ does there exist a ${\displaystyle W(n,w)}$? The following conjectures have been proposed about the existence of ${\displaystyle W(n,w)}$:^[7]

1. If ${\displaystyle n\equiv 2{\pmod {4}}}$ then there exists a ${\displaystyle W(n,w)}$ if and only if ${\displaystyle w<n-1}$ is the sum of two integer squares.
2. If ${\displaystyle n\equiv 0{\pmod {4}}}$ then there exists a ${\displaystyle W(n,w)}$ for each ${\displaystyle w<n}$.
3. If ${\displaystyle n\equiv 4{\pmod {8}}}$ then there exists an orthogonal design ${\displaystyle \mathrm {OD} (n;1,1)}$ for all ${\displaystyle k<n}$ where ${\displaystyle k}$ is the sum of three integer squares.
4. If ${\displaystyle n\equiv 0{\pmod {8}}}$ then there exists an orthogonal design ${\displaystyle \mathrm {OD} (n;1,k)}$ for all ${\displaystyle k<n}$.
5. If ${\displaystyle n\equiv 2{\pmod {4}}}$ then there exists an orthogonal design ${\displaystyle \mathrm {OD} (n;1,k)}$ for all ${\displaystyle k<n-1}$ such that ${\displaystyle k=a^{2}}$, ${\displaystyle a}$ an integer.

Although the last three conjectures are statements on orthogonal designs, it has been shown that the existence of an orthogonal design ${\displaystyle \mathrm {OD} (n;s_{1},\dots ,s_{u})}$ is equivalent to the existence of ${\displaystyle X_{1},\dots ,X_{u}}$ weighing matrices of order ${\displaystyle n}$ where ${\displaystyle X_{i}}$ has weight ${\displaystyle s_{i}}$.^[7]

An equally important but often overlooked question about weighing matrices is their enumeration: for a given ${\displaystyle n}$ and ${\displaystyle w}$, how many ${\displaystyle W(n,w)}$'s are there?

References

1. Raghavarao, Damaraju (1960). "Some Aspects of Weighing Designs". The Annals of Mathematical Statistics. 31 (4). Institute of Mathematical Statistics: 878–884. doi:10.1214/aoms/1177705664. ISSN 0003-4851.
2. Seberry, Jennifer (2017). "Some Algebraic and Combinatorial Non-existence Results". Orthogonal Designs. Cham: Springer International Publishing. pp. 7–17. doi:10.1007/978-3-319-59032-5_2. ISBN 978-3-319-59031-8.
3. Geramita, Anthony V.; Pullman, Norman J.; Wallis, Jennifer S. (1974). "Families of weighing matrices". Bulletin of the Australian Mathematical Society. 10 (1). Cambridge University Press (CUP): 119–122. doi:10.1017/s0004972700040703. ISSN 0004-9727. S2CID 122560830.
4. Raghavarao, Damaraju (1971). "Weighing Designs". Constructions and combinatorial problems in design of experiments. New York: Wiley. pp. 305–308. ISBN 978-0471704850.
5. Koukouvinos, Christos; Seberry, Jennifer (1997). "Weighing matrices and their applications". Journal of Statistical Planning and Inference. 62 (1). Elsevier BV: 91–101. doi:10.1016/s0378-3758(96)00172-3. ISSN 0378-3758. S2CID 122205953.
6. Sloane, Neil J. A.; Harwit, Martin (1976-01-01). "Masks for Hadamard transform optics, and weighing designs". Applied Optics. 15 (1). The Optical Society: 107–114. Bibcode:1976ApOpt..15..107S. doi:10.1364/ao.15.000107. ISSN 0003-6935. PMID 20155192.
7. Geramita, Anthony V.; Seberry, Jennifer (1974). "Orthogonal designs III: weighing matrices". Utilitas Mathematica.
8. Charles J. Colbourn (1996). "Orthogonal Designs". CRC Handbook of Combinatorial Designs (1 ed.). Boca Raton: CRC Press. p. 400. doi:10.1201/9781003040897. ISBN 9781003040897.
9. Kotsireas, Ilias; Koukouvinos, Christos; Seberry, Jennifer (2008). "New orthogonal designs from weighing matrices". Australasian Journal of Combinatorics. 40: 99–104.
10. Arasu, K.T.; Gordon, Daniel M.; Zhang, Yiran (2019). "New Nonexistence Results on Circulant Weighing Matrices". arXiv:1908.08447v3. {{cite journal}}: Cite journal requires |journal= (help)
11. Harada, Masaaki; Munemasa, Akihiro (2012). "On the classification of weighing matrices and self-orthogonal codes". J. Combin. Designs. 20: 40–57. arXiv:1011.5382. doi:10.1002/jcd.20295. S2CID 1004492.
12. Ang, Miin Huey; Arasu, K.T.; Lun Ma, Siu; Strassler, Yoseph (2008). "Study of proper circulant weighing matrices with weight 9". Discrete Mathematics. 308 (13): 2802–2809. doi:10.1016/j.disc.2004.12.029.
13. Arasu, K.T.; Hin Leung, Ka; Lun Ma, Siu; Nabavi, Ali; Ray-Chaudhuri, D.K. (2006). "Determination of all possible orders of weight 16 circulant weighing matrices". Finite Fields and Their Applications. 12 (4): 498–538. doi:10.1016/j.ffa.2005.06.009.