Doubly stochastic matrix

From HandWiki
Short description: A square matrix

In mathematics, especially in probability and combinatorics, a doubly stochastic matrix (also called bistochastic matrix) is a square matrix [math]\displaystyle{ X=(x_{ij}) }[/math] of nonnegative real numbers, each of whose rows and columns sums to 1,[1] i.e.,

[math]\displaystyle{ \sum_i x_{ij}=\sum_j x_{ij}=1, }[/math]

Thus, a doubly stochastic matrix is both left stochastic and right stochastic.[1][2]

Indeed, any matrix that is both left and right stochastic must be square: if every row sums to 1 then the sum of all entries in the matrix must be equal to the number of rows, and since the same holds for columns, the number of rows and columns must be equal.[1]

Birkhoff polytope

Main page: Birkhoff polytope

The class of [math]\displaystyle{ n\times n }[/math] doubly stochastic matrices is a convex polytope known as the Birkhoff polytope [math]\displaystyle{ B_n }[/math]. Using the matrix entries as Cartesian coordinates, it lies in an [math]\displaystyle{ (n-1)^2 }[/math]-dimensional affine subspace of [math]\displaystyle{ n^2 }[/math]-dimensional Euclidean space defined by [math]\displaystyle{ 2n-1 }[/math] independent linear constraints specifying that the row and column sums all equal 1. (There are [math]\displaystyle{ 2n-1 }[/math] constraints rather than [math]\displaystyle{ 2n }[/math] because one of these constraints is dependent, as the sum of the row sums must equal the sum of the column sums.) Moreover, the entries are all constrained to be non-negative and less than or equal to 1.

Birkhoff–von Neumann theorem

The Birkhoff–von Neumann theorem (often known simply as Birkhoff's theorem[3][4][5]) states that the polytope [math]\displaystyle{ B_n }[/math] is the convex hull of the set of [math]\displaystyle{ n\times n }[/math] permutation matrices, and furthermore that the vertices of [math]\displaystyle{ B_n }[/math] are precisely the permutation matrices. In other words, if [math]\displaystyle{ X }[/math] is a doubly stochastic matrix, then there exist [math]\displaystyle{ \theta_1,\ldots,\theta_k \ge 0, \sum_{i=1}^k \theta_i = 1 }[/math] and permutation matrices [math]\displaystyle{ P_1,\ldots,P_k }[/math] such that

[math]\displaystyle{ X = \theta_1 P_1 + \cdots + \theta_k P_k. }[/math]

(Such a decomposition of X is known as a 'convex combination'.) A proof of the theorem based on Hall's marriage theorem is given below.

This representation is known as the Birkhoff–von Neumann decomposition, and may not be unique. It is often described as a real-valued generalization of Kőnig's theorem, where the correspondence is established through adjacency matrices of graphs.

Other properties

  • The product of two doubly stochastic matrices is doubly stochastic. However, the inverse of a nonsingular doubly stochastic matrix need not be doubly stochastic (indeed, the inverse is doubly stochastic iff it has nonnegative entries).
  • The stationary distribution of an irreducible aperiodic finite Markov chain is uniform if and only if its transition matrix is doubly stochastic.
  • Sinkhorn's theorem states that any matrix with strictly positive entries can be made doubly stochastic by pre- and post-multiplication by diagonal matrices.
  • For [math]\displaystyle{ n=2 }[/math], all bistochastic matrices are unistochastic and orthostochastic, but for larger [math]\displaystyle{ n }[/math] this is not the case.
  • Van der Waerden's conjecture that the minimum permanent among all n × n doubly stochastic matrices is [math]\displaystyle{ n!/n^n }[/math], achieved by the matrix for which all entries are equal to [math]\displaystyle{ 1/n }[/math].[6] Proofs of this conjecture were published in 1980 by B. Gyires[7] and in 1981 by G. P. Egorychev[8] and D. I. Falikman;[9] for this work, Egorychev and Falikman won the Fulkerson Prize in 1982.[10]

Proof of the Birkhoff–von Neumann theorem

Let X be a doubly stochastic matrix. Then we will show that there exists a permutation matrix P such that xij ≠ 0 whenever pij ≠ 0. Thus if we let λ be the smallest xij corresponding to a non-zero pij, the difference X – λP will be a scalar multiple of a doubly stochastic matrix and will have at least one more zero cell than X. Accordingly we may successively reduce the number of non-zero cells in X by removing scalar multiples of permutation matrices until we arrive at the zero matrix, at which point we will have constructed a convex combination of permutation matrices equal to the original X.[3]

For instance if [math]\displaystyle{ X=\frac{1}{12}\begin{pmatrix} 7 & 0 & 5 \\ 2 & 6 & 4 \\ 3 & 6 & 3 \end{pmatrix} }[/math] then [math]\displaystyle{ P=\begin{pmatrix} 0 & 0 & 1 \\ 1 & 0 & 0 \\ 0 & 1 & 0 \end{pmatrix} }[/math], [math]\displaystyle{ \lambda = \frac{2}{12} }[/math], and [math]\displaystyle{ X-\lambda P=\frac{1}{12}\begin{pmatrix} 7 & 0 & 3 \\ 0 & 6 & 4 \\ 3 & 4 & 3 \end{pmatrix} }[/math].

Proof: Construct a bipartite graph in which the rows of X are listed in one part and the columns in the other, and in which row i is connected to column j iff xij ≠ 0. Let A be any set of rows, and define A' as the set of columns joined to rows in A in the graph. We want to express the sizes |A| and |A'| of the two sets in terms of the xij.

For every i in A, the sum over j in A' of xij is 1, since all columns j for which xij ≠ 0 are included in A', and X is doubly stochastic; hence |A| is the sum over all i ∈ A, j ∈ A' of xij.

Meanwhile |A'| is the sum over all i (whether or not in A) and all j in A' of xij ; and this is ≥ the corresponding sum in which the i are limited to rows in A. Hence |A'| ≥ |A|.

It follows that the conditions of Hall's marriage theorem are satisfied, and that we can therefore find a set of edges in the graph which join each row in X to exactly one (distinct) column. These edges define a permutation matrix whose non-zero cells correspond to non-zero cells in X.

Generalisations

There is a simple generalisation to matrices with more columns and rows such that the i th row sum is equal to ri (a positive integer), the column sums are equal to 1, and all cells are non-negative (the sum of the row sums being equal to the number of columns). Any matrix in this form can be expressed as a convex combination of matrices in the same form made up of 0s and 1s. The proof is to replace the i th row of the original matrix by ri separate rows, each equal to the original row divided by ri ; to apply Birkhoff's theorem to the resulting square matrix; and at the end to additively recombine the ri rows into a single i th row.

In the same way it is possible to replicate columns as well as rows, but the result of recombination is not necessarily limited to 0s and 1s. A different generalisation (with a significantly harder proof) has been put forward by R. M. Caron et al.[4]

See also

References

  1. 1.0 1.1 1.2 Gagniuc, Paul A. (2017). Markov Chains: From Theory to Implementation and Experimentation. USA, NJ: John Wiley & Sons. pp. 9–11. ISBN 978-1-119-38755-8. 
  2. Marshal, Olkin (1979). Inequalities: Theory of Majorization and Its Applications. pp. 8. ISBN 978-0-12-473750-1. https://archive.org/details/inequalitiestheo00olki_067. 
  3. 3.0 3.1 Birkhoff's theorem, notes by Gábor Hetyei.
  4. 4.0 4.1 R. M. Caron, Xin Li, P. Mikusiński, H. Sherwood, and M. D. Taylor, Nonsquare “doubly stochastic” matrices, in: Distributions with Fixed Marginals and Related Topics, IMS Lecture Notes – Monographs Series, edited by L. Rüschendorf, B. Schweizer, and M. D. Taylor, vol. 28, pp. 65-75 (1996) | DOI:10.1214/lnms/1215452610
  5. W. B. Jurkat and H. J. Ryser, "Term Ranks and Permanents of Nonnegative Matrices" (1967).
  6. "Aufgabe 45", Jber. Deutsch. Math.-Verein. 35: 117, 1926 .
  7. Gyires, B. (1980), "The common source of several inequalities concerning doubly stochastic matrices", Publicationes Mathematicae Institutum Mathematicum Universitatis Debreceniensis 27 (3–4): 291–304 .
  8. Egoryčev, G. P. (1980) (in Russian), Reshenie problemy van-der-Vardena dlya permanentov, Krasnoyarsk: Akad. Nauk SSSR Sibirsk. Otdel. Inst. Fiz., p. 12 . Egorychev, G. P. (1981), "Proof of the van der Waerden conjecture for permanents" (in Russian), Akademiya Nauk SSSR 22 (6): 65–71, 225 . Egorychev, G. P. (1981), "The solution of van der Waerden's problem for permanents", Advances in Mathematics 42 (3): 299–305, doi:10.1016/0001-8708(81)90044-X .
  9. Falikman, D. I. (1981), "Proof of the van der Waerden conjecture on the permanent of a doubly stochastic matrix" (in Russian), Akademiya Nauk Soyuza SSR 29 (6): 931–938, 957 .
  10. Fulkerson Prize, Mathematical Optimization Society, retrieved 2012-08-19.

External links