The
transposed matrix
is
row stochastic;
therefore, it has an
eigenvector to the eigenvalue . Due to
fact,
the
characteristic polynomial
of the transposed matrix has a zero at . Because of
exercise,
this also holds for the characteristic polynomial of the matrix we have started with. Hence, has an eigenvector to the eigenvalue .
We now assume also that all entries of the -th row are positive, and let
denote a vector with
(at least)
a positive and a negative entry. Then
holds.
As in the proof of (2), let all entries of the -th row be positive. For any eigenvector to the eigenvalue , according to (2), either all entries are non-negative, or non-positive. Hence, for such a vector, because of
,
its -th entry is not . Let be such eigenvectors. Then belongs to the fixed space. However, the -th component of this vector equals ; therefore, it is the zero vector. This means that
and
are
linearly dependent.
Therefore, this eigenspace is one-dimensional. Because of (2), there exists an eigenvector to the eigenvalue with non-negative entries. By normalizing, we get a stationary distribution.