Mathematics for Applied Sciences (Osnabrück 2023-2024)/Part I/Lecture 25

The dimension formula

The following statement is called dimension formula.

Theorem

Let ${}K$ denote a field, let ${}V$ and ${}W$ denote ${}K$-vector spaces, and let

$\varphi \colon V\longrightarrow W$

denote a ${}K$-linear mapping. Suppose that ${}V$ has finite dimension. Then

${}\dim _{K}{\left(V\right)}=\dim _{K}{\left(\operatorname {kern} \varphi \right)}+\dim _{K}{\left(\operatorname {Im} \varphi \right)}\,$

holds.

Proof

This proof was not presented in the lecture.

$\Box$

Definition

Let ${}K$ denote a field, let ${}V$ and ${}W$ denote ${}K$-vector spaces, and let

$\varphi \colon V\longrightarrow W$

denote a ${}K$-linear mapping. Suppose that ${}V$ has finite dimension. Then we call

${}\operatorname {rk} \,\varphi :=\dim _{K}{\left(\operatorname {Im} \varphi \right)}\,$

the rank of ${}\varphi$.

The dimension formula can also be expressed as

${}\dim _{K}{\left(V\right)}=\dim _{K}{\left(\operatorname {kern} \varphi \right)}+\operatorname {rk} \,\varphi \,.$

Example

We consider the linear mapping

$\varphi \colon \mathbb {R} ^{3}\longrightarrow \mathbb {R} ^{4},{\begin{pmatrix}x\\y\\z\end{pmatrix}}\longmapsto M{\begin{pmatrix}x\\y\\z\end{pmatrix}}={\begin{pmatrix}y+z\\2y+2z\\x+3y+4z\\2x+4y+6z\end{pmatrix}},$

given by the matrix

${}M={\begin{pmatrix}0&1&1\\0&2&2\\1&3&4\\2&4&6\end{pmatrix}}\,.$

To determine the kernel, we have to solve the homogeneous linear system

${}{\begin{pmatrix}y+z\\2y+2z\\x+3y+4z\\2x+4y+6z\end{pmatrix}}={\begin{pmatrix}0\\0\\0\\0\end{pmatrix}}\,.$

The solution space is

${}L={\left\{s{\begin{pmatrix}1\\1\\-1\end{pmatrix}}\mid s\in \mathbb {R} \right\}}\,,$

and this is the kernel of ${}\varphi$. The kernel has dimension one, therefore the dimension of the image is ${}2$, due to the dimension formula.

Corollary

Let ${}K$ denote a field, let ${}V$ and ${}W$ denote ${}K$-vector spaces with the same dimension ${}n$. Let

$\varphi \colon V\longrightarrow W$

denote a linear mapping. Then ${}\varphi$ is injective if and only if ${}\varphi$ is

surjective.

Proof

This follows from the dimension formula and Lemma 24.14 .

$\Box$

Composition of linear mappings and matrices

Lemma

In the correspondence between linear mappings and matrices, the composition of linear mappings corresponds to the matrix multiplication. More precisely: let ${}U,V,W$ denote vector spaces over a field ${}K$ with bases

${\mathfrak {u}}=u_{1},\ldots ,u_{p},\,{\mathfrak {v}}=v_{1},\ldots ,v_{n}{\text{ and }}{\mathfrak {w}}=w_{1},\ldots ,w_{m}.$

Let

$\psi :U\longrightarrow V{\text{ and }}\varphi :V\longrightarrow W$

denote linear mappings. Then, for the describing matrix of ${}\psi ,\,\varphi$, and of the composition ${}\varphi \circ \psi$, the relation

${}M_{\mathfrak {w}}^{\mathfrak {u}}(\varphi \circ \psi )=(M_{\mathfrak {w}}^{\mathfrak {v}}(\varphi ))\circ (M_{\mathfrak {v}}^{\mathfrak {u}}(\psi ))\,$

holds.

Proof

We consider the chain of mappings

$U{\stackrel {\psi }{\longrightarrow }}V{\stackrel {\varphi }{\longrightarrow }}W.$

Suppose that ${}\psi$ is described by the ${}n\times p$-matrix ${}B=(b_{jk})_{jk}$, and that ${}\varphi$ is described by the ${}m\times n$-matrix ${}A={\left(a_{ij}\right)}_{ij}$ (with respect to the bases). The composition ${}\varphi \circ \psi$ has the following effect on the base vector ${}u_{k}$.

${}{\begin{aligned}{\left(\varphi \circ \psi \right)}{\left(u_{k}\right)}&=\varphi {\left(\psi {\left(u_{k}\right)}\right)}\\&=\varphi {\left(\sum _{j=1}^{n}b_{jk}v_{j}\right)}\\&=\sum _{j=1}^{n}b_{jk}\varphi (v_{j})\\&=\sum _{j=1}^{n}b_{jk}{\left(\sum _{i=1}^{m}a_{ij}w_{i}\right)}\\&=\sum _{i=1}^{m}{\left(\sum _{j=1}^{n}a_{ij}b_{jk}\right)}w_{i}\\&=\sum _{i=1}^{m}c_{ik}w_{i}.\end{aligned}}$

Here, these coefficients ${}c_{ik}=\sum _{j=1}^{n}a_{ij}b_{jk}$ are just the entries of the product matrix ${}A\circ B$.

$\Box$

From this, we can conclude that the product of matrices is associative.

Invertible matrices

Definition

Let ${}K$ be a field, and let ${}M$ denote an ${}n\times n$-matrix over ${}K$. Then ${}M$ is called invertible, if there exists a matrix ${}A\in \operatorname {Mat} _{n}(K)$ such that

${}A\circ M=E_{n}=M\circ A\,$

holds.

Definition

Let ${}K$ denote a field. For an invertible matrix ${}M\in \operatorname {Mat} _{n}(K)$, the matrix ${}A\in \operatorname {Mat} _{n}(K)$ fulfilling

${}A\circ M=E_{n}=M\circ A\,,$

is called the inverse matrix of ${}M$. It is denoted by

$M^{-1}.$

Linear mappings and change of basis

Lemma

Let ${}K$ denote a field, and let ${}V$ and ${}W$ denote finite-dimensional ${}K$-vector spaces. Let ${}{\mathfrak {v}}$ and ${}{\mathfrak {u}}$ be bases of ${}V$ and ${}{\mathfrak {w}}$ and ${}{\mathfrak {z}}$ bases of ${}W$. Let

$\varphi \colon V\longrightarrow W$

denote a linear mapping, which is described by the matrix ${}M_{\mathfrak {w}}^{\mathfrak {v}}(\varphi )$ with respect to the bases ${}{\mathfrak {v}}$ and ${}{\mathfrak {w}}$. Then ${}\varphi$ is described with respect to the bases ${}{\mathfrak {u}}$ and ${}{\mathfrak {z}}$ by the matrix

$M_{\mathfrak {z}}^{\mathfrak {w}}\circ (M_{\mathfrak {w}}^{\mathfrak {v}}(\varphi ))\circ (M_{\mathfrak {u}}^{\mathfrak {v}})^{-1},$

where ${}M_{\mathfrak {u}}^{\mathfrak {v}}$ and ${}M_{\mathfrak {z}}^{\mathfrak {w}}$ are the transformation matrices, which describe the change of basis from ${}{\mathfrak {v}}$ to ${}{\mathfrak {u}}$ and from

${}{\mathfrak {w}}$ to ${}{\mathfrak {z}}$.

Proof

This proof was not presented in the lecture.

$\Box$

Corollary

Let ${}K$ denote a field, and let ${}V$ denote a ${}K$-vector space of finite dimension. Let

$\varphi \colon V\longrightarrow V$

be a linear mapping. Let ${}{\mathfrak {u}}$ and ${}{\mathfrak {v}}$ denote bases of ${}V$. Then the matrices which describe the linear mapping with respect to ${}{\mathfrak {u}}$ and ${}{\mathfrak {v}}$ respectively (on both sides), fulfil the relation

${}M_{\mathfrak {u}}^{\mathfrak {u}}(\varphi )=M_{\mathfrak {u}}^{\mathfrak {v}}\circ M_{\mathfrak {v}}^{\mathfrak {v}}(\varphi )\circ (M_{\mathfrak {u}}^{\mathfrak {v}})^{-1}\,.$

Proof

This follows directly from Lemma 25.8 .

$\Box$

Definition

Two square matrices ${}M,N\in \operatorname {Mat} _{n}(K)$ are called similar, if there exists an invertible matrix ${}B$ with

${}M=BNB^{-1}$.

Due to Corollary 25.9 , for a linear mapping ${}\varphi \colon V\rightarrow V$, the describing matrices with respect to several bases are similar.

Properties of linear mappings

Lemma

Let ${}K$ be a field, and let ${}V$ and ${}W$ be vector spaces over ${}K$ of dimensions ${}n$ and ${}m$. Let

$\varphi \colon V\longrightarrow W$

be a linear map, described by the matrix ${}M\in \operatorname {Mat} _{m\times n}(K)$

with respect to two bases. Then the following properties hold.

1. ${}\varphi$ is injective if and only if the columns of the matrix are linearly independent.
2. ${}\varphi$ is surjective if and only if the columns of the matrix form a generating system of ${}K^{m}$.
3. Let ${}m=n$. Then ${}\varphi$ is bijective if and only if the columns of the matrix form a basis of ${}K^{m}$, and this holds if and only if ${}M$ is invertible.

Proof

Let ${}{\mathfrak {v}}=v_{1},\ldots ,v_{n}$ and ${}{\mathfrak {w}}=w_{1},\ldots ,w_{m}$ denote the bases of ${}V$ and ${}W$ respectively, and let ${}s_{1},\ldots ,s_{n}$ denote the column vectors of ${}M$. (1). The mapping ${}\varphi$ has the property

${}\varphi (v_{j})=\sum _{i=1}^{m}s_{ij}w_{i}\,,$

where ${}s_{ij}$ is the ${}i$-th entry of the ${}j$-th column vector. Therefore,

${}\varphi {\left(\sum _{j=1}^{n}a_{j}v_{j}\right)}=\sum _{j=1}^{n}a_{j}{\left(\sum _{i=1}^{m}s_{ij}w_{i}\right)}=\sum _{i=1}^{m}{\left(\sum _{j=1}^{n}a_{j}s_{ij}\right)}w_{i}\,.$

This is ${}0$ if and only if ${}\sum _{j=1}^{n}a_{j}s_{ij}=0$ for all ${}i$, and this is equivalent with

${}\sum _{j=1}^{n}a_{j}s_{j}=0\,.$

For this vector equation, there exists a nontrivial tuple ${}{\left(a_{1},\ldots ,a_{n}\right)}$, if and only if the columns are linearly dependent, and this holds if and only if ${}\varphi$ is not injective.
(2). See Exercise 25.3 .
(3). Let ${}n=m$. The first equivalence follows from (1) and (2). If ${}\varphi$ is bijective, then there exists a (linear) inverse mapping ${}\varphi ^{-1}$ with

$\varphi \circ \varphi ^{-1}=\operatorname {Id} _{W}{\text{ and }}\varphi ^{-1}\circ \varphi =\operatorname {Id} _{V}.$

Let ${}M$ denote the matrix for ${}\varphi$, and ${}N$ the matrix for ${}\varphi ^{-1}$. The matrix for the identity is the identity matrix. Because of Lemma 25.5 , we have

${}M\circ N=E_{n}=N\circ M\,$

and therefore ${}M$ is invertible. The reverse implication is proved similarly.

$\Box$

Finding the inverse matrix

Method

Let ${}M$ denote a square matrix. How can we decide whether the matrix is invertible, and how can we find the inverse matrix ${}M^{-1}$?

For this we write down a table, on the left-hand side we write down the matrix ${}M$, and on the right-hand side we write down the identity matrix (of the right size). Now we apply on both sides step by step the same elementary row manipulations. The goal is to produce in the left-hand column, starting with the matrix, in the end the identity matrix. This is possible if and only if the matrix is invertible. We claim that we produce, by this method, in the right column the matrix ${}M^{-1}$ in the end. This rests on the following invariance principle. Every elementary row manipulation can be realized as a matrix multiplication with some elementary matrix ${}E$ from the left. If in the table we have somewhere the pair

$(M_{1},M_{2}),$

after the next step (in the next line) we have

$(EM_{1},EM_{2}).$

If we multiply the inverse of the second matrix (which we do not know yet, but we do know its existence, in case the matrix is invertible) with the first matrix, then we get

${}(EM_{1})^{-1}EM_{2}=M_{1}^{-1}E^{-1}EM_{2}=M_{1}^{-1}M_{2}\,.$

This means that this expression is not changed in each single step. In the beginning, this expression equals ${}M^{-1}E_{n}$, hence in the end, the pair ${}(E_{n},N)$ must fulfil

${}N=E_{n}^{-1}N=M^{-1}E_{n}=M^{-1}\,.$

Example

We want to find for the matrix ${}{\begin{pmatrix}1&3&1\\4&1&2\\0&1&1\end{pmatrix}}$ its inverse matrix ${}M^{-1}$, following Method 25.12 .

${}{\begin{pmatrix}1&3&1\\4&1&2\\0&1&1\end{pmatrix}}$	${}{\begin{pmatrix}1&0&0\\0&1&0\\0&0&1\end{pmatrix}}$
${}{\begin{pmatrix}1&3&1\\0&-11&-2\\0&1&1\end{pmatrix}}$	${}{\begin{pmatrix}1&0&0\\-4&1&0\\0&0&1\end{pmatrix}}$
${}{\begin{pmatrix}1&3&1\\0&1&1\\0&-11&-2\end{pmatrix}}$	${}{\begin{pmatrix}1&0&0\\0&0&1\\-4&1&0\end{pmatrix}}$
${}{\begin{pmatrix}1&3&1\\0&1&1\\0&0&9\end{pmatrix}}$	${}{\begin{pmatrix}1&0&0\\0&0&1\\-4&1&11\end{pmatrix}}$
${}{\begin{pmatrix}1&3&1\\0&1&1\\0&0&1\end{pmatrix}}$	${}{\begin{pmatrix}1&0&0\\0&0&1\\{\frac {-4}{9}}&{\frac {1}{9}}&{\frac {11}{9}}\end{pmatrix}}$
${}{\begin{pmatrix}1&0&-2\\0&1&1\\0&0&1\end{pmatrix}}$	${}{\begin{pmatrix}1&0&-3\\0&0&1\\{\frac {-4}{9}}&{\frac {1}{9}}&{\frac {11}{9}}\end{pmatrix}}$
${}{\begin{pmatrix}1&0&0\\0&1&0\\0&0&1\end{pmatrix}}$	${}{\begin{pmatrix}{\frac {1}{9}}&{\frac {2}{9}}&{\frac {-5}{9}}\\{\frac {4}{9}}&{\frac {-1}{9}}&{\frac {-2}{9}}\\{\frac {-4}{9}}&{\frac {1}{9}}&{\frac {11}{9}}\end{pmatrix}}$

<< | Mathematics for Applied Sciences (Osnabrück 2023-2024)/Part I | >> PDF-version of this lecture Exercise sheet for this lecture (PDF)