Jump to content

Mathematics for Applied Sciences (Osnabrück 2023-2024)/Part I/Lecture 22


A healthy breakfast starts with a fruit salad. The following table shows how much vitamin C, calcium and magnesium various fruits have (in milligram with respect to 100 gram of the fruit).


apple orange grapes banana
vitamin C 12 53 4 9
calcium 7 40 12 5
magnesium 6 10 8 27

My fruit salad today consists of the mentioned fruits with portions (3276) (meaning 300 gram apple and so on). From that, one can calculate the total vitamin-C-amount, the calcium-amount and the magnesium-amount of the fruit salad, by simply multiplying for each fruit its portion with its specific amount, and summing up everything. The vitamin-C-amount of the complete fruit salad is thus

12⋅3+53⋅2+4⋅7+9⋅6=224.

This operation is an example for how a matrix operates. The table yields immediately a 3×4-matrix, namely (125349740125610827), and the above calculation is realized by the matrix multiplication

(125349740125610827)(3276)=(224215256).

One can also ask for a fruit salad which has certain amounts of vitamin C, calcium and magnesium, say (180110140). This leads to the linear system of linear equations in matrix form,

(125349740125610827)(x1x2x3x4)=(180110140).



Matrices

A system of linear equations can easily be written with a matrix. This allows us to make the manipulations that lead to the solution of such a system without writing down the variables. Matrices are quite simple objects; however, they can represent quite different mathematical objects (e.g., a family of column vectors, a family of row vectors, a linear mapping, a table of physical interactions, a relation, a linear vector field, etc.), which one has to keep in mind in order to prevent wrong conclusions.


Let K denote a field, and let I and J denote index sets. An I×J-matrix is a mapping

I×J⟶K,(i,j)⟼aij.

If I={1,…,m} and J={1,…,n}, then we talk about an m×n-matrix. In this case, the matrix is usually written as

(a11a12…a1na21a22…a2n⋮⋮⋱⋮am1am2…amn).

We will usually restrict to this last situation.


For every i∈I, the family aij , j∈J, is called the i-th row of the matrix, which is usually written as a row tuple (or row vector)

(ai1,ai2,…,ain).

For every j∈J, the family aij , i∈I, is called the j-th column of the matrix, usually written as a column tuple (or column vector)

(a1ja2j⋮amj).

The elements aij are called the entries of the matrix. For aij, the number i is called the row index, and j is called the column index of the entry. The position of the entry aij is where the i-th row meets the j-th column. A matrix with m=n is called a square matrix. An m×1-matrix is simply a column tuple (or column vector) of length m, and an 1×n-matrix is simply a row tuple (or row vector) of length n. The set of all matrices with m rows and n columns (and with entries in K) is denoted by Matm×n(K); in case m=n we also write Matn(K).


Two matrices A,B∈Matm×n(K) are added by adding corresponding entries. The multiplication of a matrix A with an element r∈K (a scalar) is also defined entrywise, so

(a11a12…a1na21a22…a2n⋮⋮⋱⋮am1am2…amn)+(b11b12…b1nb21b22…b2n⋮⋮⋱⋮bm1bm2…bmn)=(a11+b11a12+b12…a1n+b1na21+b21a22+b22…a2n+b2n⋮⋮⋱⋮am1+bm1am2+bm2…amn+bmn)

and

r(a11a12…a1na21a22…a2n⋮⋮⋱⋮am1am2…amn)=(ra11ra12…ra1nra21ra22…ra2n⋮⋮⋱⋮ram1ram2…ramn).

The multiplication of matrices is defined in the following way:


Let K denote a field, and let A denote an m×n-matrix and B an n×p-matrix over K. Then the matrix product

AB

is the m×p-matrix, whose entries are given by

cik=∑j=1naijbjk.


A matrix multiplication is only possible when the number of columns of the left-hand matrix equals the number of rows of the right-hand matrix. Just think of the scheme

(ROWROW)(COLUMN)=(RC+O2+WL+RU+OM+WN),

the result is an 1×1-Matrix. In particular, one can multiply an m×n-matrix A with a column vector of length n (the vector on the right), and the result is a column vector of length m. The two matrices can also be multiplied with roles interchanged,

(COLUMN)(ROWROW)=(CRCOCWCRCOCWORO2OWORO2OWLRLOLWLRLOLWURUOUWURUOUWMRMOMWMRMOMWNRNONWNRNONW).

An n×n-matrix of the form

(d110⋯⋯00d220⋯0⋮⋱⋱⋱⋮0⋯0dn−1n−100⋯⋯0dnn)
is called a diagonal matrix.

The n×n-matrix

En:=(10⋯⋯0010⋯0⋮⋱⋱⋱⋮0⋯0100⋯⋯01)
is called identity matrix.

The identity matrix En has the property EnM=M=MEn, for an arbitrary n×n-matrix M.


If we multiply an m×n-matrix A=(aij)ij with a column vector x=(x1x2⋮xn), then we get

Ax=(a11a12…a1na21a22…a2n⋮⋮⋱⋮am1am2…amn)(x1x2⋮xn)=(a11x1+a12x2+⋯+a1nxna21x1+a22x2+⋯+a2nxn⋮am1x1+am2x2+⋯+amnxn).

Hence, an inhomogeneous system of linear equations with disturbance vector (c1c2⋮cm) can be written briefly as

Ax=c.

Then, the manipulations on the equations that do not change the solution set, can be replaced by corresponding manipulations on the rows of the matrix. It is not necessary to write down the variables.



Vector spaces
The addition of two arrows '"`UNIQ--postMath-0000005D-QINU`"' and '"`UNIQ--postMath-0000005E-QINU`"', a typical example for vectors.
The addition of two arrows a and b, a typical example for vectors.

The central concept of linear algebra is a vector space.


Let K denote a field, and V a set with a distinguished element 0∈V, and with two mappings

+:V×V⟶V,(u,v)⟼u+v,

and

⋅:K×V⟶V,(s,v)⟼sv=s⋅v.

Then V is called a K-vector space (or a vector space over K), if the following axioms hold[1] (where r,s∈K and u,v,w∈V are arbitrary). [2]

  1. u+v=v+u,
  2. (u+v)+w=u+(v+w),
  3. v+0=v,
  4. For every v, there exists a z such that v+z=0,
  5. 1⋅u=u,
  6. r(su)=(rs)u,
  7. r(u+v)=ru+rv,
  8. (r+s)u=ru+su.

The binary operation in V is called (vector-)addition, and the operation K×V→V is called scalar multiplication. The elements in a vector space are called vectors, and the elements r∈K are called scalars. The null element 0∈V is called null vector, and for v∈V, the inverse element is called the negative of v, denoted by −v. The field which occurs in the definition of a vector space is called the base field. All the concepts of linear algebra refer to such a base field. In case K=ℝ, we talk about a real vector space, and in case K=ℂ, we talk about a complex vector space. For real and complex vector spaces there exist further structures like length, angle, inner product. But first we develop the algebraic theory of vector spaces over an arbitrary field.



Let K denote a field, and let n∈ℕ+. Then the product set

Kn=K×⋯×K⏟n-times={(x1,…,xn)∣xi∈K},

with componentwise addition and with scalar multiplication given by

s(x1,…,xn)=(sx1,…,sxn),

is a vector space. This space is called the n-dimensional standard space. In particular, K1=K is a vector space.

The null space 0, consisting of just one element 0, is a vector space. It might be considered as K0=0.

The vectors in the standard space Kn can be written as row vectors

(a1,a2,…,an)

or as column vectors

(a1a2⋮an).

The vector

ei:=(0⋮010⋮0),

where the 1 is at the i-th position, is called i-th standard vector.


The complex numbers form a field, and therefore they form also a vector space over the field ℂ itself. However, the set of complex numbers equals ℝ2 as an additive group. The multiplication of a complex number a+bi with a real number s=(s,0) is componentwise, so this multiplication coincides with the scalar multiplication on ℝ2. Hence, the set of complex numbers is also a real vector space.


For a field K, and given natural numbers m,n, the set

Matm×n(K)

of all m×n-matrices, endowed with componentwise addition and componentwise scalar multiplication, is a K-vector space. The null element in this vector space is the null matrix

0=(0…0⋮⋱⋮0…0).

Let R=K[X] be the polynomial ring in one variable over the field K, consisting of all polynomials, that is, expressions of the form

anXn+an−1Xn−1+⋯+a2X2+a1X+a0,

with ai∈K. Using componentwise addition and componentwise multiplication with a scalar s∈K (this is also multiplication with the constant polynomial s), the polynomial ring is a K-vector space.


Lemma

Let K be a field, and let V be a K-vector space. Then the following properties hold (for

v∈V and s∈K).
  1. We have 0v=0.
  2. We have s0=0.
  3. We have (−1)v=−v.
  4. If s≠0 and v≠0, then sv≠0.

Proof

◻



Linear subspaces

Let K be a field, and let V be a K-vector space. A subset U⊆V is called a linear subspace if the following properties hold.

  1. 0∈U.
  2. If u,v∈U, then also u+v∈U.
  3. If u∈U and s∈K, then also su∈U holds.

Addition and scalar multiplication can be restricted to such a linear subspace. Hence, the linear subspace is itself a vector space, see Exercise 22.20 . The simplest linear subspaces in a vector space V are the null space 0 and the whole vector space V.


Lemma

Let K be a field, and let

a11x1+a12x2+⋯+a1nxn=0a21x1+a22x2+⋯+a2nxn=0⋮⋮⋮am1x1+am2x2+⋯+amnxn=0

be a homogeneous system of linear equations over K. Then the set of all solutions to the system is a linear subspace of the standard space Kn.

Proof

◻


Therefore, we talk about the solution space of the linear system. In particular, the sum of two solutions of a system of linear equations is again a solution. The solution set of an inhomogeneous linear system is not a vector space. However, one can add, to a solution of an inhomogeneous system, a solution of the corresponding homogeneous system, and get a solution of the inhomogeneous system again.


We take a look at the homogeneous version of Example 21.11 , so we consider the homogeneous linear system

2x+5y+2z−v=03x−4y+u+2v=04x−2z+2u=0

over ℝ. Due to Lemma 22.14 , the solution set L is a linear subspace of ℝ5. We have described it explicitly in Example 21.11 as

{u(−13,0,13,1,0)+v(−213,513,−413,0,1)∣u,v∈ℝ}.

This description also shows that the solution set is a vector space. Moreover, with this description, it is clear that L is in bijection with ℝ2, and this bijection respects the addition and also the scalar multiplication (the solution set L′ of the inhomogeneous system is also in bijection with ℝ2, but there is no reasonable addition nor scalar multiplication on L′). However, this bijection depends heavily on the chosen "basic solutions“ (−13,0,13,1,0) and (−213,513,−413,0,1), which depends on the order of elimination. There are several equally good basic solutions for L.

This example shows also the following: the solution space of a linear system over K is "in a natural way“, that means, independent on any choice, a linear subspace of Kn (where n is the number of variables). For this solution space, there always exists a "linear bijection“ (an "isomorphism“) to some Kd (d≤n), but there is no natural choice for such a bijection. This is one of the main reasons to work with abstract vector spaces, instead of just Kn.



Footnotes
  1. ↑ The first four axioms, which are independent of K, mean that (V,0,+) is a commutative group.
  2. ↑ Also for vector spaces, there is the convention that multiplication binds stronger than addition.


<< | Mathematics for Applied Sciences (Osnabrück 2023-2024)/Part I | >>
PDF-version of this lecture
Exercise sheet for this lecture (PDF)