Linear system/Examples/Introduction/Section

Firstly, we give three introductory examples, one from every day's life, one from geometry and one from physics. They all lead to systems of linear equations.

Example

At a booth on the Christmas market, there are three different pots of mulled wine. All three contain the ingredients cinnamon, cloves, red wine and sugar, but the compositions differ. The mixtures of the mulled wines are

$G_{1}={\begin{pmatrix}1\\2\\11\\2\end{pmatrix}},\,G_{2}={\begin{pmatrix}2\\2\\12\\3\end{pmatrix}},\,G_{3}={\begin{pmatrix}3\\1\\20\\7\end{pmatrix}}.$

Every mulled wine is represented by a four-tuple, where the entries represent the respective shares of the ingredients. The set of all (possible) mulled wines form a vector space and the three concrete mulled wines are vectors in this space.

Now suppose that none of the three mulled wines meets exactly our taste, in fact the wanted mulled wine has the mixture

${}W={\begin{pmatrix}1\\2\\20\\5\end{pmatrix}}\,.$

Is there a possibility to get the wanted mulled wine, by pouring together the given mulled wines in some way? Are there numbers ${}a,b,c\in \mathbb {Q}$ such that

${}a{\begin{pmatrix}1\\2\\11\\2\end{pmatrix}}+b{\begin{pmatrix}2\\2\\12\\3\end{pmatrix}}+c{\begin{pmatrix}3\\1\\20\\7\end{pmatrix}}={\begin{pmatrix}1\\2\\20\\5\end{pmatrix}}\,$

holds? This vector-equation can be expressed by four equations in the "variables“ ${}a,b,c$, where the equations come from the rows. When does there exist a solution, when none, when many? These are typical questions of linear algebra.

Example

Two planes in space, intersecting in a line.

Suppose that two planes are given in ${}\mathbb {R} ^{3}$,

Failed to parse (syntax error): {\displaystyle {{}} E = { \left\{ (x,y,z) \in \R^3 \mid 4x-2y-3z <table class="metadata plainlinks ambox ambox-notice" style=""> <tr> <td class="mbox-image"><div style="width: 52px;"> [[File:Wikiversity logo 2017.svg|50px|link=]]</div></td> <td class="mbox-text" style=""> '''[[m:Soft redirect|Soft redirect]]'''<br />This page can be found at <span id="SoftRedirect">[[mw:Help:Magic words#Other]]</span>. </td> </tr> </table>[[Category:Wikiversity soft redirects|Linear system/Examples/Introduction/Section]] __NOINDEX__ 5 \right\} } \, }

and

Failed to parse (SVG (MathML can be enabled via browser plugin): Invalid response ("Math extension cannot connect to Restbase.") from server "http://localhost:6011/en.wikiversity.org/v1/":): {\displaystyle {{}} F = { \left\{ (x,y,z) \in \R^3 \mid 3x-5y+2z <table class="metadata plainlinks ambox ambox-notice" style=""> <tr> <td class="mbox-image"><div style="width: 52px;"> [[File:Wikiversity logo 2017.svg|50px|link=]]</div></td> <td class="mbox-text" style=""> '''[[m:Soft redirect|Soft redirect]]'''<br />This page can be found at <span id="SoftRedirect">[[mw:Help:Magic words#Other]]</span>. </td> </tr> </table>[[Category:Wikiversity soft redirects|Linear system/Examples/Introduction/Section]] __NOINDEX__ 1 \right\} } \, . }

How can we describe the intersecting line ${}G=E\cap F$? A point ${}P=(x,y,z)$ belongs to the intersection line if and only if it satisfies both plane equations. Therefore, both equations,

Failed to parse (syntax error): {\displaystyle 4x-2y-3z <table class="metadata plainlinks ambox ambox-notice" style=""> <tr> <td class="mbox-image"><div style="width: 52px;"> [[File:Wikiversity logo 2017.svg|50px|link=]]</div></td> <td class="mbox-text" style=""> '''[[m:Soft redirect|Soft redirect]]'''<br />This page can be found at <span id="SoftRedirect">[[mw:Help:Magic words#Other]]</span>. </td> </tr> </table>[[Category:Wikiversity soft redirects|Linear system/Examples/Introduction/Section]] __NOINDEX__ 5 \, \, \text{ and } \, \, 3x-5y+2z <table class="metadata plainlinks ambox ambox-notice" style=""> <tr> <td class="mbox-image"><div style="width: 52px;"> [[File:Wikiversity logo 2017.svg|50px|link=]]</div></td> <td class="mbox-text" style=""> '''[[m:Soft redirect|Soft redirect]]'''<br />This page can be found at <span id="SoftRedirect">[[mw:Help:Magic words#Other]]</span>. </td> </tr> </table>[[Category:Wikiversity soft redirects|Linear system/Examples/Introduction/Section]] __NOINDEX__ 1 , }

must hold. We multiply the first equation by ${}3$, and subtract from that four times the second equation, and get

${}14y-17z=11\,.$

If we set ${}y=0$, then ${}z=-{\frac {11}{17}}$ and ${}x={\frac {13}{17}}$ must hold. This means that the point ${}P=\left({\frac {13}{17}},\,0,\,-{\frac {11}{17}}\right)$ belongs to ${}G$. In the same way, setting ${}z=0$, we find the point ${}Q=\left({\frac {23}{14}},\,{\frac {11}{14}},\,0\right)$. Therefore, the intersecting line is the line connecting these points, so

${}G={\left\{\left({\frac {13}{17}},\,0,\,-{\frac {11}{17}}\right)+t\left({\frac {209}{238}},\,{\frac {11}{14}},\,{\frac {11}{17}}\right)\mid t\in \mathbb {R} \right\}}\,.$

Example

An electrical network consists of several connected wires, which we call the edges of the network in this context. In every edge ${}K_{j}$, there is a certain (depending on the material and the length of the edge) resistance ${}R_{j}$. The points ${}P_{n}$, where the edges meet, are called the vertices of the network. If we put to some edges of the network a certain electric tension (voltage), then we will have in every edge a certain current ${}I_{j}$. It is helpful to assign to each edge a fixed direction, in order to distinguish the direction of the current in this edge (if the current is in the opposite direction, it gets a minus sign). We call these directed edges. In every vertex of the network, the currents of the adjacent edges come together, their sum must be ${}0$. In an edge ${}K_{j}$, there is a voltage drop ${}U_{j}$, determined by Ohm's law to be

${}U_{j}=R_{j}\cdot I_{j}\,.$

We call a closed directed alignment of edges in a network a mesh. For such a mesh, the sum of voltages is ${}0$, unless from "outside“ a certain voltage is enforced.

We list these Kirchhoff's laws again.

1. In every vertex, the sum of the currents equal ${}0$.
2. In every mesh, the sum of the voltages equals ${}0$.
3. If in a mesh, a voltage ${}V$ is enforced, then the sum of the voltages equals ${}V$.

Due to "physical reasons“, we expect that, given voltages in every edge, there should be a well-defined current in every edge. In fact, these currents can be computed, if we translate the stated laws into a system of linear equations and solve this system.

In the example given by the picture, suppose that the edges ${}K_{1},\ldots ,K_{5}$ (with the resistances ${}R_{1},\ldots ,R_{5}$) are directed from left to right, and that the connecting edge ${}K_{0}$ from ${}A$ to ${}C$ (where the voltage ${}V$ is applied) is directed upwards. The four vertices and the three meshes ${}(A,D,B),\,(D,B,C)$ and ${}(A,D,C)$ yield the system of linear equations

${\begin{matrix}I_{0}&+I_{1}&&-I_{3}&&&=&0\\&&&I_{3}&+I_{4}&+I_{5}&=&0\\-I_{0}&&+I_{2}&&-I_{4}&&=&0\\&-I_{1}&-I_{2}&&&-I_{5}&=&0\\&R_{1}I_{1}&&+R_{3}I_{3}&&-R_{5}I_{5}&=&0\\&&-R_{2}I_{2}&&-R_{4}I_{4}&+R_{5}I_{5}&=&0\\&-R_{1}I_{1}&+R_{2}I_{2}&&&&=&-V\,.\end{matrix}}$

Here the ${}R_{j}$ and ${}V$ are given numbers, and the ${}I_{j}$ are the unknowns we are looking for.

We give now the definition of a homogeneous and of an inhomogeneous system of linear equations over a field, for a given set of variables.

Definition

Let ${}K$ denote a field, and let ${}a_{ij}\in K$ for ${}1\leq i\leq m$ and ${}1\leq j\leq n$. We call

${\begin{matrix}a_{11}x_{1}+a_{12}x_{2}+\cdots +a_{1n}x_{n}&=&0\\a_{21}x_{1}+a_{22}x_{2}+\cdots +a_{2n}x_{n}&=&0\\\vdots &\vdots &\vdots \\a_{m1}x_{1}+a_{m2}x_{2}+\cdots +a_{mn}x_{n}&=&0\end{matrix}}$

a (homogeneous) system of linear equations in the variables ${}x_{1},\ldots ,x_{n}$. A tuple ${}(\xi _{1},\ldots ,\xi _{n})\in K^{n}$ is called a solution of the linear system, if Failed to parse (syntax error): {\displaystyle {{}} \sum_{j <table class="metadata plainlinks ambox ambox-notice" style=""> <tr> <td class="mbox-image"><div style="width: 52px;"> [[File:Wikiversity logo 2017.svg|50px|link=]]</div></td> <td class="mbox-text" style=""> '''[[m:Soft redirect|Soft redirect]]'''<br />This page can be found at <span id="SoftRedirect">[[mw:Help:Magic words#Other]]</span>. </td> </tr> </table>[[Category:Wikiversity soft redirects|Linear system/Examples/Introduction/Section]] __NOINDEX__ 1}^n a_{ij } \xi_j = 0} holds for all ${}i=1,\ldots ,m$.

If ${}(c_{1},\ldots ,c_{m})\in K^{m}$ is given, then

${\begin{matrix}a_{11}x_{1}+a_{12}x_{2}+\cdots +a_{1n}x_{n}&=&c_{1}\\a_{21}x_{1}+a_{22}x_{2}+\cdots +a_{2n}x_{n}&=&c_{2}\\\vdots &\vdots &\vdots \\a_{m1}x_{1}+a_{m2}x_{2}+\cdots +a_{mn}x_{n}&=&c_{m}\end{matrix}}$

is called an inhomogeneous system of linear equations. A tuple ${}(\zeta _{1},\ldots ,\zeta _{n})\in K^{n}$ is called a solution to the inhomogeneous linear system, if Failed to parse (syntax error): {\displaystyle {{}} \sum_{j <table class="metadata plainlinks ambox ambox-notice" style=""> <tr> <td class="mbox-image"><div style="width: 52px;"> [[File:Wikiversity logo 2017.svg|50px|link=]]</div></td> <td class="mbox-text" style=""> '''[[m:Soft redirect|Soft redirect]]'''<br />This page can be found at <span id="SoftRedirect">[[mw:Help:Magic words#Other]]</span>. </td> </tr> </table>[[Category:Wikiversity soft redirects|Linear system/Examples/Introduction/Section]] __NOINDEX__ 1}^n a_{ij} \zeta_j = c_i}

holds for all ${}i$.

The set of all solutions of the system is called the solution set. In the homogeneous case, this is also called the solution space, as it is indeed by

a vector space.

A homogeneous system of linear equations has always the so-called trivial solution ${}0=(0,\ldots ,0)$. An inhomogeneous system does not necessarily have a solution. For a given inhomogeneous linear system of equations, the homogeneous system which arises when we replace the vector on the right-hand side by the null vector ${}0$, is called the corresponding homogeneous system.

The following situation describes a more abstract version of example.

Example

Let ${}K$ denote a field and ${}m\in \mathbb {N}$. Suppose that in ${}K^{m}$, there are ${}n$ vectors (or ${}m$-tuples)

$v_{1}={\begin{pmatrix}a_{11}\\a_{21}\\\vdots \\a_{m1}\end{pmatrix}},\,v_{2}={\begin{pmatrix}a_{12}\\a_{22}\\\vdots \\a_{m2}\end{pmatrix}},\ldots ,v_{n}={\begin{pmatrix}a_{1n}\\a_{2n}\\\vdots \\a_{mn}\end{pmatrix}}$

given. Let

${}w={\begin{pmatrix}c_{1}\\c_{2}\\\vdots \\c_{m}\end{pmatrix}}\,$

be another vector. We want to know whether ${}w$ can be written as a linear combination of the ${}v_{j}$. Thus, we are dealing with the question whether there are ${}n$ elements ${}s_{1},\ldots ,s_{n}\in K$, such that

${}s_{1}{\begin{pmatrix}a_{11}\\a_{21}\\\vdots \\a_{m1}\end{pmatrix}}+s_{2}{\begin{pmatrix}a_{12}\\a_{22}\\\vdots \\a_{m2}\end{pmatrix}}+\cdots +s_{n}{\begin{pmatrix}a_{1n}\\a_{2n}\\\vdots \\a_{mn}\end{pmatrix}}={\begin{pmatrix}c_{1}\\c_{2}\\\vdots \\c_{m}\end{pmatrix}}\,$

holds. This equality of vectors means identity in every component, so that this condition yields a system of linear equations

${\begin{matrix}a_{11}s_{1}+a_{12}s_{2}+\cdots +a_{1n}s_{n}&=&c_{1}\\a_{21}s_{1}+a_{22}s_{2}+\cdots +a_{2n}s_{n}&=&c_{2}\\\vdots &\vdots &\vdots \\a_{m1}s_{1}+a_{m2}s_{2}+\cdots +a_{mn}s_{n}&=&c_{m}.\end{matrix}}$