Search for probability and statistics terms on Statlect
StatLect

Non-homogeneous system

by , PhD

A non-homogeneous system of equations is a system in which the vector of constants on the right-hand side of the equals sign is non-zero.

This lecture presents a general characterization of the solutions of a non-homogeneous system.

We recommend to read the lecture on homogeneous systems before reading this one.

Table of Contents

Definition

A non-homogenous system has the form[eq1]where A is a $K	imes L$ matrix of coefficients, x is a $L	imes 1$ vector of unknowns and $b$ is a Kx1 non-zero vector of constants.

Example Consider the system[eq2]Its matrix form is[eq3]The system is non-homogeneous because the vector of constants is[eq4]

Equivalent system in row echelon form

By means of elementary row operations, a non-homogenous system can be transformed into an equivalent system [eq5]where the coefficient matrix $R$ is in row echelon form (REF).

The equivalent system in row echelon form has the same solutions as the original one.

Existence of solutions

Unlike homogeneous systems, that are guaranteed to always have at least one solution (the so-called trivial solution), non-homogeneous systems may not have a solution.

As demonstrated in the lecture on row echelon forms, if the REF matrix $R$ has a zero row $R_{jullet }$ and, at the same time, $b_{j}
eq 0$, then the system has no solution. If there are no such rows, then the system has at least one solution.

Basic and non-basic variables

The columns of an REF matrix are of two kinds:

Here is a simple example.

Example Consider the $3	imes 3$ REF matrix[eq6]The first and the third columns are basic, while the second one is non-basic.

Particular solution

When the system has a solution, we can assign arbitrarily chosen values to the non-basic variables and then use the back-substitution algorithm to find the values of the basic variables that solve the system. The solution thus found, for a specific choice of the non-basic variables, is called a particular solution of the system.

Example Consider the system[eq5]where $R$ is given in the previous example and[eq8]Since the third row of $R$ is zero, we need to check the third entry of $b_{R}$. It is zero, so the system has a solution. The variable $x_{2}$ is non-basic and we can assign an arbitrary value to it. We choose $x_{2}=0$. We can now start the back-substitution algorithm. The second equation is[eq9]and the first equation is[eq10]or[eq11]Thus, a particular solution of the system is[eq12]

Associated homogeneous system

A general solution of a system is a characterization of the set of all its possible solutions.

The general solution of a non-homogeneous system is usually provided by relating it to the general solution of its associated homogeneous system.

Let [eq13]be a non-homogeneous system. Then, its associated homogeneous system is[eq14]

General solution

The general solution of a non-homogeneous system is characterized as follows.

Proposition Let $x_{p}$ be any particular solution of (1). Then, x is a solution of (1) if and only if $x-x_{p}$ is a solution of (2).

Proof

The hypothesis is that[eq15]If (1) holds, then we can subtract (3) from (1) to obtain[eq16]Conversely, if (4) holds, then we can add (3) to it, so as to obtain (1).

In other words, we can derive the set of all the solutions of the non-homogeneous system (1) in three steps:

Here is an example.

Example Consider the following non-homogeneous system:[eq1]where the coefficient matrix is already in row echelon form:[eq20]and[eq21]There are no zero rows, so the system is guaranteed to have a solution. The first two columns are basic, while the last two are non-basic. We can find a particular solution by setting the non-basic variables to zero ($x_{3}=x_{4}=0$). After doing so, the solution becomes readable from the matrix of coefficients: $x_{1}=4$, $x_{2}=2$. Thus, we have a particular solution[eq22]Also the solution of the associated homogeneous system is immediate to find:[eq23]Therefore, the solution of the given non-homogeneous system is the set of all vectors x that satisfy[eq24]

Solved exercises

Below you can find some exercises with explained solutions.

Exercise 1

Find the general solution of the system[eq1]where[eq26]and[eq27]

Solution

To facilitate things, we are going to transform the system into an equivalent one in reduced row echelon form. We divide the second equation by $3$; then, we subtract two times the second equation from the first one. The result is [eq28]The existence of a solution is guaranteed by the fact that there are no zero rows in the reduced echelon form. We can derive a particular solution by setting $x_{3}=0$ (since $x_{3}$ is non-basic). As a consequence, the particular solution is[eq29]The general solution of the associated homogeneous system is the set of all vectors x that satisfy[eq30]The general solution of the given non-homogeneous system contains all vectors that satisfy[eq31]

How to cite

Please cite as:

Taboga, Marco (2021). "Non-homogeneous system", Lectures on matrix algebra. https://www.statlect.com/matrix-algebra/non-homogeneous-system.

The books

Most of the learning materials found on this website are now available in a traditional textbook format.