Elementary column operations

All the theory of linear systems we have discussed so far (e.g., matrix form, equivalent systems, elementary row operations, row echelon form, Gaussian elimination) depends on the choice we have initially made of arranging the equations of the system vertically (one below the other) and writing their left- and right-hand sides as entries of two column vectors.

A parallel, and mostly identical, theory can be developed by arranging the equations horizontally (one besides the other) and writing their left- and right-hand sides as entries of two row vectors. In this parallel theory, which is briefly outlined below, elementary column operations (which are the counterpart of elementary row operations) play a key role. Furthermore, precisely defining column operations is worthwhile because several useful concepts in linear algebra rely on a unified treatment of row and column operations.

Table of contents

Systems in row form
Column operations
Column echelon form
Gaussian and Gauss Jordan elimination
Solved exercises
1. Exercise 1
2. Exercise 2

Systems in row form

Remember that a system of linear equations in unknowns [eq1] can be represented in matrix form aswhere is the matrix of coefficients, is the vector of constants and is the vector of unknowns.

Thus, we have two column vectors on the two sides of the equal sign:

on the left-hand side;
on the right-hand side.

By transposing both sides of the system, we can equivalently write it asso that the vector of unknowns $x^{ op }$ is a row vector, the matrix of coefficients $A^{ op }$ is a matrix and the vector of constants $b^{ op }$ is a row vector.

In other words, we have two row vectors on the two sides of the equal sign:

$x^{ op }A^{ op }$ on the left-hand side;
$b^{ op }$ on the right-hand side.

This is what we meant in the introduction by "arranging the equations horizontally, one besides the other".

Notice that:

in the system , each row is an equation;
in the system , each column is an equation.

Example Consider the system [eq5] Then, [eq6] and we have two vectors on the two sides of the equal sign: [eq7] Each row of the two vectors corresponds to an equation. By transposing everything, we get [eq8] and we have two vectors on the two sides of the equal sign: [eq9] Each column of the two vectors corresponds to an equation. To better visualize the correspondence between columns, we could write [eq10]

Column operations

When a system is written horizontally, we can obtain systems equivalent to it by performing elementary column operations:

multiplying a column by a non-zero constant;
adding a multiple of one column to another column;
interchanging columns.

These operations are completely analogous to the elementary row operations performed on systems written vertically.

Remember that elementary row operations can be performed in two alternative ways:

directly on the rows of the system;
on the rows of the identity matrix; the system is then pre-multiplied by the resultant matrix.

The same is true of elementary column operations, who can be performed:

directly on the columns of the system;
on the columns of the identity matrix; the system is then post-multiplied by the resultant matrix.

This can be easily seen as follows. When the system is arranged vertically and the matrix obtained by performing elementary row operations is , then the equivalent system is

If we transpose both sides of the equation, we getwhere $R^{ op }$ is the matrix obtained by performing column operations on the identity matrix (transposition transforms row operations into column operations).

Example Consider the system of two equations in three unknowns [eq13] that can be written in matrix form as where [eq15] Adding the first equation to the second, we obtain the equivalent system [eq16] that can be written in matrix form aswhere [eq18] We obtain the same result by 1) taking the identity matrix [eq19] 2) adding its first column to the second: [eq20] and 3) post-multiplying $A^{ op }$ and $b^{ op }$ by $R^{ op }$ : [eq21]

Column echelon form

Remember that systems arranged vertically are easy to solve when they are in row echelon form or reduced row echelon form. These forms have obvious counterparts for systems arranged horizontally: the systemis said to be in (reduced) column echelon form if and only if the system is in (reduced) row echelon form.

Equivalently, the matrix $A^{ op }$ is said to be in (reduced) column echelon form if and only if the matrix is in (reduced) row echelon form.

Gaussian and Gauss Jordan elimination

Finally, Gaussian and Gauss Jordan elimination, the two algorithms used to transform a vertical system into an equivalent system in (reduced) row echelon form, can be used on a horizontal system with straightforward modifications: whenever an elementary row operation is necessary for the vertical system, we instead perform a column operation on the horizontal system.

Solved exercises

Below you can find some exercises with explained solutions.

Exercise 1

Write the system [eq24] horizontally.

Solution

The system is [eq25]

Exercise 2

Write the matrix that allows us to sum twice the first column of the system in the previous exercise to the second column.

Solution

The matrix is obtained by performing the elementary column operation on the identity matrix: [eq26]

How to cite

Please cite as:

Taboga, Marco (2021). "Elementary column operations", Lectures on matrix algebra. https://www.statlect.com/matrix-algebra/elementary-column-operations.