Properties of block matrices

In this lecture we summarize some simple properties enjoyed by block matrices (also called partitioned matrices).

We are going to assume that the reader is already familiar with the concept of a block matrix.

Table of contents

Addition of block matrices
Scalar multiplication of a block matrix
Multiplication of block matrices
Transpose of a block matrix
Solved exercises
1. Exercise 1
2. Exercise 2

Addition of block matrices

If two block matrices $M_{1}$ and $M_{2}$ have the same dimension and are partitioned in the same way, we obtain their sum by adding the corresponding blocks.

Example If [eq1] we can compute their sum as [eq2]

All the couples of summands need to have the same dimension. For instance, in the example above, if $A_{1}$ is ( rows and columns), then $A_{2}$ must be .

This property of block matrices is a direct consequence of the definition of matrix addition. Two matrices having the same dimension can be added together by adding their corresponding entries. For example, the -th entry of $M_{1}+M_{2}$ is the sum of the -th entry of $M_{1}$ and the -th entry of $M_{2}$ . This does not change if we first partition $M_{1}$ and $M_{2}$ and then we add together the two blocks to which the -th entries of $M_{1}$ and $M_{2}$ respectively belong.

Scalar multiplication of a block matrix

Remember that the multiplication of a matrix by a scalar is performed by multiplying all the entries of by the scalar .

The same result can be achieved by multiplying all the blocks of by (because then all the entries of each block are multiplied by )

Example If [eq3] then [eq4]

Multiplication of block matrices

The multiplication of two block matrices can be carried out as if their blocks were scalars, by using the standard rule for matrix multiplication: the -th block of the product $M_{1}M_{2}$ is equal to the dot product between the -th row of blocks of $M_{1}$ and the -th column of blocks of $M_{2}$ .

Example Given two block matrices [eq5] we have that [eq6]

As all the products must be well-defined, all the couples of blocks involved in a multiplication must be conformable. For instance, in the example above the number of columns of $A_{1}$ and the number of rows of $A_{2}$ must coincide for the product $A_{1}A_{2}$ to be well-defined.

A proof that the dot product formula can be applied to block matrices follows.

Proof

Let us start from the case of the two matrices $M_{1}$ and $M_{2}$ in the previous example. Suppose that the blocks $A_{1}$ and $C_{1}$ have $S_{1}$ columns. As a consequence, $A_{2}$ and $B_{2}$ must have $S_{1}$ rows for the block products to be well-defined. Further assume that the blocks $B_{1}$ and $D_{1}$ have $S_{2}$ columns. It follows that $C_{2}$ and $D_{2}$ must have $S_{2}$ rows. By the definition of matrix product, the -th entry of $M_{1}M_{2}$ is [eq7] Now, suppose that the partition of $M_{1}$ leaves $K_{1}$ rows in the upper part of the matrix and $K_{2}$ in the lower one. Further assume that the partition of $M_{2}$ leaves $L_{1}$ columns to the left and $L_{2}$ to the right. Then, if $kleq K_{1}$ and $lleq L_{1}$ (upper-left quadrant of $M_{1}M_{2}$ ), we have [eq8] where we have used the facts that: 1) when $kleq K_{1}$ and $sleq S_{1}$ ; when $sleq S_{1}$ and $lleq L_{1}$ ; 3) when $kleq K_{1}$ and ; 4) when and $lleq L_{1}$ . Thus, as far as the upper-left quadrant is concerned, the claim we wanted to prove is true. Along similar lines, we can discuss the case in which $kleq K_{1}$ and $L>L_{1}$ (upper-right quadrant of $M_{1}M_{2}$ ), for which [eq13] We do not report the proofs for the remaining two quadrants, which are analogous. Moreover, similar case-by-case discussions can be performed if the block matrix is partitioned in a different manner (i.e., it has different numbers of horizontal and vertical cuts).

The proof, although tedious, allows us to better understand under what condition all the blocks can be multiplied. The partitions need to be such that a vertical partition of $M_{1}$ leaves $S_{1}$ columns to the left and $S_{2}$ to the right if and only if an horizontal partition of $M_{2}$ leaves $S_{1}$ rows in the upper part of the matrix and $S_{2}$ in the lower part. There are no constraints on the horizontal partitions of $M_{1}$ and the vertical partitions of $M_{2}$ .

Transpose of a block matrix

The transpose of a block-matrix is the matrix $M^{ op }$ such that the -th block of $M^{ op }$ is equal to the transpose of the -th block of .

Example The transpose of the partitioned matrix [eq14] is [eq15]

A proof follows.

Proof

Let us first prove the result for the matrix in the example. Suppose that: 1) and have $J_{1}$ rows; 2) and have $J_{2}$ rows; 3) and have $K_{1}$ columns; 4) and have $K_{2}$ columns. Then, we can define the -th entry of as [eq16] By the definition of transpose, we have that the -th entry of $M^{ op }$ is Therefore, [eq18] We can easily check that this case-by-case definition corresponds to [eq15] The proofs for block matrices having different partitions (i.e., different numbers of horizontal and vertical cuts) are similar (the case-by-case definitions of the matrices change based on the number of cuts).

Solved exercises

Below you can find some exercises with explained solutions.

Exercise 1

Define the block matrix [eq20] where is an identity matrix and is a matrix of zeros. Compute the product $MM^{ op }$ .

Solution

We have that the transpose of is [eq21] and the product is [eq22]

Exercise 2

Define the block matrix [eq23] How is the transpose $M^{ op }$ structured?

Solution

The transpose of is [eq24]

How to cite

Please cite as:

Taboga, Marco (2021). "Properties of block matrices", Lectures on matrix algebra. https://www.statlect.com/matrix-algebra/properties-of-block-matrices.