Determinants
In the first chapter we highlighted the special case of linear systems with the same number of equations as unknowns, those of the form where is a square matrix. We noted that there are only two kinds of ’s. If is associated with a unique solution for any , such as for the homogeneous system , then is associated with a unique solution for every such . We call such a matrix nonsingular. The other kind of , where every linear system for which it is the matrix of coefficients has either no solution or infinitely many solutions, we call singular.
In our work since then this distinction has been a theme. For instance, we now know that an matrix is nonsingular if and only if each of these holds:
any system has a solution and that solution is unique;
Gauss-Jordan reduction of yields an identity matrix;
the rows of form a linearly independent set;
the columns of form a linearly independent set, a basis for ;
any map that represents is an isomorphism;
an inverse matrix exists.
So when we look at a square matrix, one of the first things that we ask is whether it is nonsingular.
This chapter develops a formula that determines whether is nonsingular. More precisely, we will develop a formula for matrices, one for matrices, etc. These are naturally related; that is, we will develop a family of formulas, a scheme that describes the formula for each size.
Since we will restrict the discussion to square matrices, in this chapter we will often simply say ‘matrix’ in place of ‘square matrix’.
Definition
Determining nonsingularity is trivial for matrices.
Corollary Three.IV.4.11 gives the formula.
We can produce the formula as we did the prior one, although the computation is intricate (see Exercise 1.10).
With these cases in mind, we posit a family of formulas: , , etc. For each the formula defines a determinant function such that an matrix is nonsingular if and only if . (We usually omit the subscript because the size of describes which determinant function we mean.)
Exploration
This subsection is an optional motivation and development of the general definition. The definition is in the next subsection.
Above, in each case the matrix is nonsingular if and only if some formula is nonzero. But the three formulas don’t show an obvious pattern. We may spot that the term has one letter, that the terms and have two letters, and that the terms each have three letters. We may even spot that in those terms there is a letter from each row and column of the matrix, e.g., in the term one letter comes from each row and from each column.
But these observations are perhaps more puzzling than enlightening. For instance, we might wonder why some terms are added but some are subtracted.
A good strategy for solving problems is to explore which properties the solution must have, and then search for something with those properties. So we shall start by asking what properties we’d like the determinant formulas to have.
At this point, our main way to decide whether a matrix is singular or not is to do Gaussian reduction and then check whether the diagonal of the echelon form matrix has any zeroes, that is, whether the product down the diagonal is zero. So we could guess that whatever determinant formula we find, the proof that it is right may involve applying Gauss’s Method to the matrix to show that in the end the product down the diagonal is zero if and only if our formula gives zero.
This suggests a plan: we will look for a family of determinant formulas that are unaffected by row operations and such that the determinant of an echelon form matrix is the product of its diagonal entries. In the rest of this subsection we will test this plan against the and formulas. In the end we will have to modify the “unaffected by row operations” part, but not by much.
First we check whether the and formulas are unaffected by the row operation of combining: if
then is ? This check of the determinant after the operation
shows that it is indeed unchanged, and the other combination gives the same result. Likewise, the combination leaves the determinant unchanged
as do the other row combination operations.
So there seems to be promise in the plan. Of course, perhaps if we had worked out the determinant formula and tested it then we might have found that it is affected by row combinations. This is an exploration and we do not yet have all the facts. Nonetheless, so far, so good.
Next we compare with for row swaps. Here we hit a snag: the row swap does not yield .
And this swap inside of a matrix
also does not give the same determinant as before the swap since again there is a sign change. Trying a different swap
also gives a change of sign.
So row swaps appear in this experiment to change the sign of a determinant. This does not wreck our plan entirely. We hope to decide nonsingularity by considering only whether the formula gives zero, not by considering its sign. Therefore, instead of expecting determinant formulas to be entirely unaffected by row operations we modify our plan so that on a swap they will change sign.
Obviously we finish by comparing with for the operation of multiplying a row by a scalar. This
ends with the entire determinant multiplied by , and the other case has the same result. This case ends the same way
as do the other two cases. These make us suspect that multiplying a row by multiplies the determinant by . As before, this modifies our plan but does not wreck it. We are asking only that the zero-ness of the determinant formula be unchanged, not focusing on the its sign or magnitude.
So in this exploration our plan got modified in some inessential ways and is now: we will look for determinant functions that remain unchanged under the operation of row combination, that change sign on a row swap, that rescale on the rescaling of a row, and such that the determinant of an echelon form matrix is the product down the diagonal. In the next two subsections we will see that for each there is one and only one such function.
Finally, for the next subsection note that factoring out scalars is a row-wise operation: here
the comes only out of the top row only, leaving the other rows unchanged. Consequently in the definition of determinant we will write it as a function of the rows , rather than as or as a function of the entries .
Exercises
Exercise 1.3 Supplied answer
Recommended. Verify that the determinant of an upper-triangular matrix is the product down the diagonal.
Do lower-triangular matrices work the same way?
Answer. For the first, apply the formula in this section, note that any term with a , , or is zero, and simplify. Lower-triangular matrices work the same way.
Exercise 1.4 Supplied answer
Recommended. Use the determinant to decide if each is singular or nonsingular.
Answer.
Nonsingular, the determinant is .
Nonsingular, the determinant is .
Singular, the determinant is .
Exercise 1.5 Supplied answer
Singular or nonsingular? Use the determinant to decide.
Answer.
Nonsingular, the determinant is .
Singular, the determinant is .
Singular, the determinant is .
Exercise 1.6 Supplied answer
Recommended. Each pair of matrices differ by one row operation. Use this operation to compare with .
,
,
,
Exercise 1.7 Supplied answer
Recommended. Find the determinant of this matrix by following the plan: perform Gauss’s Method and look for the determinant to remain unchanged on a row combination, to change sign on a row swap, to rescale on the rescaling of a row, and such that the determinant of the echelon form matrix is the product down its diagonal.
Answer. Gauss’s Method does this.
The echelon form matrix has a product down the diagonal of . In the course of Gauss’s Method no rows got rescaled but there was a row swap, so to get the determinant we change the sign, giving .
Exercise 1.8 Supplied answer
Show this.
Answer. Using the formula for the determinant of a matrix we expand the left side
and by distributing we expand the right side.
Now we can just check that the two are equal. (Remark. This is the case of Vandermonde’s determinant which arises in applications).
Exercise 1.10 Supplied answer
Do the Gaussian reduction to check the formula for matrices stated in the preamble to this section.
is nonsingular iff
Answer. We first reduce the matrix to echelon form. To begin, assume that and that .
This step finishes the calculation.
Now assuming that and , the original matrix is nonsingular if and only if the entry above is nonzero. That is, under the assumptions, the original matrix is nonsingular if and only if , as required.
We finish by running down what happens if the assumptions that were taken for convenience in the prior paragraph do not hold. First, if but then we can swap
and conclude that the matrix is nonsingular if and only if either or . The condition ‘ or ’ is equivalent to the condition ‘’. Multiplying out and using the case assumption that to substitute for gives this.
Since , we have that the matrix is nonsingular if and only if . Therefore, in this and case, the matrix is nonsingular when .
The remaining cases are routine. Do the but case and the and but case by first swapping rows and then going on as above. The , , and case is easy—that matrix is singular since the columns form a linearly dependent set, and the determinant comes out to be zero.
Exercise 1.11 Supplied answer
Show that the equation of a line in through and is given by this determinant.
Answer. Figuring the determinant and doing some algebra gives this.
Note that this is the equation of a line (in particular, in contains the familiar expression for the slope), and note that and satisfy it.
Exercise 1.12 Supplied answer
Many people have learned this mnemonic for the determinant of a matrix: copy the first two columns to the right side of the matrix, then take the products down the forward diagonals and add them together, and then take the products on the backward diagonals and subtract them. That is, first write
and then calculate this.
Check that this agrees with the formula given in the preamble to this section.
Does it extend to other-sized determinants?
Answer.
The comparison with the formula given in the preamble to this section is easy.
While it holds for matrices
it does not hold for matrices. An example is that this matrix is singular because the second and third rows are equal
but following the scheme of the mnemonic does not give zero.
Exercise 1.13 Supplied answer
The cross product of the vectors
is the vector computed as this determinant.
Note that the first row’s entries are vectors, the vectors from the standard basis for . Show that the cross product of two vectors is perpendicular to each vector.
Answer. The determinant is . To check perpendicularity, we check that the dot product with the first vector is zero
and the dot product with the second vector is also zero.
Exercise 1.14 Supplied answer
Prove that each statement holds for matrices.
The determinant of a product is the product of the determinants .
If is invertible then the determinant of the inverse is the inverse of the determinant .
Matrices and are similar if there is a nonsingular matrix such that . (We shall look at this relationship in Chapter Five.) Show that similar matrices have the same determinant.
Answer.
Plug and chug: the determinant of the product is this
while the product of the determinants is this.
Verification that they are equal is easy.
Use the prior item.
That similar matrices have the same determinant is immediate from the above two: .
Exercise 1.15 Supplied answer
Recommended. Prove that the area of this region in the plane
is equal to the value of this determinant.
Compare with this.
Answer. One way is to count these areas
by taking the area of the entire rectangle and subtracting the area of the upper-left rectangle, the upper-middle triangle, the upper-right triangle, the lower-left triangle, the lower-middle triangle, and the lower-right rectangle . Simplification gives the determinant formula.
This determinant is the negative of the one above; the formula distinguishes whether the second column is counterclockwise from the first.
Exercise 1.16 Supplied answer
Prove that for matrices, the determinant of a matrix equals the determinant of its transpose. Does that also hold for matrices?
Answer. The computation for matrices, using the formula quoted in the preamble, is easy. It does also hold for matrices; the computation is routine.
Exercise 1.17 Supplied answer
Is the determinant function linear —is ?
Answer. No. We illustrate with the determinant. Recall that constants come out one row at a time.
This contradicts linearity (here we didn’t need , i.e., we can take to be the matrix of zeros).
Exercise 1.18 Supplied answer
Show that if is then for any scalar .
Answer. Bring out the ’s one row at a time.
Exercise 1.19 Supplied answer
Which real numbers make
singular? Explain geometrically.
Answer. There are no real numbers that make the matrix singular because the determinant of the matrix is never , it equals for all . Geometrically, with respect to the standard basis, this matrix represents a rotation of the plane through an angle of . Each such map is one-to-one —for one thing, it is invertible.
Exercise 1.20 Supplied answer
Puzzle. [Am. Math. Mon., Apr. 1955] If a third order determinant has elements , , …, , what is the maximum value it may have?
Answer. This is how the answer was given in the cited source. Let be the sum of the three positive terms of the determinant and the sum of the three negative terms. The maximum value of is
The minimum value of consistent with is
Any change in would result in lowering that sum by more than . Therefore the maximum value for the determinant and one form for the determinant is
Properties of Determinants
We want a formula to determine whether an matrix is nonsingular. We will not begin by stating such a formula. Instead we will begin by considering, for each , the function that such a formula calculates. We will define this function by a list of properties. We will then prove that a function with these properties exists and is unique, and also describe how to compute it. (Because we will eventually prove this, from the start we will just say ‘’ instead of ‘if there is a unique determinant function then ’.)
Definition 2.1 A determinant is a function such that
for
for
for any scalar
where is an identity matrix
(the ’s are the rows of the matrix). We often write for .
Remark 2.2 Condition (2) is redundant since
swaps rows and . We have listed it for consistency with the Gauss’s Method presentation in earlier chapters.
Remark 2.3 Condition (3) does not have a restriction, although the Gauss’s Method operation of multiplying a row by does have it. The next result shows that we do not need that restriction here.
Lemma 2.4 A matrix with two identical rows has a determinant of zero. A matrix with a zero row has a determinant of zero. A matrix is nonsingular if and only if its determinant is nonzero. The determinant of an echelon form matrix is the product down its diagonal.
Proof To verify the first sentence swap the two equal rows. The sign of the determinant changes but the matrix is the same and so its determinant is the same. Thus the determinant is zero.
For the second sentence multiply the zero row by two. That doubles the determinant but it also leaves the row unchanged, and hence leaves the determinant unchanged. Thus the determinant must be zero.
Do Gauss-Jordan reduction for the third sentence, . By the first three properties the determinant of is zero if and only if the determinant of is zero (although the two could differ in sign or magnitude). A nonsingular matrix Gauss-Jordan reduces to an identity matrix and so has a nonzero determinant. A singular reduces to a with a zero row; by the second sentence of this lemma its determinant is zero.
The fourth sentence has two cases. If the echelon form matrix is singular then it has a zero row. Thus it has a zero on its diagonal and the product down its diagonal is zero. By the third sentence of this result the determinant is zero and therefore this matrix’s determinant equals the product down its diagonal.
If the echelon form matrix is nonsingular then none of its diagonal entries is zero. This means that we can divide by those entries and use condition (3) to get ’s on the diagonal.
Then the Jordan half of Gauss-Jordan elimination leaves the identity matrix.
So in this case also, the determinant is the product down the diagonal.
QED
That gives us a way to compute the value of a determinant function on a matrix: do Gaussian reduction, keeping track of any changes of sign caused by row swaps and any scalars that we factor out, and finish by multiplying down the diagonal of the echelon form result. This algorithm is as fast as Gauss’s Method and so is practical on all of the matrices that we will see.
Example 2.5 Doing determinants with Gauss’s Method
doesn’t give a big time savings because the determinant formula is easy. However, a determinant is often easier to calculate with Gauss’s Method than with its formula.
Example 2.6 Determinants bigger than go quickly with the Gauss’s Method procedure.
That example raises an important point. This chapter’s introduction gives formulas for and determinants, so we know that they exist, but not for determinant functions on matrices that are or larger. Instead, Definition 2.1 gives properties that a determinant function should have and leads to computing determinants by Gauss’s Method.
However, for any matrix we can reduce it to echelon form by Gauss’s Method in multiple ways. For example, given a reduction we could change it by inserting a first step that multiplies the top row by and then a second step that multiplies it by . So we have to worry that two different Gauss’s Method reductions could lead to two different computed values for the determinant.
That is, we must verify that Definition 2.1 gives a well-defined function. The next two subsections do this, showing that there exists a well-defined function satisfying the definition.
But first we show that if there is such a function then there is no more than one. The example above illustrates the idea: we got by following the properties of the definition. So while we have not yet proved that exists, that there is a function with properties (1) – (4), if such a function satisfying them does exist then we know what value it gives on the above matrix.
Lemma 2.7 For each , if there is an determinant function then it is unique.
Proof Suppose that there are two functions satisfying the properties of Definition 2.1 and its consequence Lemma 2.4. Given a square matrix , fix some way of performing Gauss’s Method to bring the matrix to echelon form (it does not matter that there are multiple ways, just fix one of them). By using this fixed reduction as in the above examples— keeping track of row-scaling factors and how the sign alternates on row swaps, and then multiplying down the diagonal of the echelon form result— we can compute the value that these two functions must return on , and they must return the same value. Since they give the same output on every input, they are the same function.
QED
The ‘if there is an determinant function’ emphasizes that, although we can use Gauss’s Method to compute the only value that a determinant function could possibly return, we haven’t yet shown that such a function exists for all . The rest of this section does that.
Exercises
For these, assume that an determinant function exists for all .
Exercise 2.8 Supplied answer
Recommended. Find each determinant by performing one row operation.
Answer.
Do to get echelon form, and then multiply down the diagonal. The determinant is .
Swapping the second and third rows brings the system to echelon form (and changes the sign of the determinant). Multiplying down the diagonal gives , so the determinant of the given matrix is .
Exercise 2.11 Supplied answer
For which values of does this system have a unique solution?
Answer. When is the determinant not zero?
Obviously, gives nonsingularity and hence a nonzero determinant. If then we get echelon form with a combination.
Multiplying down the diagonal gives . Thus the matrix has a nonzero determinant, and so the system has a unique solution, if and only if .
Exercise 2.12 Supplied answer
Recommended. Express each of these in terms of .
Answer.
Condition (2) of the definition of determinants applies via the swap .
Condition (3) applies.
Exercise 2.13 Supplied answer
Recommended. Find the determinant of a diagonal matrix.
Answer. A diagonal matrix is in echelon form, so the determinant is the product down the diagonal.
Exercise 2.14 Supplied answer
Describe the solution set of a homogeneous linear system if the determinant of the matrix of coefficients is nonzero.
Answer. It is the trivial subspace.
Exercise 2.15 Supplied answer
Recommended. Show that this determinant is zero.
Answer. Adding the second row to the first gives a matrix whose first row is times its third row.
Exercise 2.16 Supplied answer
Find the , , and matrices with entry given by .
Find the determinant of the square matrix with entry .
Answer.
, ,
The determinant in the case is . In every other case the second row is the negative of the first, and so matrix is singular and the determinant is zero.
Exercise 2.17 Supplied answer
Find the , , and matrices with entry given by .
Find the determinant of the square matrix with entry .
Answer.
, ,
The and cases yield these.
And matrices with are singular, e.g.,
because twice the second row minus the first row equals the third row. Checking this is routine.
Exercise 2.18 Supplied answer
Recommended. Show that determinant functions are not linear by giving a case where .
Answer. This one
is easy to check.
By the way, this also gives an example where scalar multiplication is not preserved .
Exercise 2.19 Supplied answer
The second condition in the definition, that row swaps change the sign of a determinant, is somewhat annoying. It means we have to keep track of the number of swaps, to compute how the sign alternates. Can we get rid of it? Can we replace it with the condition that row swaps leave the determinant unchanged? (If so then we would need new , , and formulas, but that would be a minor matter.)
Answer. No, we cannot replace it. Remark 2.2 shows that the four conditions after the replacement would conflict —no function satisfies all four.
Exercise 2.20 Supplied answer
Prove that the determinant of any triangular matrix, upper or lower, is the product down its diagonal.
Answer. A upper-triangular matrix is in echelon form.
A lower-triangular matrix is either singular or nonsingular. If it is singular then it has a zero on its diagonal and so its determinant (namely, zero) is indeed the product down its diagonal. If it is nonsingular then it has no zeroes on its diagonal, and we can reduce it by Gauss’s Method to echelon form without changing the diagonal.
Exercise 2.21 Supplied answer
Refer to the definition of elementary matrices in the Mechanics of Matrix Multiplication subsection.
What is the determinant of each kind of elementary matrix?
Prove that if is any elementary matrix then for any appropriately sized .
(This question doesn’t involve determinants.) Prove that if is singular then a product is also singular.
Show that .
Show that if is nonsingular then .
Answer.
The properties in the definition of determinant show that , , and .
The three cases are easy to check by recalling the action of left multiplication by each type of matrix.
If is invertible then the associative property of matrix multiplication shows that is invertible. So if is not invertible then neither is .
If is singular then apply the prior answer: and . If is not singular then we can write it as a product of elementary matrices .
Exercise 2.22 Supplied answer
Prove that the determinant of a product is the product of the determinants in this way. Fix the matrix and consider the function given by .
Check that satisfies condition (1) in the definition of a determinant function.
Check condition (2).
Check condition (3).
Check condition (4).
Conclude the determinant of a product is the product of the determinants.
Answer.
We must show that if
then . We will be done if we show that combining rows first and then multiplying to get gives the same result as multiplying first to get and then combining (because the determinant is unaffected by the combination so we’ll then have , and hence ). That argument runs: after adding times row of to row of , the entry is , which is the entry of .
We need only show that swapping and then multiplying to get gives the same result as multiplying by and then swapping (because, as the determinant changes sign on the row swap, we’ll then have , and so ). That argument runs just like the prior one.
Not surprisingly by now, we need only show that multiplying a row by a scalar and then computing gives the same result as first computing and then multiplying the row by (as the determinant is rescaled by the multiplication, we’ll have , so ). The argument runs just as above.
Clear.
Because we’ve shown that is a determinant and that determinant functions (if they exist) are unique, we have that so .
Exercise 2.23 Supplied answer
A submatrix of a given matrix is one that we get by deleting some of the rows and columns of . Thus, the first matrix here is a submatrix of the second.
Prove that for any square matrix, the rank of the matrix is if and only if is the largest integer such that there is an submatrix with a nonzero determinant.
Answer. We will first argue that a rank matrix has a submatrix with nonzero determinant. A rank matrix has a linearly independent set of rows. A matrix made from those rows will have row rank and thus has column rank . Conclusion: from those rows we can extract a linearly independent set of columns, and so the original matrix has a submatrix of rank .
We finish by showing that if is the largest such integer then the rank of the matrix is . We need only show, by the maximality of , that if a matrix has a submatrix of nonzero determinant then the rank of the matrix is at least . Consider such a submatrix. Its rows are parts of the rows of the original matrix, clearly the set of whole rows is linearly independent. Thus the row rank of the original matrix is at least , and the row rank of a matrix equals its rank.
Exercise 2.24 Supplied answer
Prove that a matrix with rational entries has a rational determinant.
Answer. A matrix with only rational entries reduces with Gauss’s Method to an echelon form matrix using only rational arithmetic. Thus the entries on the diagonal must be rationals, and so the product down the diagonal is rational.
Exercise 2.25 Supplied answer
Puzzle. [Am. Math. Mon., Feb. 1953] Find the element of likeness in (a) simplifying a fraction, (b) powdering the nose, (c) building new steps on the church, (d) keeping emeritus professors on campus, (e) putting , , in the determinant
Answer. This is how the answer was given in the cited source. The value of the determinant is independent of the values , , . Hence operation (e) does not change the value of the determinant but merely changes its appearance. Thus the element of likeness in (a), (b), (c), (d), and (e) is only that the appearance of the principle entity is changed. The same element appears in (f) changing the name-label of a rose, (g) writing a decimal integer in the scale of , (h) gilding the lily, (i) whitewashing a politician, and (j) granting an honorary degree.
The Permutation Expansion
The prior subsection defines a function to be a determinant if it satisfies four conditions and shows that there is at most one determinant function for each . What is left is to show that for each such a function exists.
But, we easily compute determinants: we use Gauss’s Method, keeping track of the sign changes from row swaps, and end by multiplying down the diagonal. How could they not exist?
The difficulty is to show that the computation gives a well-defined—that is, unique—result. Consider these two Gauss’s Method reductions of the same matrix, the first without any row swap
and the second with one.
Both yield the determinant since in the second one we note that the row swap changes the sign of the result we get by multiplying down the diagonal. The fact that we are able to proceed in two ways opens the possibility that the two give different answers. That is, the way that we have given to compute determinant values does not plainly eliminate the possibility that there might be, say, two reductions of some matrix that lead to different determinant values. In that case we would not have a function, since the definition of a function is that for each input there must be exactly associated one output. The rest of this section shows that the definition Definition 2.1 never leads to a conflict.
To do this we will define an alternative way to find the value of a determinant. (This alternative is less useful in practice because it is slow. But it is very useful for theory.) The key idea is that condition (3) of Definition 2.1 shows that the determinant function is not linear.
Example 3.1 With condition (3) scalars come out of each row separately,
not from the entire matrix at once. So, where
then (instead, ).
Since scalars come out a row at a time we might guess that determinants are linear a row at a time.
Definition 3.2 Let be a vector space. A map is multilinear if
for and .
Lemma 3.3 Determinants are multilinear.
Proof Property (2) here is just Definition 2.1’s condition (3) so we need only verify property (1).
There are two cases. If the set of other rows is linearly dependent then all three matrices are singular and so all three determinants are zero and the equality is trivial.
Therefore assume that the set of other rows is linearly independent. We can make a basis by adding one more vector . Express and with respect to this basis
and add.
Consider the left side of (1) and expand .
By the definition of determinant’s condition (1), the value of () is unchanged by the operation of adding to the -th row . The -th row becomes this.
Next add , etc., to eliminate all of the terms from the other rows. Apply condition (3) from the definition of determinant.
Now this is a sum of two determinants. To finish, bring and back inside in front of the ’s and use row combinations again, this time to reconstruct the expressions of and in terms of the basis. That is, start with the operations of adding to and to , etc., to get the expansions of and .
QED
Multilinearity allows us to expand a determinant into a sum of determinants, each of which involves a simple matrix.
Example 3.4 Use property (1) of multilinearity to break up the first row
and then use (1) again to break each along the second row.
The result is four determinants. In each row of each of the four there is a single entry from the original matrix.
Example 3.5 In the same way, a determinant separates into a sum of many simpler determinants. Splitting along the first row produces three determinants (we have highlighted the zero in the position to set it off visually from the zeroes that appear as part of the splitting).
In turn, each of the above splits in three along the second row. Then each of the nine splits in three along the third row. The result is twenty seven determinants, such that each row contains a single entry from the starting matrix.
So multilinearity will expand an determinant into a sum of -many determinants, where each row of each determinant contains a single entry from the starting matrix.
In this expansion, although there are lots of terms, most of them have a determinant of zero.
Example 3.6 In each of these examples from the prior expansion, two of the entries from the original matrix are in the same column.
For instance, in the first matrix the and the both come from the first column of the original matrix. In the second matrix the and both come from the third column. And in the third matrix the and both come from the third column. Any such matrix is singular because one row is a multiple of the other. Thus any such determinant is zero, by Lemma 2.4.
With that observation the above expansion of the determinant into the sum of the twenty seven determinants simplifies to the sum of these six where the entries from the original matrix come one per row, and also one per column.
In that expansion we can bring out the scalars.
To finish, evaluate those six determinants by row-swapping them to the identity matrix, keeping track of the sign changes.
That example captures this subsection’s new calculation scheme. Multilinearity expands a determinant into many separate determinants, each with one entry from the original matrix per row. Most of these have one row that is a multiple of another so we omit them. We are left with the determinants that have one entry per row and column from the original matrix. Factoring out the scalars further reduces the determinants that we must compute to the one-entry-per-row-and-column matrices where all entries are ’s.
Recall Definition Three.IV.3.14, that a permutation matrix is square, with entries ’s except for a single in each row and column. We now introduce a notation for permutation matrices.
Definition 3.7 An -permutation is a function on the first positive integers that is one-to-one and onto.
In a permutation each number , …, appears as output for one and only one input. We can denote a permutation as a sequence .
Example 3.8 The -permutations are the functions given by , , and given by , . The sequence notation is shorter: and .
Example 3.9 In the sequence notation the -permutations are , , , , , and .
We denote the row vector that is all ’s except for a in entry with so that the four-wide is . Now our notation for permutation matrices is: with any associate the matrix whose rows are , …, . For instance, associated with the -permutation is the matrix whose rows are the corresponding ’s.
Example 3.10 These are the permutation matrices for the -permutations listed in Example 3.8.
For instance, ’s first row is and its second is .
Example 3.11 Consider the -permutation . The permutation matrix has rows , , and .
Definition 3.12 The permutation expansion for determinants is
where are all of the -permutations.
We can restate the formula in summation notation
read aloud as, “the sum, over all permutations , of terms having the form .”
Example 3.13 The familiar determinant formula follows from the above
as does the formula.
Computing a determinant with the permutation expansion typically takes longer than with Gauss’s Method. However, we will use it to prove that the determinant function exists. The proof is long so we will just state the result here and defer the proof to the following subsection.
Theorem 3.14 For each there is an determinant function.
Also in the next subsection is the proof of the next result (they are together because the two proofs overlap).
Theorem 3.15 The determinant of a matrix equals the determinant of its transpose.
Because of this theorem, while we have so far stated determinant results in terms of rows, all of the results also hold in terms of columns.
Corollary 3.16 A matrix with two equal columns is singular. Column swaps change the sign of a determinant. Determinants are multilinear in their columns.
Proof For the first statement, transposing the matrix results in a matrix with the same determinant, and with two equal rows, and hence a determinant of zero. Prove the other two in the same way.
QED
We finish this subsection with a summary: determinant functions exist, are unique, and we know how to compute them. As for what determinants are about, perhaps these lines [Kemp] help make it memorable.
Determinant none,
Solution: lots or none.
Determinant some,
Solution: just one.
Exercises
This summarizes our notation for the - and -permutations.
Exercise 3.17 Supplied answer
Recommended. For this matrix, find the term associated with each -permutation.
That is, fill in the rest of this table.
permutation term Exercise 3.18 Supplied answer
Recommended. For each -permutation find .
Answer. We can swap each to the identity matrix. If the number of swaps is even then it’s determinant is , while if the number of swaps is odd then the determinant is
permutation number of swaps Remark. In that table we simply swapped until we found a number that brought us back to ‘’. But is a different number of swaps possible? If one person found swaps and another found that would be OK, since both give a determinant of . But if we can swap in two different ways and one of them is even and one is odd then that would be a problem. The next section shows that a mix of even and odd is not possible.
Exercise 3.19 Supplied answer
This determinant is by the formula. Compute it with the permutation expansion.
Exercise 3.20 Supplied answer
This determinant is because the first two rows add to the third. Compute the determinant using the permutation expansion.
Exercise 3.21 Supplied answer
Recommended. Compute the determinant by using the permutation expansion.
Exercise 3.22 Supplied answer
Recommended. Compute these both with Gauss’s Method and the permutation expansion formula.
Answer.
Gauss’s Method gives this
and permutation expansion gives this.
Gauss’s Method gives this
and the permutation expansion gives this.
Exercise 3.23 Supplied answer
Recommended. Use the permutation expansion formula to derive the formula for determinants.
Exercise 3.24 Supplied answer
List all of the -permutations.
Answer. This is all of the permutations where
the ones where
the ones where
and the ones where .
Exercise 3.25 Supplied answer
A permutation, regarded as a function from the set to itself, is one-to-one and onto. Therefore, each permutation has an inverse.
Find the inverse of each -permutation.
Find the inverse of each -permutation.
Answer. Each of these is easy to check.
permutation inverse permutation inverse
Exercise 3.26 Supplied answer
Prove that is multilinear if and only if for all and , this holds.
Answer. For the ‘if’ half, the first condition of Definition 3.2 follows from taking and the second condition follows from taking .
The ‘only if’ half also routine. From the first condition of Definition 3.2 gives and the second condition, applied twice, gives the result.
Exercise 3.27 Supplied answer
How would determinants change if we changed property (4) of the definition to read that ?
Answer. They would all double.
Exercise 3.28 Supplied answer
Verify the second and third statements in Corollary 3.16.
Answer. For the second statement, given a matrix, transpose it, swap rows, and transpose back. The result is swapped columns, and the determinant changes by a factor of . The third statement is similar: given a matrix, transpose it, apply multilinearity to what are now rows, and then transpose back the resulting matrices.
Exercise 3.29 Supplied answer
Recommended. Show that if an matrix has a nonzero determinant then we can express any column vector as a linear combination of the columns of the matrix.
Answer. An matrix with a nonzero determinant has rank so its columns form a basis for .
Exercise 3.30 Supplied answer
[Strang 80] True or false: a matrix whose entries are only zeros or ones has a determinant equal to zero, one, or negative one.
Exercise 3.31 Supplied answer
Show that there are terms in the permutation expansion formula of a matrix.
How many are sure to be zero if the entry is zero?
Answer.
For the column index of the entry in the first row there are five choices. Then, for the column index of the entry in the second row there are four choices. Continuing, we get . (See also the next question.)
Once we choose the second column in the first row, we can choose the other entries in ways.
Exercise 3.33 Supplied answer
Show that the inverse of a permutation matrix is its transpose.
Answer. [Schmidt] We will show that ; the argument is similar. The entry of is the sum of terms of the form where the entries of are denoted with ’s, that is, . Thus the entry of is the sum . But is usually , and so is usually . The only time is nonzero is when it is , but then there are no other such that is nonzero ( is the only row with a in column ). In other words,
and this is exactly the formula for the entries of the identity matrix.
Exercise 3.34 Supplied answer
A matrix is skew-symmetric if , as in this matrix.
Show that skew-symmetric matrices with nonzero determinants exist only for even .
Answer. In the exponent must be even.
Exercise 3.35 Supplied answer
Recommended. What is the smallest number of zeros, and the placement of those zeros, needed to ensure that a matrix has a determinant of zero?
Answer. Showing that no placement of three zeros suffices is routine. Four zeroes does suffice; put them all in the same row or column.
Exercise 3.36 Supplied answer
If we have data points and want to find a polynomial passing through those points then we can plug in the points to get an equation/ unknown linear system. The matrix of coefficients for that system is the Vandermonde matrix. Prove that the determinant of the transpose of that matrix of coefficients
equals the product, over all indices with , of terms of the form . (This shows that the determinant is zero, and the linear system has no solution, if and only if the ’s in the data are not distinct.)
Answer. The case shows what to do. The row combination operations of and give this.
Then the row combination operation of gives the desired result.
Exercise 3.37 Supplied answer
We can divide a matrix into blocks, as here,
which shows four blocks, the square and ones in the upper left and lower right, and the zero blocks in the upper right and lower left. Show that if a matrix is such that we can partition it as
where and are square, and and are all zeroes, then .
Answer. Let be , let be , and let be . Apply the permutation expansion formula
Because the upper right of is all zeroes, if a has at least one of among its first column numbers then the term arising from is (e.g., if then is ). So the above formula reduces to a sum over all permutations with two halves: first rearrange and after that comes a permutation of . To see this gives , distribute.
Exercise 3.38 Supplied answer
Prove that for any matrix there are at most distinct reals such that the matrix has determinant zero (we shall use this result in Chapter Five).
Answer. The case shows what happens.
Each term in the permutation expansion has three factors drawn from entries in the matrix (e.g., and ), and so the determinant is expressible as a polynomial in of degree . Such a polynomial has at most roots.
In general, the permutation expansion shows that the determinant is a sum of terms, each with factors, giving a polynomial of degree . A polynomial of degree has at most roots.
Exercise 3.39 Supplied answer
Puzzle. [Math. Mag., Jan. 1963, Q307] The nine positive digits can be arranged into arrays in ways. Find the sum of the determinants of these arrays.
Answer. This is how the answer was given in the cited source. When two rows of a determinant are interchanged, the sign of the determinant is changed. When the rows of a three-by-three determinant are permuted, positive and negative determinants equal in absolute value are obtained. Hence the determinants fall into groups, each of which sums to zero.
Exercise 3.40 Supplied answer
[Math. Mag., Jan. 1963, Q237] Show that
Answer. This is how the answer was given in the cited source. When the elements of any column are subtracted from the elements of each of the other two, the elements in two of the columns of the derived determinant are proportional, so the determinant vanishes. That is,
Exercise 3.41 Supplied answer
Puzzle. [Am. Math. Mon., Jan. 1949] Let be the sum of the integer elements of a magic square of order three and let be the value of the square considered as a determinant. Show that is an integer.
Answer. This is how the answer was given in the cited source. Let
have magic sum . Then
and . Hence, adding rows and columns,
Exercise 3.42 Supplied answer
Puzzle. [Am. Math. Mon., Jun. 1931] Show that the determinant of the elements in the upper left corner of the Pascal triangle
has the value unity.
Answer. This is how the answer was given in the cited source. Denote by the determinant in question and by the element in the -th row and -th column. Then from the law of formation of the elements we have
Subtract each row of from the row following it, beginning the process with the last pair of rows. After the subtractions the above equality shows that the element is replaced by the element , and all the elements in the first column, except , become zeroes. Now subtract each column from the one following it, beginning with the last pair. After this process the element is replaced by , as shown in the above relation. The result of the two operations is to replace by , and to reduce each element in the first row and in the first column to zero. Hence and consequently
Determinants Exist
This subsection contains proofs of two results from the prior subsection. It is optional. We will use the material developed here only in the Jordan Canonical Form subsection, which is also optional.
We wish to show that for any size , the determinant function on matrices is well-defined. The prior subsection develops the permutation expansion formula.
This reduces the problem of showing that the determinant is well-defined to only showing that the determinant is well-defined on the set of permutation matrices.
A permutation matrix can be row-swapped to the identity matrix. So one way that we can calculate its determinant is by keeping track of the number of swaps. However, we still must show that the result is well-defined. Recall what the difficulty is: the determinant of
could be computed with one swap
or with three.
Both reductions have an odd number of swaps so in this case we figure that but if there were some way to do it with an even number of swaps then we would have the determinant giving two different outputs from a single input. Below, Corollary 4.5 proves that this cannot happen— there is no permutation matrix that can be row-swapped to an identity matrix in two ways, one with an even number of swaps and the other with an odd number of swaps.
Definition 4.1 In a permutation , elements such that are in an inversion of their natural order. Similarly, in a permutation matrix two rows
such that are in an inversion.
Example 4.2 This permutation matrix
has a single inversion, that precedes .
Example 4.3 There are three inversions here:
precedes , precedes , and precedes .
Lemma 4.4 A row-swap in a permutation matrix changes the number of inversions from even to odd, or from odd to even.
Proof Consider a swap of rows and , where .
If the two rows are adjacent
then since inversions involving rows not in this pair are not affected, the swap changes the total number of inversions by one, either removing or producing one inversion depending on whether or not. Consequently, the total number of inversions changes from odd to even or from even to odd.
If the rows are not adjacent then we can swap them via a sequence of adjacent swaps, first bringing row up
and then bringing row down.
Each of these adjacent swaps changes the number of inversions from odd to even or from even to odd. The total number of swaps is odd. Thus, in aggregate, the number of inversions changes from even to odd, or from odd to even.
QED
Corollary 4.5 If a permutation matrix has an odd number of inversions then swapping it to the identity takes an odd number of swaps. If it has an even number of inversions then swapping to the identity takes an even number.
Proof The identity matrix has zero inversions. To change an odd number to zero requires an odd number of swaps, and to change an even number to zero requires an even number of swaps.
QED
Example 4.6 The matrix in Example 4.3 can be brought to the identity with one swap . (So the number of swaps needn’t be the same as the number of inversions, but the oddness or evenness of the two numbers is the same.)
Definition 4.7 The signum of a permutation is if the number of inversions in is odd and is if the number of inversions is even.
Example 4.8 Using the notation for the -permutations from Example 3.8 we have
so because there are no inversions, while because there is one.
We still have not shown that the determinant function is well-defined because we have not considered row operations on permutation matrices other than row swaps. We will finesse this issue. Define a function by altering the permutation expansion formula, replacing with .
The advantage of this formula is that the number of inversions is clearly well-defined—just count them. Therefore, we will be finished showing that an determinant function exists when we show that satisfies the conditions in the definition of a determinant.
Lemma 4.9 The function above is a determinant. Hence determinant functions exist for every .
Proof We must check that it satisfies the four conditions from the definition of determinant, Definition 2.1.
Condition (4) is easy: where is the identity, in
all of the terms in the summation are zero except for the one where the permutation is the identity, which gives the product down the diagonal, which is one.
For condition (3) suppose that and consider .
Factor out to get the desired equality.
For (2) suppose that . We must show that is the negative of .
We will show that each term in () is associated with a term in , and that the two terms are negatives of each other. Consider the matrix from the multilinear expansion of giving the term .
It is the result of the operation performed on this matrix.
That is, the term with hatted ’s is associated with this term from the expansion: , where the permutation equals but with the -th and -th numbers interchanged, and . The two terms have the same multiplicands , …, including the entries from the swapped rows and . But the two terms are negatives of each other since by Lemma 4.4.
Now, any permutation can be derived from some other permutation by such a swap, in one and only one way. Therefore the summation in () is in fact a sum over all permutations, taken once and only once.
Thus .
Finally, for condition (1) suppose that .
Distribute over the addition in .
Break it into two summations.
Recognize the second one.
Consider the terms . Notice the subscripts; the entry is , not . The sum of these terms is the determinant of a matrix that is equal to except that row of is a copy of row of , that is, has two equal rows. In the same way that we proved Lemma 2.4 we can see that : a swap of ’s equal rows will change the sign of but since the matrix is unchanged by that swap the value of must also be unchanged, and so that value must be zero.
QED
We have now proved that determinant functions exist for each size . We already know that for each size there is at most one determinant. Therefore, for each size there is one and only one determinant function.
We end this subsection by proving the other result remaining from the prior subsection.
Theorem 4.10 The determinant of a matrix equals the determinant of its transpose.
Proof The proof is best understood by doing the general case. That the argument applies to the case will be clear.
Compare the permutation expansion of the matrix
with the permutation expansion of its transpose.
Compare first the six products of ’s. The ones in the expansion of are the same as the ones in the expansion of the transpose; for instance, is in the top and is in the bottom. That’s perfectly sensible—the six in the top arise from all of the ways of picking one entry of from each row and column while the six in the bottom are all of the ways of picking one entry of from each column and row, so of course they are the same set.
Next observe that in the two expansions, each -product expression is not necessarily associated with the same permutation matrix. For instance, on the top is associated with the matrix for the map , , . On the bottom is associated with the matrix for the map , , . The second map is inverse to the first. This is also perfectly sensible—both the matrix transpose and the map inverse flip the to , flip the to , and flip to .
We finish by noting that the determinant of equals the determinant of , as Exercise 4.16 shows.
QED
Exercises
These summarize the notation used in this book for the - and -permutations.
Exercise 4.11 Supplied answer
Give the permutation expansion of a general matrix and its transpose.
Answer. This is the permutation expansion of the determinant of a matrix
and the permutation expansion of the determinant of its transpose.
As with the expansions described in the subsection, the permutation matrices from corresponding terms are transposes (although this is disguised by the fact that each is self-transpose).
Exercise 4.12 Supplied answer
Recommended. This problem appears also in the prior subsection.
Find the inverse of each -permutation.
Find the inverse of each -permutation.
Answer. Each of these is easy to check.
permutation inverse permutation inverse
Exercise 4.13 Supplied answer
Recommended.
Find the signum of each -permutation.
Find the signum of each -permutation.
Exercise 4.14 Supplied answer
Find the only nonzero term in the permutation expansion of this matrix.
Compute that determinant by finding the signum of the associated permutation.
Answer. To get a nonzero term in the permutation expansion we must use the entry and the entry. Having fixed on those two we must also use the entry and the entry. The signum of is because from
the two row swaps and will produce the identity matrix.
Exercise 4.15 Supplied answer
[Strang 80] What is the signum of the -permutation ?
Answer. The pattern is this.
… … So to find the signum of , we subtract one and look at the remainder on division by four. If the remainder is or then the signum is , otherwise it is . For , the number is divisible by four, so leaves a remainder of on division by four (more properly said, a remainder or ), and so the signum is . The case has a signum of , the case has a signum of and the case has a signum of .
Exercise 4.16 Supplied answer
Prove these.
Every permutation has an inverse.
Every permutation is the inverse of another.
Answer.
We can view permutations as maps that are one-to-one and onto. Any one-one and onto map has an inverse.
If it always takes an odd number of swaps to get from to the identity, then it always takes an odd number of swaps to get from the identity to (any swap is reversible).
This is the first question again.
Exercise 4.17 Supplied answer
Prove that the matrix of the permutation inverse is the transpose of the matrix of the permutation , for any permutation .
Answer. If then . The result now follows on the observation that has a in entry if and only if , and has a in entry if and only if ,
Exercise 4.18 Supplied answer
Recommended. Show that a permutation matrix with inversions can be row swapped to the identity in steps. Contrast this with Corollary 4.5.
Answer. This does not say that is the least number of swaps to produce an identity, nor does it say that is the most. It instead says that there is a way to swap to the identity in exactly steps.
Let be the first row that is inverted with respect to a prior row and let be the first row giving that inversion. We have this interval of rows.
Swap.
The second matrix has one fewer inversion because there is one fewer inversion in the interval ( vs. ) and inversions involving rows outside the interval are not affected.
Proceed in this way, at each step reducing the number of inversions by one with each row swap. When no inversions remain the result is the identity.
The contrast with Corollary 4.5 is that the statement of this exercise is a ‘there exists’ statement: there exists a way to swap to the identity in exactly steps. But the corollary is a ‘for all’ statement: for all ways to swap to the identity, the parity (evenness or oddness) is the same.
Exercise 4.19 Supplied answer
Recommended. For any permutation let be the integer defined in this way.
(This is the product, over all indices and with , of terms of the given form.)
Compute the value of on all -permutations.
Compute the value of on all -permutations.
Prove that is not .
Prove this.
Many authors give this formula as the definition of the signum function.
Answer.
First, is the product of the single factor and so . Second, is the product of the single factor and so .
permutation It is a product of nonzero terms.
Note that is negative if and only if and are in an inversion of their usual order.
References cited in this section
Am. Math. Mon., Apr. 1955
Vern Haggett (proposer), F. W. Saunders (solver), Elementary problem 1135, American Mathematical Monthly, vol. 62 no. 4 (Apr. 1955), p. 257.
Am. Math. Mon., Feb. 1953
Norman Anning (proposer), C. W. Trigg (solver), Elementary problem 1016, American Mathematical Monthly, vol. 60 no. 2 (Feb. 1953), p. 115.
Kemp
Franklin Kemp Linear Equations, American Mathematical Monthly, volume 89 number 8 (Oct. 1982), p. 608.
Strang 80
Gilbert Strang, Linear Algebra and its Applications, second edition, Harcourt Brace Jovanovich, 1980.
Schmidt
Jack Schmidt, http://math.stackexchange.com/a/98558/12012, 2012-Jan-12.
Math. Mag., Jan. 1963, Q307
C. W. Trigg (proposer). Quickie 307, Mathematics Magazine, volume 36 number 1 (Jan. 1963), p. 77.
Math. Mag., Jan. 1963, Q237
D. L. Silverman (proposer), C. W. Trigg (solver), Quickie 237, Mathematics Magazine, volume 36 number 1 (Jan. 1963).
Am. Math. Mon., Jan. 1949
C. W. Trigg (proposer), R. J. Walker (solver), Elementary problem 813, American Mathematical Monthly, vol. 56 no. 1 (Jan. 1949), p. 33.
Am. Math. Mon., Jun. 1931
C. A. Rupp (proposer), H. T. R. Aude (solver), problem 3468, American Mathematical Monthly, vol. 37 no. 6 (June-July 1931), p. 355.