Incompleteness

Theories and Computability

Reading preferences

Optional display controls need JavaScript. All reading content and navigation work without it.

Source file content/incompleteness/theories-computability/theories-computability.tex

Editorial

This chapter depends on material in the chapter on computability theory, but can be left out if that hasn't been covered. It's currently a basic conversion of Jeremy Avigad's notes, has not been revised, and is missing exercises.

Source file content/incompleteness/theories-computability/introduction.tex

Introduction

Editorial

This section should be rewritten.

We have the following:

  1. A definition of what it means for a function to be representable in Q\Th{Q}source (the definition of representability of a function in Q)

  2. a definition of what it means for a relation to be representable in Q\Th{Q}source (the definition of representability of a relation in Q)

  3. a theorem asserting that the representable functions of Q\Th{Q}source are exactly the computable ones (the theorem that a function is representable in Q exactly when it is computable)

  4. a theorem asserting that the representable relations of Q\Th{Q}source are exactly the computable ones the theorem characterizing computable relations by representability in Q)

A em theory is a set of sentences that is deductively closed, that is, with the property that whenever TTsource proves A!Asource then A!Asource is in TTsource. It is probably best to think of a theory as being a collection of sentences, together with all the things that these sentences imply. From now on, we will use Q\Th{Q}source to refer to the em theory consisting of the set of sentences derivable from the eight axioms in the introduction to representability in Q and its eight axioms. Remember that we can code formula of Q\Th{Q}source as numbers; if A!Asource is such a formula, let #A#\Gn{!A}source denote the number coding A!Asource. Modulo this coding, we can now ask whether various sets of formulas are computable or not.

Source file content/incompleteness/theories-computability/q-is-ce.tex

Q\Th{Q}source is c.e.-Complete

Q is computably enumerable complete

Q\Th{Q}source is c.e. but not decidable. In fact, it is a complete c.e. set.

Proof

It is not hard to see that Q\Th{Q}source is c.e., since it is the set of (codes for) sentences yysource such that there is a proof xxsource of yysource in Q\Th{Q}source:

Q={y:xPrfQ(x,y)}.Q = \Setabs{y}{\lexists[x][\Prf[\Th{Q}](x,y)]}.source

But we know that PrfQ(x,y)\Prf[\Th{Q}](x,y)source is computable (in fact, primitive recursive), and any set that can be written in the above form is c.e.

Saying that it is a complete c.e.\ set is equivalent to saying that KmQK \leq_m Qsource, where K={x:Ax(x)}K = \Setabs{x}{!A_x(x) \downarrow}source. So let us show that KKsource is reducible to Q\Th{Q}source. Since Kleene's predicate T(e,x,s)T(e,x,s)source is primitive recursive, it is representable in Q\Th{Q}source, say, by AT!A_Tsource. Then for every xxsource, we have

xKsT(x,x,s)s(QAT(x¯,x¯,s¯))QsAT(x¯,x¯,s).x \in K & \lif \lexists[s][T(x,x,s)] \\ & \lif \lexists[s][(\Th{Q} \Proves !A_T(\num x,\num x, \num s))] \\ & \lif \Th{Q} \Proves \lexists[s][!A_T(\num x, \num x, s)].source

Conversely, if QsAT(x¯,x¯,s)\Th{Q} \Proves \lexists[s][!A_T(\num x, \num x, s)]source, then, in fact, for some natural number nnsource the formula AT(x¯,x¯,n¯)!A_T(\num x, \num x, \num n)source must be true. Now, if T(x,x,n)T(x,x,n)source were false, Q\Th{Q}source would prove ¬AT(x¯,x¯,n¯)\lnot !A_T(\num x, \num x, \num n)source, since AT!A_Tsource represents TTsource. But then Q\Th{Q}source proves a false formula, which is a contradiction. So T(x,x,n)T(x,x,n)source must be true, which implies Ax(x)!A_x(x) \downarrowsource.

In short, we have that for every xxsource, xxsource is in KKsource if and only if Q\Th{Q}source proves sT(x¯,x¯,s)\lexists[s][T(\num x,\num x,s)]source. So the function ffsource which takes xxsource to (a code for) the sentence sT(x¯,x¯,s)\lexists[s][T(\num x, \num x, s)]source is a reduction of KKsource to Q\Th{Q}source.

Source file content/incompleteness/theories-computability/oconsis-ext-of-q-undec.tex

ω\omegasource-Consistent Extensions of Q\Th{Q}source are Undecidable

Explain

The proof that Q\Th{Q}source is c.e.-complete relied on the fact that any sentence provable in Q\Th{Q}source is “true” of the natural numbers. The next definition and theorem strengthen this theorem, by pinpointing just those aspects of “truth” that were needed in the proof above. Don't dwell on this theorem too long, though, because we will soon strengthen it even further. We include it mainly for historical purposes: Gödel's original paper used the notion of ω\omegasource-consistency, but his result was strengthened by replacing ω\omegasource-consistency with ordinary consistency soon after.

Definition of omega consistency

A theory T\Th{T}source is ω\omegasource-consistent if the following holds: if xA(x)\lexists[x][!A(x)]source is any sentence and T\Th{T}source proves ¬A(0¯)\lnot !A(\num 0)source, ¬A(1¯)\lnot !A(\num 1)source, ¬A(2¯)\lnot !A(\num 2)source, dots then T\Th{T}source does not prove xA(x)\lexists[x][!A(x)]source.

Omega consistent extensions of Q are undecidable

Let T\Th{T}source be any ω\omegasource-consistent theory that includes Q\Th{Q}source. Then T\Th{T}source is not decidable.

Proof

If T\Th{T}source includes Q\Th{Q}source, then T\Th{T}source represents the computable functions and relations. We need only modify the previous proof. As above, if xKx \in Ksource, then T\Th{T}source proves sAT(x¯,x¯,s)\lexists[s][!A_T(\num x,\num x, s)]source. Conversely, suppose T\Th{T}source proves sAT(x¯,x¯,s)\lexists[s][!A_T(\num x, \num x, s)]source. Then xxsource must be in KKsource: otherwise, there is no halting computation of machine xxsource on input xxsource; since AT!A_Tsource represents Kleene's TTsource relation, T\Th{T}source proves ¬AT(x¯,x¯,0¯)\lnot !A_T(\num x, \num x, \num 0)source, ¬AT(x¯,x¯,1¯)\lnot !A_T(\num x, \num x, \num 1)source, dots, making T\Th{T}source ω\omegasource-inconsistent.

Source file content/incompleteness/theories-computability/extensions-of-q-not-decidable.tex

Consistent Extensions of Q\Th{Q}source are Undecidable

Explain

Remember that a theory is consistent if it does not prove both A!Asource and ¬A\lnot !Asource for any formula A!Asource. Since anything follows from a contradiction, an inconsistent theory is trivial: every sentence is provable. Clearly, if a theory if ω\omegasource-consistent, then it is consistent. But being consistent is a weaker requirement (i.e., there are theories that are consistent but not ω\omegasource-consistent.). We can weaken the assumption in the preceding definition of omega consistency to simple consistency to obtain a stronger theorem.

There is no universal computable binary relation

There is no “universal computable relation.” That is, there is no binary computable relation R(x,y)R(x,y)source, with the following property: whenever S(y)S(y)source is a unary computable relation, there is some kksource such that for every yysource, S(y)S(y)source is true if and only if R(k,y)R(k,y)source is true.

Proof

Suppose R(x,y)R(x,y)source is a universal computable relation. Let S(y)S(y)source be the relation ¬R(y,y)\lnot R(y,y)source. Since S(y)S(y)source is computable, for some kksource, S(y)S(y)source is equivalent to R(k,y)R(k,y)source. But then we have that S(k)S(k)source is equivalent to both R(k,k)R(k,k)source and ¬R(k,k)\lnot R(k,k)source, which is a contradiction.

Consistent extensions of Q are undecidable

Let T\Th{T}source be any consistent theory that includes Q\Th{Q}source. Then T\Th{T}source is not decidable.

Proof

Suppose T\Th{T}source is a consistent, decidable extension of Q\Th{Q}source. We will obtain a contradiction by using T\Th{T}source to define a universal computable relation.

Let R(x,y)R(x,y)source hold if and only if

xxsource codes a formula D(u)!D(u)source, and T\Th{T}source proves D(y¯)!D(\num y)source.

Since we are assuming that T\Th{T}source is decidable, RRsource is computable. Let us show that RRsource is universal. If S(y)S(y)source is any computable relation, then it is representable in Q\Th{Q}source (and hence T\Th{T}source) by a formula DS(u)!D_S(u)source. Then for every nnsource, we have

S(n¯)TDS(n¯)R(#DS(u)#,n)S(\num n) & \lif & T \vdash !D_S(\num n) \\ & \lif & R(\Gn{!D_S(u)}, n)source

and

¬S(n¯)T¬DS(n¯)TDS(n¯)(since T is consistent)¬R(#DS(u)#,n).\lnot S(\num n) & \lif & T \vdash \lnot !D_S(\num n) \\ & \lif & T \not\vdash !D_S(\num n) \quad \text{(since $\Th{T}$ is consistent)} \\ & \lif & \lnot R(\Gn{!D_S(u)}, n).source

That is, for every yysource, S(y)S(y)source is true if and only if R(#DS(u)#,y)R(\Gn{!D_S(u)}, y)source is. So RRsource is universal, and we have the contradiction we were looking for.

Let “true arithmetic” be the theory {A:A}\Setabs{!A}{ \Sat{\Nat}{!A}}source, that is, the set of sentences in the language of arithmetic that are true in the standard interpretation.

True arithmetic is undecidable

True arithmetic is not decidable.

Source file content/incompleteness/theories-computability/computably-axiomatizable.tex

axiomatizable Theories

A theory T\Th{T}source is said to be axiomatizable if it has a computable set of axioms AAsource. (Saying that AAsource is a set of axioms for T\Th{T}source means T={A:AA}T = \Setabs{!A}{A \Proves !A}source.) Any “reasonable” axiomatization of the natural numbers will have this property. In particular, any theory with a finite set of axioms is axiomatizable.

Computably axiomatizable theories are computably enumerable

Suppose T\Th{T}source is axiomatizable. Then T\Th{T}source is computably enumerable.

Proof

Suppose AAsource is a computable set of axioms for T\Th{T}source. To determine if AT!A \in Tsource, just search for a derivation of A!Asource from the axioms.

Put slightly differently, A!Asource is in T\Th{T}source if and only if there is a finite list of axioms B1!B_1source, dots, Bk!B_ksource in AAsource and a derivation of (B1Bk)A(!B_1 \land \dots \land !B_k) \lif !Asource in first-order logic. But we already know that any set with a definition of the form “there exists dots such that dots” is c.e., provided the second “dots” is computable.

Source file content/incompleteness/theories-computability/complete-decidable.tex

axiomatizable Complete Theories are Decidable

A theory is said to be em complete if for every sentence A!Asource, either A!Asource or ¬A\lnot !Asource is provable.

Complete computably axiomatizable theories are decidable

Suppose a theory T\Th{T}source is complete and axiomatizable. Then T\Th{T}source is decidable.

Proof

Suppose T\Th{T}source is complete and AAsource is a computable set of axioms. If T\Th{T}source is inconsistent, it is clearly computable. (Algorithm: “just say yes.”) So we can assume that T\Th{T}source is also consistent.

To decide whether or not a sentence A!Asource is in T\Th{T}source, simultaneously search for a derivation of A!Asource from T\Th{T}source and a derivation of ¬A\lnot !Asource. Since T\Th{T}source is complete, you are bound to find one or the other; and since T\Th{T}source is consistent, if you find a derivation of ¬A\lnot !Asource, there is no derivation of A!Asource.

Put in different terms, we already know that T\Th{T}source is c.e.; so by a theorem we proved before, it suffices to show that the complement of T\Th{T}source is c.e. also. But a formula A!Asource is in T¯\Th{\bar T}source if and only if ¬A\lnot !Asource is in T\Th{T}source; so T¯mT\Th{\bar T} \leq_m \Th{T}source.

Source file content/incompleteness/theories-computability/first-incompleteness.tex

Q\Th{Q}source has no Complete, Consistent, Axiomatizable Extensions

First incompleteness theorem from undecidability

There is no complete, consistent, axiomatizable extension of Q\Th{Q}source.

Proof

We already know that there is no consistent, decidable extension of Q\Th{Q}source. But if T\Th{T}source is complete and axiomatized, then it is decidable.

Explain

This theorems is not that far from Gödel's original 1931 formulation of the First Incompleteness Theorem. Aside from the more modern terminology, the key differences are this: Gödel has “ω\omegasource-consistent” instead of “consistent”; and he could not say “axiomatizable” in full generality, since the formal notion of computability was not in place yet. (The formal models of computability were developed over the following decade, including by Gödel, and in large part to be able to characterize the kinds of theories that are susceptible to the Gödel phenomenon.)

The theorem says you can't have it all, namely, completeness, consistency, and axiomatizability. If you give up any one of these, though, you can have the other two: Q\Th{Q}source is consistent and computably axiomatized, but not complete; the inconsistent theory is complete, and computably axiomatized (say, by {00}\{ \eq/[0][0] \}source), but not consistent; and the set of true sentence of arithmetic is complete and consistent, but it is not computably axiomatized.

Source file content/incompleteness/theories-computability/inseparability.tex

Sentences Provable and Refutable in Q\Th{Q}source are Computably Inseparable

Let Q¯\Th{\bar Q}source be the set of sentences whose em negations are provable in Q\Th{Q}source, i.e., Q¯={A:Q¬A}\Th{\bar Q} = \Setabs{!A}{\Th{Q} \Proves \lnot !A}source. Remember that disjoint sets AAsource and BBsource are said to be computably inseparable if there is no computable set CCsource such that ACA \subseteq Csource and BC¯B \subseteq \Complement{C}source.

Provable and refutable sentences of Q are computably inseparable

Q\Th{Q}source and Q¯\Th{\bar Q}source are computably inseparable.

Proof

Suppose CCsource is a computable set such that QC\Th{Q} \subseteq Csource and Q¯C¯\Th{\bar Q} \subseteq \Complement{C}source. Let R(x,y)R(x,y)source be the relation

xxsource codes a formula D(u)!D(u)source and D(y¯)!D(\num y)source is in CCsource.

We will show that R(x,y)R(x,y)source is a universal computable relation, yielding a contradiction.

Suppose S(y)S(y)source is computable, represented by DS(u)!D_S(u)source in Q\Th{Q}source. Then

S(n¯)QDS(n¯)DS(n¯)CS(\num n) & \lif & \Th{Q} \Proves !D_S(\num n) \\ & \lif & !D_S(\num n) \in Csource

and

¬S(n¯)Q¬DS(n¯)DS(n¯)Q¯DS(n¯)C\lnot S(\num n) & \lif & \Th{Q} \Proves \lnot !D_S(\num n) \\ & \lif & !D_S(\num n) \in \Th{\bar Q} \\ & \lif & !D_S(\num n) \not\in Csource

So S(y)S(y)source is equivalent to R(#(DS(u¯)),y)R(\#(!D_S(\num u)),y)source.

Source file content/incompleteness/theories-computability/consis-with-q.tex

Theories Consistent with Q\Th{Q}source are Undecidable

The following theorem says that not only is Q\Th{Q}source undecidable, but, in fact, any theory that does not disagree with Q\Th{Q}source is undecidable.

Theories consistent with Q are undecidable

Let T\Th{T}source be any theory in the language of arithmetic that is consistent with Q\Th{Q}source (i.e., TQ\Th{T} \cup \Th{Q}source is consistent). Then T\Th{T}source is undecidable.

Proof

Remember that Q\Th{Q}source has a finite set of axioms, Q1!Q_1source, dots, Q8!Q_8source. We can even replace these by a single axiom, E=Q1Q8!E = !Q_1 \land \dots \land !Q_8source.

Suppose T\Th{T}source is a decidable theory consistent with Q\Th{Q}source. Let

C={A:TEA}.C = \Setabs{!A}{\Th{T} \Proves !E \lif !A}.source

We show that CCsource would be a computable separation of Q\Th{Q}source and Q¯\Th{\bar Q}source, a contradiction. First, if A!Asource is in Q\Th{Q}source, then A!Asource is provable from the axioms of Q\Th{Q}source; by the deduction theorem, there is a derivation of EA!E \lif !Asource in first-order logic. So A!Asource is in CCsource.

On the other hand, if A!Asource is in Q¯\Th{\bar Q}source, then there is a proof of E¬A!E \lif \lnot !Asource in first-order logic. If T\Th{T}source also proves EA!E \lif !Asource, then T\Th{T}source proves ¬E\lnot !Esource, in which case TQ\Th{T} \cup \Th{Q}source is inconsistent. But we are assuming TQ\Th{T} \cup \Th{Q}source is consistent, so T\Th{T}source does not prove EA!E \lif !Asource, and so A!Asource is not in CCsource.

We've shown that if A!Asource is in Q\Th{Q}source, then it is in CCsource, and if A!Asource is in Q¯\Th{\bar Q}source, then it is in C¯\Complement{C}source. So CCsource is a computable separation, which is the contradiction we were looking for.

This theorem is very powerful. For example, it implies:

Undecidability of first order logic in the arithmetic language

First-order logic for the language of arithmetic (that is, the set {A:A is provable in first-order logic}\Setabs{!A}{\text{$!A$ is provable in first-order logic}}source) is undecidable.

Proof

First-order logic is the set of consequences of \emptysetsource, which is consistent with Q\Th{Q}source.

Source file content/incompleteness/theories-computability/interpretability.tex

Theories in which Q\Th{Q}source is Interpretable are Undecidable

We can strengthen these results even more. Informally, an interpretation of a language L1\Lang{L_1}source in another language L2\Lang{L_2}source involves defining the universe, relation symbols, and function symbols of L1\Lang{L_1}source with formulas in L2\Lang{L_2}source. Though we won't take the time to do this, one can make this definition precise.

Undecidability through interpretation of arithmetic

Suppose T\Th{T}source is a theory in a language in which one can interpret the language of arithmetic, in such a way that T\Th{T}source is consistent with the interpretation of Q\Th{Q}source. Then T\Th{T}source is undecidable. If T\Th{T}source proves the interpretation of the axioms of Q\Th{Q}source, then no consistent extension of T\Th{T}source is decidable.

The proof is just a small modification of the proof of the last theorem; one could use a counterexample to get a separation of Q\Th{Q}source and Q¯\Th{\bar Q}source. One can take ZFC\Th{ZFC}source, Zermelo--Fraenkel set theory with the axiom of choice, to be an axiomatic foundation that is powerful enough to carry out a good deal of ordinary mathematics. In ZFC\Th{ZFC}source one can define the natural numbers, and via this interpretation, the axioms of Q\Th{Q}source are true. So we have

Source corollary concerning extensions of Z F C

There is no decidable extension of ZFC\Th{ZFC}source.

Incompleteness for computably axiomatizable extensions of Z F C

There is no complete, consistent, computably axiomatizable extension of ZFC\Th{ZFC}source.

The language of ZFC\Th{ZFC}source has only a single binary relation, \insource. (In fact, you don't even need equality.) So we have

Undecidability with a binary relation symbol

First-order logic for any language with a binary relation symbol is undecidable.

This result extends to any language with two unary function symbols, since one can use these to simulate a binary relation symbol. The results just cited are tight: it turns out that first-order logic for a language with only unary relation symbols and at most one unary function symbol is decidable.

One more bit of trivia. We know that the set of sentences in the language 0\Obj 0source, 'source, ++source, ×\timessource, <<source true in the standard model is undecidable. In fact, one can define <<source in terms of the other symbols, and then one can define ++source in terms of ×\timessource and 'source. So the set of true sentences in the language 0\Obj 0source, 'source, ×\timessource is undecidable. On the other hand, Presburger has shown that the set of sentences in the language 0\Obj 0source, 'source, ++source true in the language of arithmetic is decidable. The procedure is computationally infeasible, however.

Source disclosures