Jump to content

WikiJournal of Science/Can each number be specified by a finite text?

From Wikiversity

WikiJournal of Science
Open access • Publication charge free • Public peer review • Wikipedia-integrated

WikiJournal of Science is an open-access, free-to-publish, Wikipedia-integrated academic journal for science, mathematics, engineering and technology topics. WJS WikiJSci Wiki.J.Sci. WikiJSci WikiSci WikiScience Wikiscience Wikijournal of Science Wikiversity Journal of Science WikiJournal Science Wikipedia Science Wikipedia science journal STEM Science Mathematics Engineering Technology Free to publish Open access Open-access Non-profit online journal Public peer review

<meta name='citation_doi' value='10.15347/WJS/2020.008'>

Article information

Author: Boris Tsirelson[a][i] 

See author information ▼
  1. Tel Aviv University (retired), † (deceased)
  1. boris.tsirelson@gmail.com

Abstract

Contrary to popular misconception, the question in the title is far from simple. It involves sets of numbers on the first level, sets of sets of numbers on the second level, and so on, endlessly. The infinite hierarchy of the levels involved distinguishes the concept of "definable number" from such notions as "natural number", "rational number", "algebraic number", "computable number" etc.


Introduction

The question in the title may seem simple, but is able to cause controversy and trip up professional mathematicians. Here is a quote from a talk "Must there be numbers we cannot describe or define?" [1] by J.D. Hamkins.

The math tea argument
Heard at a good math tea anywhere:
“There must be real numbers we cannot describe or define, because there are uncountably many real numbers, but only countably many definitions.”
Does this argument withstand scrutiny?

See also "Maybe there's no such thing as a random sequence" [2] by P.G. Doyle (in particular, on pages 6,7 note two excerpts from A. Tarski [42]). And on Wikipedia one can also find the flawed "math tea" argument on talk pages and obsolete versions of articles.[1] [2] And elsewhere on the Internet.[3] I, the author, was myself a witness and accomplice. I shared and voiced the flawed argument in informal discussions (but not articles or lectures). Despite some awareness (but not professionalism) in mathematical logic,[4] I was a small part of the problem, and now I try to become a small part of the solution, spreading the truth.

Careless handling of the concept "number specified by a finite text" leads to paradoxes; in particular, Richard's paradox.

Richard's paradox

The paradox begins with the observation that certain expressions of natural language define real numbers unambiguously, while other expressions of natural language do not. For example, "The real number the integer part of which is 17 and the th decimal place of which is 0 if is even and 1 if is odd" defines the real number 17.1010101... = 1693/99, while the phrase "the capital of England" does not define a real number.

Thus there is an infinite list of English phrases (such that each phrase is of finite length, but lengths vary in the list) that define real numbers unambiguously. We first arrange this list of phrases by increasing length, then order all phrases of equal length lexicographically (in dictionary order), so that the ordering is canonical. This yields an infinite list of the corresponding real numbers: Now define a new real number as follows. The integer part of is 0, the th decimal place of is 1 if the th decimal place of is not 1, and the th decimal place of is 2 if the th decimal place of is 1.

The preceding two paragraphs are an expression in English that unambiguously defines a real number Thus must be one of the numbers However, was constructed so that it cannot equal any of the This is the paradoxical contradiction.

(Quoted from Wikipedia.)


See also Definability paradoxes by Timothy Gowers.

In order to ask (and hopefully solve) a well-posed question we have to formalize the concept "number specified by a finite text" via a well-defined mathematical notion "definable number". What exactly is meant by "text"? And what exactly is meant by "number specified by text"? Does "specified" mean "defined"? Can we define such notions as "definition" and "definable"? Striving to understand definitions in general, let us start with some examples.

136 notable constants are collected, defined and discussed in the book "Mathematical constants" by Steven Finch [3]. The first member of this collection is "Pythagoras’ Constant, "; the second is "The Golden Mean, "; the third "The Natural Logarithmic Base, e"; the fourth "Archimedes’ Constant, "; and the last (eleventh) in Chapter 1 "Well-Known Constants" is "Chaitin’s Constant".

Each constant has several equivalent definitions. Below we take for each constant the first (main) definition from the mentioned book.

  • The first constant is defined as the positive real number whose product by itself is equal to 2. That is, the real number satisfying and
  • The second constant is defined as the real number satisfying and
  • The third constant is defined as the limit of as That is, the real number satisfying the following condition:
for every there exists such that for every satisfying and holds
The same condition in symbols:
logical notation

"and"      "or"      "implies"      "not"      "for every"      "there exists (at least one)"      "there exists one and only one"          (a longer list).


We note that these three definitions are of the form "the real number satisfying " where is a statement that may be true or false depending on the value of its variable ; in other words, not a statement when is just a variable, but a statement whenever a real number is substituted for the variable. Such is called a property of , or a predicate (on real numbers).

Not all predicates may be used this way. For example, we cannot say "the real number satisfying " (why "the"? two numbers satisfy, one positive, one negative), nor "the real number satisfying " (no such numbers). In order to say "the real number satisfying " we have to prove existence and uniqueness:

existence: (in words: there exists such that );
uniqueness: (in words: whenever and satisfy they are equal).

In this case one says "there is one and only one such x" and writes "".

The road to definable numbers passes through definable predicates. We postpone this matter to the next section and return to examples.

  • The fourth constant is defined as the area enclosed by a circle of radius 1.

This definition involves geometry. True, a lot of equivalent definitions in terms of numbers are well-known; in particular, according to the mentioned book, this area is equal to However, in general, every branch of mathematics may be involved in a definition of a number; existence of an equivalent definition in terms of (only) numbers is not guaranteed.

The last example is Chaitin's constant. In contrast to the four constants (mentioned above) of evident theoretical and practical importance, Chaitin's constant is rather of theoretical interest. Its definition is intricate. Here is a simplified version, sufficient for our purpose.[5]

  • The last constant is defined as the sum of the series where is equal to 1 if there exist natural numbers such that otherwise and is a polynomial in 10 variables, with integer coefficients, such that the sequence is uncomputable.

Hilbert’s tenth problem asked for a general algorithm that could ascertain whether the Diophantine equation has positive integer solutions given arbitrary polynomial with integer coefficients. It appears that no such algorithm can exist even for a single and arbitrary when is complicated enough. See Wikipedia: computability theory, Matiyasevich's theorem; and Scholarpedia:Matiyasevich theorem.

The five numbers are defined, thus, should be definable according to any reasonable approach to definability. The first four numbers are computable (both theoretically and practically; in fact, trillions, that is, millions of millions, of decimal digits of are already computed), but the last number is uncomputable. How so? Striving to better understand this strange situation we may introduce approximations to the numbers as follows: is equal to 1 if there exist natural numbers less than such that otherwise here is arbitrary. For each we have as that is, the sequence is increasing, and converges to Also, this sequence is computable (given just check all the points ). Now we introduce approximations to the number as follows: We have (as ), and the sequence is computable. A wonder: a computable increasing sequence of rational numbers converges to a uncomputable number!

For every there exists such that such depending on denote it and get moreover, for all In order to compute up to it suffices to compute Doesn't it mean that is computable? No, it does not, unless the sequence is computable. Well, these numbers need not be optimal, just large enough. Isn't large enough? Amazingly, no, this is not large enough. Moreover, is not enough. And even the "power tower" is still not enough!

Here is the first paragraph from a prize-winning article by Bjorn Poonen [4]:

Does the equation have a solution in integers? Yes: (3, 1, 1), for instance. How about Again yes, although this was not known until 1999: the smallest solution is (−283059965, −2218888517, 2220422932). And how about This is an unsolved problem.

Given that the simple Diophantine equation has solutions for but only beyond we may guess that the "worst case" Diophantine equation needs very large In fact, the sequence has to be uncomputable (otherwise would be computable, but it is not). Some computable sequences grow fantastically fast. See Wikipedia: "Ackermann function", "Fast-growing hierarchy". And nevertheless, no one of them bounds from above the sequence Reality beyond imagination!

Every computable number is definable, but a definable number need not be computable. Computability being another story, we return to definability.

From predicates to relations

Recall the five definitions mentioned in the introduction. They should be special cases of a general notion "definition". In order to formalize this idea we have to be more pedantic than in the introduction. "Nothing but the hard technical story is any real good" (Littlewood, A Mathematician's Miscellany, page 70); exercises are waiting for you.

All mathematical objects (real numbers, limits, sets etc.) are treated in the framework of the mainstream mathematics, unless stated otherwise. Alternative approaches are sometimes mentioned in Sections 9, 10. Naive set theory suffices for Sections 27; axiomatic set theory is used in Sections 810.

A definition is a text in a language. A straightforward formalization of such notions as "definition" and "definable" uses "formal language" (a formalization of "language") and other notions of model theory. Surprisingly, there is a shorter way. Operations on sets are used instead of logical symbols, and relations instead of predicates.

"However, predicates have many different uses and interpretations in mathematics and logic, and their precise definition, meaning and use will vary from theory to theory." (Quoted from Wikipedia.) Here we use predicates for informal explanations only; on the formal level they will be avoided (replaced with relations).

The number was defined as the real number such that where is the predicate " and ". This predicate is the conjunction of two predicates and the first being "", the second "". The single-element set corresponding to the predicate is the intersection of the sets and (Here and everywhere, is the set of all real numbers.)

set notation

  " is the set of all such that "        " belongs to "        union        intersection      set difference        Cartesian product        real line        Cartesian plane          and more, more, more.


This is instructive. In order to formalize a definition of a number via its defining property, we have to deal with sets of numbers, and more generally, relations between numbers.

Also, is the product and is the sum But what is "product", "sum", "" and ""? The answer is given by the axiomatic approach to real numbers: they are a complete totally ordered field. It means that addition, multiplication and order are defined and have the appropriate properties. Thus, 0 is defined as the real number satisfying the condition Similarly, is defined as the real number satisfying the condition

Now we need predicates with two and more variables. The order is a binary (that is, with two variables) predicate "". Addition is a ternary (that is, with three variables) predicate "". Similarly, multiplication is a ternary predicate "" (denoted also "" or "").

Each unary (that is, with one variable) predicate on real numbers leads to a set of real numbers, a subset of the real line Likewise, each binary predicate on reals leads to a set of pairs of real numbers, a subset of the Cartesian plane the latter being the Cartesian product of the real line by itself. On the other hand, a binary relation on is defined as an arbitrary subset of

Thus, each binary predicate on reals leads to a binary relation on reals. If we swap the variables, that is, turn to another predicate that is then we get another relation inverse (in other words, converse, or opposite) to the former relation (generally different, but sometimes the same).

Similarly, each ternary predicate on reals leads to a ternary relation on reals; and, changing the order of variables, we get ternary relations (generally, different) corresponding to 6 permutations of 3 variables. And generally, each n-ary predicate on reals leads to a n-ary relation on reals (a subset of ); and, changing the order of variables, we get such relations. The case is included (for unification); a unary relation on reals (called also property of reals) is a subset of

Thus, on reals, the order is the binary relation the addition is the ternary relation and the multiplication is the ternary relation Still, we cannot forget predicates until we understand how to construct new relations out of these basic relations. For example, how to construct the binary relation and the unary relation We know that if a predicate is the conjunction of two predicates, then it leads to the intersection of the corresponding sets. Similarly, the disjunction leads to the union , and the negation leads to the complement Also, the implication leads to and the equivalence leads to The same holds for n-ary predicates; the disjunction still corresponds to the union the negation to the complement etc. But what to do when is or is or is etc?

This question was answered, in context of axiomatic set theory, in the first half of the 20th century.[6] A somewhat different answer, in the context of definability, was given by van den Dries in 1998 [5], [6] and slightly modified by Auke Bart Booij in 2013 [7]; see also Macintyre 2016 [8, "Defining First-Order Definability"]. Here is the answer (slightly modified).

First, in addition to the Boolean operations (union and complement; intersection is superfluous, since it is complement of the union of complements) on subsets of we introduce permutation of coordinates; for example (), and in general,

where is an arbitrary permutation of

In particular, permutation of coordinates in a binary relation gives the inverse relation. For example, the inverse to is And, by the way, the intersection of these two is the relation (corresponding to the predicate "").

Second, set multiplication, in other words, Cartesian product by : that is,

turns a -ary relation to a relation that is formally -ary, but the last variable is unrelated to others.

Now, returning to a predicate of the form we treat the corresponding ternary relation as the intersection of two ternary relations and and as the Cartesian product of the binary relation by being inverse to the relation (corresponding to the given predicate ); and as obtained (by permutation of coordinates) from the Cartesian product (by ) of the relation corresponding to the given predicate

Third, the projection; for example (), and in general,

it turns a -ary relation to a -ary relation. For the set is also called the domain of the binary relation

Now, returning to a predicate of the form we rewrite it as "" and treat the corresponding binary relation as the projection of the ternary relation and as a permutation of the Cartesian product

What if is ""? Then we rewrite it as "" and get the complement of the projection of the complement of the relation corresponding to

So, we accept the 3 given relations (order, addition, multiplication) as "definable", and we accept the 5 operations (complement, union, permutation, set multiplication, projection) for producing definable relations out of other definable relations. Thus we get infinitely many definable relations (unary, binary, ternary and so on).

More formally, these relations are called "first-order definable (without parameters) over "; but, less formally, "definable over" is often replaced with "definable in" (and sometimes "definable from"); "without parameters" is omitted throughout this essay; also "first order" and "over " are often omitted in this section. See Wikipedia: Definable set: Definition; The field of real numbers.

Generally, starting from a set (not necessarily the real line) and some chosen relations on this set (including the equality relation if needed), and applying the 5 operations (complement, union, permutation, set multiplication, projection) repeatedly (in all possible combinations), one obtains an infinite collection of relations (unary, binary, ternary and so on) on the given set. Every such collection of relations is called a structure (Booij [7]), or a VDD-structure (Brian Tyrrell [9]) on the given set. According to Tyrrell [9, page 3], "The advantage of this definition is that no model theory is then needed to develop the theory". The technical term "VDD structure" (rather than just "structure" used by van den Dries and Booij) is chosen by Tyrrell "to prevent a notation clash" (Tyrrell [9, page 2]), since many other structures of different kinds are widely used in mathematics. "VDD" apparently refers to van den Dries who pioneered this approach. But let us take a shorter term "D-structure", where "D" refers to "definable" and "Dries" as well. The D-structure obtained (by the 5 operations) from the chosen relations, in other words, generated by these relations, is the smallest D-structure containing these relations.

Generality aside, we return to the special case, the D-structure of definable relations on the real line defined above (generated by order, addition and multiplication; though, the order appears to be superfluous).

  • Exercise 2.1. Prove that a relation is definable in if and only if it is definable in  Hint: if and only if

We say that a number is definable, if the single-element set is a definable unary relation.

  • Exercise 2.2. Prove that the numbers 0 and 1 are definable.  Hint: recall "" and "".
  • Exercise 2.3. Prove that the sum of two definable numbers is definable.  Hint:
  • Exercise 2.4. Prove that the number is definable.  Hint:
  • Exercise 2.5. Prove that the number is definable.  Hint:
  • Exercise 2.6. Prove that the golden ratio is definable.
  • Exercise 2.7. Prove that the binary relation "" is definable.  Hint:

In contrast, the ternary relation "" is not definable. Moreover, the binary relation is not definable. The problem is that all relations definable in are semialgebraic sets over (the subring of) integers.

Proofs

Theorem. All relations definable in are semialgebraic sets over integers.

Proof. The two relations "", "" are semialgebraic (evidently). Two operations, permutation and set multiplication, applied to semialgebraic relations, give semialgebraic relations (evidently). The third, projection operation, applied to a semialgebraic relation, gives a semialgebraic relation by the Tarski–Seidenberg theorem [10, Theorem 2.76].

Theorem. If and then the binary relation is not semialgebraic.

Proof. Assume the contrary. Then the function on being semialgebraic, must be algebraic [10, Prop. 2.86], [11, Corollary 3.5]). It means existence of a polynomial (not identically 0) such that for all It follows that for all complex numbers Taking we get for all integer Therefore for all complex (otherwise the polynomial cannot have infinitely many roots). Similarly, taking we get for all complex and all therefore everywhere; a contradiction.


Thus, we cannot define the number via in this framework. Also, only algebraic numbers are definable in this framework.

Each natural number is definable, which does not mean that the set of all natural numbers is definable (in ). In fact, it is not!

Proof

Follows immediately from the lemma below.

Lemma. For every semialgebraic subset of there exists such that either or

Proof. First, the claim holds for every set of the form where is a polynomial, since either as or as or is constant. Second, a Boolean operation (union, complement), applied to sets that satisfy the claim, gives a set that satisfies the claim (evidently).


We could accept the set of natural numbers as definable, that is, turn to definability in but does it help to define the number ? Surprisingly, it does! "[...] then the situation changes drastically" (van den Dries [5, Example 1.3]). See also Booij [7, page 17]: "[...] if we add the seemingly innocent set Z to the tame structure of semialgebraic sets, we get a wild structure [...]"

Beyond the algebraic

In this section, "definable" means "first order definable in ". In other words, the real line is endowed with the D-structure generated by addition, multiplication, and the set of natural numbers. Good news: we'll see that the five numbers discussed in Introduction, are definable. Bad news: in addition to their usual definitions we'll use Diophantine equations, computability and Matiyasevich's theorem (mentioned in Introduction in relation to Chaitin's constant). The reader not acquainted with computability theory should rely on intuitive idea of computation (instead of formal proofs of computability), and consult the linked Wikipedia article for computability-related notions ("recursively enumerable", "computable sequence"). Alternatively, the reader may skip to Section 5; there, usual definitions will apply, no computability needed.

Every Diophantine set

(where is a polynomial with integer coefficients), treated as a subset of is a definable n-ary relation. And every recursively enumerable set is Diophantine.

For every computable sequence of natural numbers, the binary relation is recursively enumerable, therefore definable.

In particular, the binary relation " and " is definable, as well as " and ". Now (at last!) the number is definable, via more formally, is the real number satisfying the condition

This is not quite the definition mentioned in Introduction, but equivalent to it.

Similarly, for every convergent computable sequence of rational numbers, its limit is a definable number. In other words, every limit computable real number is definable.

Every computable real number is limit computable, therefore definable. In particular, the number is computable, therefore definable.

Chaitin's constant is not computable, but still, limit computable (recall Introduction: it is the limit of a computable increasing sequence of rational numbers), therefore definable. So, all the five constants discussed in Introduction (taken from the book "Mathematical constants") are definable. Moreover, all the constants discussed in that book are definable.

On the other hand, if we choose a number between 0 and 1 at random, according to the uniform distribution, we almost surely get an undefinable number, because the definable numbers are a countable set.

Of course, such a randomly chosen undefinable number is not an explicit example of undefinable number. It may seem that "explicit example of undefinable number" is a patent nonsense, just as "defined undefinable number". But no, not quite nonsense, see Section 4.

An infinite sequence of real numbers is nothing but the binary relation if this binary relation is definable, we say that the sequence is definable. If a sequence is definable, then all its members are definable numbers. However, a sequence of definable numbers is generally not definable.

  • Exercise 3.1. If a definable sequence converges, then its limit is a definable number. Prove it.

A function is nothing but the binary relation "", that is, if this binary relation is definable, we say that the function is definable. An arbitrary binary relation is a function if and only if for every there exists one and only one such that

  • Exercise 3.2. If is a definable function and is a definable number, then is a definable number. Prove it.

However, a function that has definable values at all definable arguments is generally not definable.

  • Exercise 3.3. If a definable function is differentiable, then its derivative is a definable function. Prove it.  Hint: the derivative is the limit of...
  • Exercise 3.4. If a definable function is continuous, then its antiderivative is definable if and only if is a definable number. Prove it.  Hint:

Similarly to the number we can treat the exponential function First, the relation is definable (since is a computable function of ). Second, the relation is definable, since is the limit of as tends to infinity and tends to more formally (but still not completely formally...), if and only if

here is the set of integers (evidently definable).

The cosine function may be treated via complex numbers and Euler's formula First, the real part of the complex number is a computable function of Second, its limit as tends to infinity and tends to is equal to the real part of the complex number

Note that the exponential integral and the sine integral are definable nonelementary functions.

Definable functions can be pathological and disrespect dimension. In particular, there is a definable one-to-one correspondence between the (two-dimensional) square and a subset of the (one-dimensional) interval which will be used in Section 6. Here is a way to this fact.

Given two numbers we consider their decimal digits: where for each and the set is infinite (since we represent, say, as rather than ); and similarly We interweave their digits, getting a third number The ternary relation between such is a function Not all numbers of are of the form (for example, is not), which does not matter. It does matter that are uniquely determined by that is, implies In other words, is an injection

Denoting by the -th decimal digit of we have here is the integer part of and is the fractional part of

  • Exercise 3.5. The integer part function is definable. Prove it.  Hint:
  • Exercise 3.6. The function is definable. (See Booij [7, Lemma 3.4].) Prove it.  Hint:
  • Exercise 3.7. The function is definable. Prove it.  Hint:
  • Exercise 3.8. Generalize the previous exercise to  Hint: consider

Explicit example of undefinable number

We construct such example in two steps. First, we enumerate all numbers definable in ("first order" is meant but omitted, as before); that is, we construct a sequence of real numbers that contains all numbers definable in (and only such numbers). Second, we construct a real number not contained in this sequence.

The second step is well-known and simple, so let us do it now, for an arbitrary sequence of real numbers. We construct a real number via its decimal digits, as and we choose each to be different from the n-th digit (after the decimal point) of the absolute value of To be specific, let us take if for some integer and otherwise. Then since the integral part of being of the form for integer is different from the integral part of the latter being of the form for integer and (either or ). This is an instance of Cantor's diagonal argument.

Now we start constructing a sequence of real numbers that contains all numbers definable in (and only such numbers). These numbers being elements of single-element subsets of definable in and these subsets being unary relations, we enumerate all relations (unary, binary, ...) definable in These are obtained from the three given relations (addition, multiplication, "naturality") via the 5 operations (complement, union, permutation, set multiplication, projection) applied repeatedly. We may save on permutations by restricting ourselves to adjacent transpositions, that is, permutations that swap two adjacent numbers and leave intact other numbers of this is sufficient, since every permutation is a product of some adjacent transpositions. We start with the three given relations

"addition"
"multiplication"
"naturality"

and apply to them the five operations (whenever possible). The first operation "complement" gives

The "union" operation gives

The "permutation" operation (reduced to adjacent transpositions), applied to the ternary relation gives two relations namely, (equal to due to commutativity, but we do not bother) and we apply the same to getting Further, "set multiplication" gives the 4-ary relation

similarly and . The most remarkable "projection" operation gives

(in fact, ), and similarly

The first 16 relations are thus constructed. On the next iteration we apply the 5 operations to these 16 relations (whenever possible; though, some are superfluous) and get a longer finite list. And so on, endlessly. A bit cumbersome, but really, a routine exercise in programming, isn't it? Well, it is, provided however that the "programming language" stipulates the data type "relation over " and the relevant operations on relations. By the way, equality test for relations is not needed (unless we want to skip repetitions); but test of existence and uniqueness (for unary relations), and extraction of the unique element, are needed for the next step.

Now we are in position to construct for each we check, whether the relation is of the form for or not; if it is, we take otherwise (Note that whenever the relation is not unary.)

Applying the diagonal argument (above) to this sequence we construct a real number not contained in the sequence, therefore, not definable in

This number is defined, but not in Why not? Because the definition of involves a sequence of relations on Sequences of numbers are used in Section 3, but sequences of relations are something new, beyond the first order. (See Wikipedia: First-order logic, Second-order logic.)

Is there a better approach? Could we define in the same sequence or maybe another sequence containing all computable numbers, by a clever trick? No, this is impossible. For every sequence definable in the diagonal argument gives a number definable in and not contained in the given sequence.

Second order

We introduce second-order definability in The set of natural numbers is second-order definable in as we'll see soon. In contrast to the first order definability, usual definitions of mathematical constants will apply without recourse to computability and Diophantine sets.

A second-order predicate is a predicate that takes a first-order predicate as an argument. Likewise, a second-order relation is a relation between relations. For example, the binary relation between a function and its derivative may be thought of as a relation between two binary relations: first, the relation between real numbers and second, the relation between real numbers First order definability of a real number involves definable first-order relations (between real numbers). Second order definability of a real number involves definable second-order relations (between first-order relations). Here is a possible formalization of this idea.

We introduce the set

that contains, on one hand, all tuples (finite sequences) of real numbers (for all ; here we do not distinguish 1-tuples from real numbers), and on the other hand, all -ary relations on (for all ). Here is the set of all subsets (that is, the power set) of the real line in other words, of unary relations on is the set of all subsets (that is, the power set) of the Cartesian plane in other words, of binary relations on and so on. On this set we introduce two relations:

  • membership, the binary relation it says that the given -tuple belongs to the given -ary relation;
  • "appendment", the ternary relation it says that the latter tuple results from the former tuple by appending the given real number.

The two ternary relations on addition and multiplication, may be thought of as ternary relations on (since ):

  • addition:
  • multiplication:

We endow with the D-structure generated by the four relations (membership, appendment, addition, multiplication). All relations on that belong to this D-structure will be called second-order definable. In the rest of this section, "definable" means "second-order definable", unless stated otherwise.

  • Exercise 5.1. The set of all tuples and the set of all relations are definable subsets of Prove it.  Hint: first, the set of all tuples is where is the appendment relation; second, take the complement.
  • Exercise 5.2. The set of all real numbers is a definable subset of Prove it.  Hint: where is the appendment relation.
  • Exercise 5.3. Each is a definable subset of Prove it.  Hint: where is the appendment relation.
  • Exercise 5.4. The set of all sets of real numbers (that is, unary relations) is a definable subset of Prove it.  Hint: for we have apply the projection to
  • Exercise 5.5. For each the set of all -ary relations is a definable subset of Prove it.  Hint: similar to the previous exercise.
  • Exercise 5.6. If is a definable set of subsets of , then the union of all these subsets is a definable set (of real numbers). Prove it.  Hint: for we have take the projection of
  • Exercise 5.7. Do the same for the intersection  Hint: consider (But what if is empty?)
  • Exercise 5.8. Generalize the two exercises above to and so on.  Hint: now is a tuple.

In particular, taking a single-element set we see that definability of implies definability of The converse holds as well (see below).

  • Exercise 5.9. If a set (of real numbers) is definable, then the set (of all subsets of ) is definable. Prove it.  Hint: for we have consider
  • Exercise 5.10. Do the same for the set (of all supersets of ).  Hint: similarly to the previous exercise, consider
  • Exercise 5.11. Generalize the two exercises above to and so on.

Remark.   These 11 exercises (above) do not use addition and multiplication, nor any properties of real numbers. They generalize readily to a more general situation. One may start with an arbitrary set (rather than the real line ), consider the set constructed from as above (all tuples and all relations), endow by a D-structure such that the two relations on , membership and appendment, are definable, and generalize the 11 exercises to this case.

Taking the intersection of the set of subsets and the set of supersets we see that definability of implies definability of the single-element set (called singleton) So, is definable if and only if is definable. And still (by convention, as before) a real number is definable if and only if is definable.

Does it mean that, for example, numbers are definable (as well as every rational number and every algebraic number)? We know that they are first-order definable in does it follow that they are (second-order) definable in

The answer is affirmative, but needs a proof. Here we face another general question. Let be a set and its subset. Every -ary relation on is also a -ary relation on (since ). Thus, given some relations on we get two D-structures; first, the D-structure on generated by the given relations, and second, the D-structure on generated by the same relations.

Lemma.   Assume that is a definable subset of (according to the second D-structure). Then every relation on definable according to the first D-structure is also definable according to the second D-structure.

Proof

Denote the first D-structure by and the second by We know that It follows (via set multiplication) that and so on; by induction, for all Thus (via permutation),

In order to prove that we compare the five operations on relations (complement, union, permutation, set multiplication, projection) over (call them -operations) and over (-operations). We have to check that each -operation applied to relations on that belong to gives again a relation (on ) that belongs to

For the union we have nothing to check, since the -union of two relations is equal to their -union. Similarly, we have nothing to check for permutation and projection. Only set multiplication and complement need some attention.

Set multiplication. The -multiplication applied to gives We have since and

It follows (by induction) that for all

Complement. The -complement applied to gives We note that the -complement belongs to (since ), thus (since ).


Now we are in position to prove definability of the set of natural numbers. It is sufficient to prove definability of the set of all sets satisfying the two conditions and (since the intersection of all these is ). The complement is the projection of the intersection of two sets, and The former results from the (permuted) membership relation; the latter is the projection of the projection of this set being the intersection of three sets: first, second, times the addition relation; third, It follows that is definable, whence is definable.

This is instructive. In order to formalize a definition of a set via its defining property, we have to deal with sets of sets, and more generally, relations between sets.

Using again the lemma above we see that all real numbers first-order definable in are second-order definable. Section 3 gives many examples, including the five numbers discussed in Introduction. But second-order proofs of their definability are much more easy and natural.

The binary relation "" is the sequence of factorials, that is, the set It is definable, similarly to since it is the least subset of such that and Alternatively, it is definable since it is the only subset of with the following three properties: :

That is, the factorial is the only function satisfying the recurrence relation and the initial condition

  • Exercise 5.12. Partial sums of the series are a definable sequence. Prove it.
  • Exercise 5.13. The number is definable. Deduce it from the previous exercise.

In the first-order framework it is possible to treat many functions (for instance, the exponential function the sine and cosine functions the exponential integral and the sine integral ) and many relations between functions (for instance, derivative and antiderivative); arguments and values of these functions are arbitrary real numbers (not necessarily definable), but the functions are definable. Such notions as arbitrary functions (not necessarily definable), continuous functions (and their antiderivatives), differentiable functions (and their derivatives) need the second-order framework.

As was noted there, a function is nothing but the binary relation "", that is, An arbitrary binary relation is such a function if and only if for every there exists one and only one such that (existence and uniqueness). For functions defined on arbitrary subsets of the real line the condition is weaker: for every there exists at most one such that (uniqueness).

  • Exercise 5.14. (a) All satisfying the uniqueness condition are a definable subset of (b) the same holds for the existence and uniqueness condition. Prove it.
  • Exercise 5.15. All continuous functions are a definable subset of Prove it.
  • Exercise 5.16. All differentiable functions are a definable subset of Prove it.
  • Exercise 5.17. The binary relation "" is definable. That is, the set of all pairs of functions such that is a definable subset of (in other words, definable binary relation on ). Prove it.

Antiderivative can now be treated in full generality. In contrast, in the first-order framework it was treated via Riemann integral for continuous definable only. In particular, now the exponential function may be treated via where for accordingly, the constant may be treated via Alternatively, the exponential function may be treated via the differential equation (and initial condition ). Trigonometric functions may be treated via the differential equation accordingly, the constant may be treated as the least positive number such that Or, alternatively, as (via antiderivative).

This is instructive. In the second-order framework we may define functions (and infinite sequences) via their properties, irrespective of computability, Diophantine equations and other tricks of the first-order framework.

Nice; but what about second-order definable real numbers? Are they all first-order definable, or not? Even if obtained from complicated differential equations, they are computable, therefore, first-order definable in . Probably, our only chance to find a second-order definable but first-order undefinable number is, to prove that the explicit example of (first-order) undefinable number, given in Section 4, is second-order definable; and our only chance to prove this conjecture is, to formalize that section within the second-order framework.

First-order undefinable but second-order definable

Recall the infinite sequence of relations treated in Section 4. Is it second-order definable? Each belongs to the set (from Section 5); their infinite sequence is a binary relation between and (namely, the set of pairs ), thus, a special case of a binary relation on the question is, whether this relation is definable, or not. Like the sequence of factorials, it is defined by recursion. But factorials, being numbers, are first-order objects, which is why their sequence is second-order definable via its properties. In contrast, relations are second-order objects! Does it mean that third order is needed for defining their sequence by recursion?

True, the sequence of factorials is first-order definable (in ) due to its computability, via Matiyasevich's theorem. Could something like that be invented for second-order objects? Probably not.

Yet, these obstacles are surmountable. The sequence of relations may be replaced with a single relation by a kind of currying (or rather, uncurrying); the disjoint union may be used instead of the set of pairs Further, relations of different arities may be replaced with unary relations (subsets of the real line), since two real numbers may be encoded into a single real number via an appropriate definable injection and the same applies to three and more numbers (moreover, to infinitely many numbers, see Booij [7, Section 3.2]). In addition, tuples may be replaced (whenever needed) by finite sequences which provides a richer assortment of definable relations.

The distinction between tuples and finite sequences is a technical subtlety that may be ignored in many contexts, but sometimes requires attention. It is tempting to say that an ordered pair a 2-tuple (that is, tuple of length 2), and a 2-sequence (that is, finite sequence of length 2) are just all the same. However, the 2-sequence is, by definition, a function on thus, the set of two ordered pairs Surely we cannot define an ordered pair to be a set of two other ordered pairs! If sequences are defined via functions, and functions are defined via pairs, then pairs must be defined before sequences, and cannot be the same as 2-sequences. See Wikipedia: sequence (formal definition), tuples (as nested ordered pairs), and ordered pair: Kuratowski's definition. For convenience we'll denote a finite sequence by it is similar to, but different from, the tuple

We'll construct again, this time in the second-order framework, the sequence of real numbers that contains all numbers first-order definable in exactly the same sequence as in Section 4. To this end we'll construct first the disjoint union of unary relations on similar to, but different from, relations (unary, binary, ...) constructed there (that exhaust all relations first-order definable in ).

Before the unary relations we construct 4-tuples of integers (call them "instructions") imitating a program for a machine that computes Similarly to a machine language instruction, each contains an operation code, address of the first operand, a parameter or address of the second operand (if applicable, otherwise 0), and in addition, the arity of

Recall Section 4. Three relations of arities 3,3,1 are given, and lead to the next 13 relations In particular, is the complement of Accordingly, we let here, operation code 1 means "complement...", operand address 1 means "...of ", the third number 0 is dummy, and the last number 3 means that the relation is ternary. Similarly, and

Further, being the union of and we let operation code 2 means "union...", first operand address 1 means "...of ", second operand address 2 means "...and ", and again, 3 is the arity of

Further, being a permutation of we let operation code 3 means "permutation...", operand address 1 means "...of ", the parameter 1 means "swap 1 and 2", and 3 is the arity of Similarly, (in swap 2 and 3), (in swap 1 and 2), (in swap 2 and 3).

Further, being we let operation code 4 means "set multiplication", 1 refers to the operand and 4 is the arity of Similarly, and

Further, being the projection of we let operation code 5 means "projection...", 1 means "...of ", and 2 means "...is binary". Similarly,

This way, the finite sequence of natural numbers (interpreted as arities) leads to the finite sequence of 4-tuples (interpreted as instructions). Similarly, every finite sequence of natural numbers leads to the corresponding finite sequence of 4-tuples. The relation between these two finite sequences is definable; the proof is rather cumbersome, like a routine exercise in programming, but doable. Having this relation, we define an infinite sequence of 4-tuples (interpreted as the infinite "program") together with an infinite sequence by the following defining properties:

  • for every the finite sequence