Classical mathematical analysis involves an intriguing interplay between finite and infinite collections and between discrete and continuous structures. What makes the interplay intriguing is the emergence from the most elementary considerations of results that are paradoxical, or, at least, utterly counterintuitive. What, for example is the sum of 1 + 2 + 3 + … + n + …?
The sum?
Surely this sequence of numbers is simply getting bigger and bigger; and beyond this, it is not converging to anything.
Not so. The sum is –1/12.
Niels Abel called divergent series the Devil’s invention.1 Having made outstanding contributions to the subject as the Devil’s plaything, he knew what he was talking about.
Infinite Sequences
Mathematical analysis begins by considering infinite sequences of real numbers and by defining their limit. For the moment, I will consider the real numbers and only the real numbers. An infinite sequence is an arbitrary function whose domain coincides with the set ℕ = {0, 1, 2, …, n, …} of natural numbers, or with some of its infinite subsets, and whose range is contained in the real line . Thus or more explicitly, if less compactly
.
The terms of such sequences are often generated by a fixed rule, or by applying a specific algorithm to each .
Limits are next. A real number is a limit of a sequence if, for any , there exists a natural number such that whenever . If this is the case, the sequence converges (or tends) to as tends to infinity: . It is easy to show that is unique.2
The definition of a limit having been given—by Augustin-Louis Cauchy, as it happens—mathematicians wished naturally to know whether and under what conditions such limits existed. The classical criterion—by Cauchy again, as it happens again—affirms that is convergent if, and only if, for any there exists a natural number such that whenever and .3
Among the glories of mathematical analysis, no one beyond Cauchy has ever found these ideas easy, and no one beyond Leonhard Euler has ever found them obvious.
The Cauchy criterion reflects the completeness property of the real numbers, from which necessary and sufficient condition for the existence of a limit follow almost at once. Many other conditions for convergence are more convenient in practice. If a sequence of real numbers is monotone and bounded, then it necessarily has a limit.
If two sequences and converge to and respectively, then, for any real and , the sequence converges to .
Suppose that, for two sequences and , two natural numbers and can be found such that whenever . Then converges if and only if converges and, in this case, so does the equality
The convergence of a sequence of real numbers depends only on its tail.
Example 1.
The sequence converges and its limit is equal to 1.
Example 2.
The sequence , where for , converges to Napier’s constant, e = 2.71828… .
Example 3.
The sequence , where for , converges to Euler’s constant, C = 0.57721… .
If there exists no limit of a sequence , then the sequence is divergent. In some sense, most real sequences are divergent.
Example 4.
Any unbounded sequence is divergent; in particular, the unbounded sequence , where for .
Example 5.
The sequence , where for all even , and for all odd natural , is divergent.
Example 6.
The sequence , where for , is unbounded, and thus divergent.
Sometimes it is convenient to treat certain divergent sequences as if they were converging to infinity. A sequence tends to +∞ if, for every , there exists an such that whenever . A sequence tends to –∞ if, for every , there exists an such that whenever .
Given a sequence , one can associate another sequence to it, where denotes the sum of the first terms of . Observe that the initial sequence is completely determined by , because , a point valid for all . The pair is called an infinite series, a series for short.4 With far less by way of notational clutter, mathematicians write
.
A series is convergent if the corresponding sequence has a finite limit , the sum of the series; otherwise, it is divergent.
Cauchy’s convergence criterion now follows: an infinite series has a sum if and only if, for any , there exists a such that whenever and .
The convergence of implies that
.
In the field, where time is short, simpler tests are used: D’Alembert’s test, the nth root test, Leibniz’s test, Raabe’s test, Kummer’s test, Bertrand’s test, Gauss’s test, the integral test, Abel’s test, Dirichlet’s test, Ermakov’s test.5
There are sufficiently many tests to hold an endless series of undergraduate examinations.
Example 7.
The series converges, because all of its terms , where , are less than , and the series
converges to 2. Here the so-called comparison test does its work. A more delicate calculation shows that the sum of is equal to .6 This is a result well hidden from anyone’s intuitions.
As one might expect, series come in special types. There are geometric series, harmonic series, hyper-geometric series, alternating series, and many more besides. In many cases, a series of the form
,
is up for grabs, where are real-valued functions of a real variable . For each value of , one has the usual series
.
Did I mention power series, Taylor series, Laurent series, Dirichlet series, trigonometric series, Fourier series, and the ever-popular binomial series?
Example 8.
The geometric series , where .
Example 9.
Grandi’s series: and, more generally, for any strictly positive integer , the series .
Example 10.
The series .
Example 11.
Dirichlet’s series:
,
where , and is a sequence of real numbers. In particular, the generalized harmonic series, which is a part of Riemann’s zeta fuction, appears almost everywhere:
,
and the generalized alternating harmonic series, which is a part of Dirichlet’s eta function
,
is obtained in this way. The series converges for all real , and the series converges for all real .
Example 12.
A series is called absolutely convergent if the series converges. Every absolutely convergent series converges.
The converse is not true, alas. The alternating harmonic series
,
converges and its sum is equal to ,7 but the same series is not absolutely convergent, as Example 4 might indicate.
A convergent series is conditionally convergent if its associated series diverges.
If a series converges conditionally, then for any real there exists a permutation of its terms such that the new series converges to . This is Riemann’s classical theorem, which admits a nontrivial generalization to a series of vectors in a finite-dimensional Euclidean space.
Strangely Divergent Series
Strangely divergent series such as are straightforward inasmuch as they are divergent; they are strange inasmuch as they are not. This is a claim that would seem to tiptoe to the very edge of paradox. Nonetheless, Euler dealt systematically with strangely divergent series; he was able to manipulate them successfully. After many clever manipulations, Euler thought to claim that any divergent series must have a certain sum. Euler’s position was criticized by the fastidious Jean D’Alembert, the equally fastidious Abel, and by other mathematicians, all of them indifferent to the possibility that Euler might have been right and they wrong. Only much later was some rational fragment of Euler’s idea transformed into a rich theory of the summability of divergent series.
Many divergent series; and so many sums; many sums, and so many summability methods: Abel’s summation method, Borel’s summation method, Cesaro’s summation method, Euler’s summation method, Holder’s summation method, Kummer’s summation method, Lambert’s summation method, Lindelof’s summation method, Poisson’s summation method, Voronoy’s summation method, and many others.8
The simplest method of summation is named after Ernesto Cesaro. If a series is given, then it may sometimes happen—not always, not in every case—that the corresponding sequence of arithmetical means of its partial sums
,
,
converges to a certain real number. This is its Cesaro sum.
The notion of a Cesaro sum is compatible with the usual notion of the sum of a convergent series. Indeed, according to one of Cauchy’s classical theorems, if a sequence of reals has a limit, then the sequence of the arithmetical means of these reals also converges and has the same limit. Simple counterexamples show that the converse is not true.
It should also be noticed that the Cesaro’s summability method inspired tauberian results in the general theory of series. Those results allow mathematicians to establish the convergence of a given series , if is summable by some method and satisfies certain additional constraints.9
After loitering in the Devil’s toolshed, Abel suggested a technique now known as Abel’s summation method, or, sometimes, the Abel-Poisson summation method. The Devil, it is well known, has work for idle hands.
Suppose that a series is given and, for a variable ranging over the open interval , consider the associated power series
.
It may happen that this series converges for each in , and therefore determines a concrete function on the interval. It may happen that there exists a limit of as tends to 1. Such is the series’ Abel sum. Cesaro’s method is compatible with the usual notion of the sum of a convergent series. So is Abel’s method. If a series converges to , then, by virtue of Abel’s classical theorem,10 the Abel sum of is also equal to . The converse fails.
The Devil’s checks are never blank.
Example 13.
For any strictly positive integer , the Abel method implies that the divergent series
,
sums to , and, in particular, the Grandi’s series
sums to 1/2. The Grandi’s series is also summable by Cesaro’s method and its Cesaro’s sum is again equal to 1/2. This is not simply a happy coincidence. Abel’s method is substantially stronger than Cesaro’s. On the other hand, for a natural number strictly greater than 1, the series
,
is not Cesaro summable.
There are many other examples of series that are summable by Abel’s method and not by Cesaro’s method.
Example 14.
Consider the series which is trivially divergent and not Cesaro summable. Abel’s method works, but Cesaro’s method lapses. Indeed, if , then the series converges, and its ordinary sum is equal to . If , Abel’s method promptly yields the equality .
Abel’s method is very helpful in dealing with the products of infinite series. What follows represents one formula, but two series:
,
.
Their product is defined by the equality
The product of two conditionally convergent series is not, in general, convergent. But if both series and are Abel summable, then their product is also Abel summable, and equal to the product of the Abel sums of and .
This is a wonderfully elegant result, and, perhaps, the simplest result accessible to intuition that suggests that the techniques contrived by definition have a rich internal structure.
Example 15.
Using the fact that the sum of products is the product of sums—above, just above—there is, at once, the equality
.
Example 16.
Emil Borel created, or discovered, several important summation methods. If
,
is a series trotting off into the unknown, then the function
,
makes sense—perfect sense, in fact—applied to the set of real numbers , for which this function is well defined. It may happen that has a finite limit as tends to +∞. If so, is called Borel’s sum of the series. If a series is convergent, then it is Borel summable, too, and its usual sum coincides with its Borel sum.
The proof is easy.
What follows involves the same Borel, but a different method: Borel integral summation.
Example 17.
The series has as its Borel sum
.11
Example 18.
Consider the partial Riemann zeta function and the partial Dirichlet’s eta function for all real numbers strictly greater than 1. The convergence of
,
,
readily implies:
.
Even better, one can consider for complex numbers . Replacing with , one obtains , which converges to a complex value whenever the real part of is strictly greater than 1. That admits an analytic continuation on the whole complex plane C is a provable fact of life. On top of this, there is
,
where is an analytic function on the open set , extending . By remembering that , one is finally able to discern that, against every expectation,
.
This is an extraordinary result in mathematics, but it is also an extraordinary result in mathematics that has nontrivial applications in contemporary theoretical physics.
Did the inspired Euler, blind since middle age, who saw so much, see this?
The Theory of Infinite Summation
Suppose that a sequence of functions is given on some subset D of such that there exists an accumulation point of D. Suppose also that, for each , there exists a limit of as tends to , and that this limit is equal to 1.
Consider a series and let the function series
be its natural associate.
It may happen that the function is well-defined on some neighbourhood of the point and, in addition, that there exists a limit of as tends to . The series is summable, and its generalized sum is equal to .
Example 19.
Assume that a sequence of functions satisfies these two conditions:
- all functions from are uniformly bounded; and
- for each , the sequence is monotone.
If S converges to , then S has as its sum.
Many classical summation methods correspond to the appropriate choice of a sequence of functions satisfying 1) and 2). For Cesaro’s summation method, the functions can be defined on in the following way:
if ,
and if
For Abel’s summation method, the functions can be defined on the open interval (0,1)
Taking the positive ray (0,+∞) of as D, and defining the functions by the formula
one gets a certain version of Borel’s summation method.
There are other general schemes.12 Not everything is smooth sailing. Two different schemes may prove inconsistent in the sense that, for some concrete series, they yield two distinct generalized sums.
Example 20.
Quite often a summability scheme is formulated in terms of a real-valued matrix T with countably many rows and columns. T-summability methods transform one infinite sequence into another in the expectation, or hope, that the transformation will yield a sequence better behaved so far as convergence goes. The celebrated Silverman–Toeplitz theorem establishes the necessary and sufficient conditions under which the class of all convergent sequences is transformed by T into itself.13
Among the many interesting and important statements about matrix summability, I wish to mention one result.14 For a given matrix T and a series , consider all those rearrangements of the terms of that yield T-summable series, and denote by the symbol the set of all T-sums obtained in this way. It turns out that, changing and T in all possible ways, the family of all sets yields the family of all analytic, or Suslin, subsets of . This family is much wider than the family of all Borel subsets of .15
Various summability schemes lead naturally to a large family of point sets in , and are connected with more or less delicate facts of classical descriptive set theory. Connections of this sort even touch upon the problem of the Lebesgue measurability of all subsets of .
From a more general point of view, any summability method may be described as a functional defined on some vector subspace L = dom() of the space of all infinite real sequences. The elements of L are of the form , where are partial finite sums of a series. As a rule, summability methods satisfy both linearity and regularity conditions. Linearity means that is a linear functional on L; regularity, that extends the standard linear functional limit defined on the space of all convergent sequences in .
Sometimes, a third condition is imposed, a certain analogue of translation invariance. If is a sum of a series and is a sum of , then .
Example 21.
No summability method satisfying the translation condition can be applied to the series . The proof is obvious: , which implies that .
Now, if a sequence does not belong to L and is an arbitrary real number, the functional can be extended to a linear functional defined on a larger vector subspace of such that
, .
This statement admits a constructive proof, one that does not rely on the axiom of choice.
Euler Vindicated
Euler’s wonderful intuition now stands vindicated:
For any concrete divergent series, there exists a linear and regular summability method that assigns a real number to the series as its sum.
A reservation follows at once. There exists no linear summability method satisfying the translation condition that assigns a finite sum to .
Suppose that
where is a real number. Then:
, and
,
which is impossible.
If one wishes to assign certain generalized sums to all divergent series all at once, then one must appeal to strong forms of the axiom of choice. A standard application of Zorn’s lemma, for example, shows that that there exists a linear regular summation method whose domain is the whole of . This result is useless in practice because of its extremely non-constructive character. On the other hand, it follows from a fundamental result by Robert Solovay that, under countable forms of the axiom of choice, it is logically consistent to assume that the domain of any linear regular summability method is a first category subspace of .16 Since is a Polish topological space, is of second category on itself. Consequently, the domain of any constructively defined linear and regular summability scheme is a very small part of . Within the same weak fragment of set theory, one may assume that the class of all linear regular summation methods, equipped with its natural partial ordering, does not possess maximal elements.
Using uncountable forms of the axiom of choice, mathematicians were able to construct some remarkable linear functionals on various vector subspaces of . Among them the best known is the Banach functional limit, or Lim, defined on the space of all bounded real sequences, Lim is linear, extends the standard functional limit, and is translation invariant.17 But the existence of such functionals always implies the existence of ultimately pathological subsets of , namely, sets non-measurable in the Lebesgue sense or sets not having the so-called Baire property.18
Example 22.
Consider the following function series FS:
where a variable ranges over . Assume that for each from a Lebesgue measurable subset of with strictly positive measure, that FS sums to by some linear, regular summation scheme satisfying the translation condition. It follows that is non-measurable in the Lebesgue sense. Such is Kolmogorov’s theorem.19
Solovay’s profound result shows that there is no hope of effectively constructing a non-Lebesgue measurable subset of or,20 equivalently, a non-Lebesgue measurable function acting from into .21