What's new

Some slides from Basel

16 February, 2020 in non-technical, travel | Tags: Assaf Naor, Collatz conjecture, Jacob Bernoulli, Leonhard Euler | by Terence Tao | 20 comments

I have just returned from Basel, Switzerland, on the occasion of the awarding of the 2019 Ostrowski prize to Assaf Naor. I was invited to give the laudatio for Assaf’s work, which I have uploaded here. I also gave a public lecture (intended at the high school student level) at the University of Basel entitled “The Notorious Collatz conjecture”; I have uploaded the slides for that here. (Note that the slides here are somewhat unpolished as I was not initially planning to make them public until I was recently requested to do so. In particular I do not have full attribution for some of the images used in the slides.)

Basel has historically been home to a number of very prominent mathematicians, most notably Jacob Bernoulli, whose headstone I saw at the Basel Minster,

and also Leonhard Euler, for which I could not find a formal memorial, but I did at least see a hotel bearing his name:

Louis Nirenberg

27 January, 2020 in math.CA, obituary | Tags: Louis Nirenberg | by Terence Tao | 15 comments

I just heard the news that Louis Nirenberg died a few days ago, aged 94. Nirenberg made a vast number of contributions to analysis and PDE (and his work has come up repeatedly on my own blog); I wrote about his beautiful moving planes argument with Gidas and Ni to establish symmetry of ground states in this post on the occasion of him receiving the Chern medal, and on how his extremely useful interpolation inequality with Gagliardo (generalising a previous inequality of Ladyzhenskaya) can be viewed as an amplification of the usual Sobolev inequality in this post. Another fundamentally useful inequality of Nirenberg is the John-Nirenberg inequality established with Fritz John: if a (locally integrable) function $f: {\bf R} \to {\bf R}$ (which for simplicity of exposition we place in one dimension) obeys the bounded mean oscillation property

$\displaystyle \frac{1}{|I|} \int_I |f(x)-f_I|\ dx \leq A \quad (1)$

for all intervals $I$ , where $f_I := \frac{1}{|I|} \int_I f$ is the average value of $f$ on $I$ , then one has exponentially good large deviation estimates

$\displaystyle \frac{1}{|I|} |\{ x \in I: |f(x)-f_I| \geq \lambda A \}| \leq \exp( - c \lambda ) \quad (2)$

for all $\lambda>0$ and some absolute constant $c$ . This can be compared with Markov’s inequality, which only gives the far weaker decay

$\displaystyle \frac{1}{|I|} |\{ x \in I: |f(x)-f_I| \geq \lambda A \}| \leq \frac{1}{\lambda}. \quad (3)$

The point is that (1) is assumed to hold not just for a given interval $I$ , but also all subintervals of $I$ , and this is a much more powerful hypothesis, allowing one for instance to use the standard Calderon-Zygmund technique of stopping time arguments to “amplify” (3) to (2). Basically, for any given interval $I$ , one can use (1) and repeated halving of the interval $I$ until significant deviation from the mean is encountered to locate some disjoint exceptional subintervals $J$ where $f_J$ deviates from $f_I$ by $O(A)$ , with the total measure of the $J$ being a small fraction of that of $I$ (thanks to a variant of (3)), and with $f$ staying within $O(A)$ of $f_I$ at almost every point of $I$ outside of these exceptional intervals. One can then establish (2) by an induction on $\lambda$ . (There are other proofs of this inequality also, e.g., one can use Bellman functions, as discussed in this old set of notes of mine.) Informally, the John-Nirenberg inequality asserts that functions of bounded mean oscillation are “almost as good” as bounded functions, in that they almost always stay within a bounded distance from their mean, and in fact the space BMO of functions of bounded mean oscillation ends up being superior to the space $L^\infty$ of bounded measurable functions for many harmonic analysis purposes (among other things, the space is more stable with respect to singular integral operators).

I met Louis a few times in my career; even in his later years when he was wheelchair-bound, he would often come to conferences and talks, and ask very insightful questions at the end of the lecture (even when it looked like he was asleep during much of the actual talk!). I have a vague memory of him asking me some questions in one of the early talks I gave as a postdoc; I unfortunately do not remember exactly what the topic was (some sort of PDE, I think), but I was struck by how kindly the questions were posed, and how patiently he would listen to my excited chattering about my own work.

Equidistribution of Syracuse random variables and density of Collatz preimages

25 January, 2020 in expository, math.CO, math.NT | Tags: Collatz conjecture, equidistribution | by Terence Tao | 71 comments

Define the Collatz map ${\mathrm{Col}: {\bf N}+1 \rightarrow {\bf N}+1}$ on the natural numbers ${{\bf N}+1 = \{1,2,\dots\}}$ by setting ${\mathrm{Col}(N)}$ to equal ${3N+1}$ when ${N}$ is odd and ${N/2}$ when ${N}$ is even, and let ${\mathrm{Col}^{\bf N}(N) := \{ N, \mathrm{Col}(N), \mathrm{Col}^2(N), \dots \}}$ denote the forward Collatz orbit of ${N}$ . The notorious Collatz conjecture asserts that ${1 \in \mathrm{Col}^{\bf N}(N)}$ for all ${N \in {\bf N}+1}$ . Equivalently, if we define the backwards Collatz orbit ${(\mathrm{Col}^{\bf N})^*(N) := \{ M \in {\bf N}+1: N \in \mathrm{Col}^{\bf N}(M) \}}$ to be all the natural numbers ${M}$ that encounter ${N}$ in their forward Collatz orbit, then the Collatz conjecture asserts that ${(\mathrm{Col}^{\bf N})^*(1) = {\bf N}+1}$ . As a partial result towards this latter statement, Krasikov and Lagarias in 2003 established the bound

$\displaystyle \# \{ N \leq x: N \in (\mathrm{Col}^{\bf N})^*(1) \} \gg x^\gamma \ \ \ \ \ (1)$

for all ${x \geq 1}$ and ${\gamma = 0.84}$ . (This improved upon previous values of ${\gamma = 0.81}$ obtained by Applegate and Lagarias in 1995, ${\gamma = 0.65}$ by Applegate and Lagarias in 1995 by a different method, ${\gamma=0.48}$ by Wirsching in 1993, ${\gamma=0.43}$ by Krasikov in 1989, ${\gamma=0.3}$ by Sander in 1990, and some ${\gamma>0}$ by Crandall in 1978.) This is still the largest value of ${\gamma}$ for which (1) has been established. Of course, the Collatz conjecture would imply that we can take ${\gamma}$ equal to ${1}$ , which is the assertion that a positive density set of natural numbers obeys the Collatz conjecture. This is not yet established, although the results in my previous paper do at least imply that a positive density set of natural numbers iterates to an (explicitly computable) bounded set, so in principle the ${\gamma=1}$ case of (1) could now be verified by an (enormous) finite computation in which one verifies that every number in this explicit bounded set iterates to ${1}$ . In this post I would like to record a possible alternate route to this problem that depends on the distribution of a certain family of random variables that appeared in my previous paper, that I called Syracuse random variables.

Definition 1 (Syracuse random variables) For any natural number ${n}$ , a Syracuse random variable ${\mathbf{Syrac}({\bf Z}/3^n{\bf Z})}$ on the cyclic group ${{\bf Z}/3^n{\bf Z}}$ is defined as a random variable of the form

$\displaystyle \mathbf{Syrac}({\bf Z}/3^n{\bf Z}) = \sum_{m=1}^n 3^{n-m} 2^{-{\mathbf a}_m-\dots-{\mathbf a}_n} \ \ \ \ \ (2)$

where ${\mathbf{a}_1,\dots,\mathbf{a_n}}$ are independent copies of a geometric random variable ${\mathbf{Geom}(2)}$ on the natural numbers with mean ${2}$ , thus

$\displaystyle \mathop{\bf P}( \mathbf{a}_1=a_1,\dots,\mathbf{a}_n=a_n) = 2^{-a_1-\dots-a_n}$

} for ${a_1,\dots,a_n \in {\bf N}+1}$ . In (2) the arithmetic is performed in the ring ${{\bf Z}/3^n{\bf Z}}$ .

Thus for instance

$\displaystyle \mathrm{Syrac}({\bf Z}/3{\bf Z}) = 2^{-\mathbf{a}_1} \hbox{ mod } 3$

$\displaystyle \mathrm{Syrac}({\bf Z}/3^2{\bf Z}) = 2^{-\mathbf{a}_1-\mathbf{a}_2} + 3 \times 2^{-\mathbf{a}_2} \hbox{ mod } 3^2$

$\displaystyle \mathrm{Syrac}({\bf Z}/3^3{\bf Z}) = 2^{-\mathbf{a}_1-\mathbf{a}_2-\mathbf{a}_3} + 3 \times 2^{-\mathbf{a}_2-\mathbf{a}_3} + 3^2 \times 2^{-\mathbf{a}_3} \hbox{ mod } 3^3$

and so forth. After reversing the labeling of the ${\mathbf{a}_1,\dots,\mathbf{a}_n}$ , one could also view ${\mathrm{Syrac}({\bf Z}/3^n{\bf Z})}$ as the mod ${3^n}$ reduction of a ${3}$ -adic random variable

$\displaystyle \mathbf{Syrac}({\bf Z}_3) = \sum_{m=1}^\infty 3^{m-1} 2^{-{\mathbf a}_1-\dots-{\mathbf a}_m}.$

The probability density function ${b \mapsto \mathbf{P}( \mathbf{Syrac}({\bf Z}/3^n{\bf Z}) = b )}$ of the Syracuse random variable can be explicitly computed by a recursive formula (see Lemma 1.12 of my previous paper). For instance, when ${n=1}$ , ${\mathbf{P}( \mathbf{Syrac}({\bf Z}/3{\bf Z}) = b )}$ is equal to ${0,1/3,2/3}$ for ${x=b,1,2 \hbox{ mod } 3}$ respectively, while when ${n=2}$ , ${\mathbf{P}( \mathbf{Syrac}({\bf Z}/3^2{\bf Z}) = b )}$ is equal to

$\displaystyle 0, \frac{8}{63}, \frac{16}{63}, 0, \frac{11}{63}, \frac{4}{63}, 0, \frac{2}{63}, \frac{22}{63}$

when ${b=0,\dots,8 \hbox{ mod } 9}$ respectively.

The relationship of these random variables to the Collatz problem can be explained as follows. Let ${2{\bf N}+1 = \{1,3,5,\dots\}}$ denote the odd natural numbers, and define the Syracuse map ${\mathrm{Syr}: 2{\bf N}+1 \rightarrow 2{\bf N}+1}$ by

$\displaystyle \mathrm{Syr}(N) := \frac{3n+1}{2^{\nu_2(3N+1)}}$

where the ${2}$ –valuation ${\nu_2(3n+1) \in {\bf N}}$ is the number of times ${2}$ divides ${3N+1}$ . We can define the forward orbit ${\mathrm{Syr}^{\bf N}(n)}$ and backward orbit ${(\mathrm{Syr}^{\bf N})^*(N)}$ of the Syracuse map as before. It is not difficult to then see that the Collatz conjecture is equivalent to the assertion ${(\mathrm{Syr}^{\bf N})^*(1) = 2{\bf N}+1}$ , and that the assertion (1) for a given ${\gamma}$ is equivalent to the assertion

$\displaystyle \# \{ N \leq x: N \in (\mathrm{Syr}^{\bf N})^*(1) \} \gg x^\gamma \ \ \ \ \ (3)$

for all ${x \geq 1}$ , where ${N}$ is now understood to range over odd natural numbers. A brief calculation then shows that for any odd natural number ${N}$ and natural number ${n}$ , one has

$\displaystyle \mathrm{Syr}^n(N) = 3^n 2^{-a_1-\dots-a_n} N + \sum_{m=1}^n 3^{n-m} 2^{-a_m-\dots-a_n}$

where the natural numbers ${a_1,\dots,a_n}$ are defined by the formula

$\displaystyle a_i := \nu_2( 3 \mathrm{Syr}^{i-1}(N) + 1 ),$

so in particular

$\displaystyle \mathrm{Syr}^n(N) = \sum_{m=1}^n 3^{n-m} 2^{-a_m-\dots-a_n} \hbox{ mod } 3^n.$

Heuristically, one expects the ${2}$ -valuation ${a = \nu_2(N)}$ of a typical odd number ${N}$ to be approximately distributed according to the geometric distribution ${\mathbf{Geom}(2)}$ , so one therefore expects the residue class ${\mathrm{Syr}^n(N) \hbox{ mod } 3^n}$ to be distributed approximately according to the random variable ${\mathbf{Syrac}({\bf Z}/3^n{\bf Z})}$ .

The Syracuse random variables ${\mathbf{Syrac}({\bf Z}/3^n{\bf Z})}$ will always avoid multiples of three (this reflects the fact that ${\mathrm{Syr}(N)}$ is never a multiple of three), but attains any non-multiple of three in ${{\bf Z}/3^n{\bf Z}}$ with positive probability. For any natural number ${n}$ , set

$\displaystyle c_n := \inf_{b \in {\bf Z}/3^n{\bf Z}: 3 \nmid b} \mathbf{P}( \mathbf{Syrac}({\bf Z}/3^n{\bf Z}) = b ).$

Equivalently, ${c_n}$ is the greatest quantity for which we have the inequality

$\displaystyle \sum_{(a_1,\dots,a_n) \in S_{n,N}} 2^{-a_1-\dots-a_m} \geq c_n \ \ \ \ \ (4)$

for all integers ${N}$ not divisible by three, where ${S_{n,N} \subset ({\bf N}+1)^n}$ is the set of all tuples ${(a_1,\dots,a_n)}$ for which

$\displaystyle N = \sum_{m=1}^n 3^{m-1} 2^{-a_1-\dots-a_m} \hbox{ mod } 3^n.$

Thus for instance ${c_0=1}$ , ${c_1 = 1/3}$ , and ${c_2 = 2/63}$ . On the other hand, since all the probabilities ${\mathbf{P}( \mathbf{Syrac}({\bf Z}/3^n{\bf Z}) = b)}$ sum to ${1}$ as ${b \in {\bf Z}/3^n{\bf Z}}$ ranges over the non-multiples of ${3}$ , we have the trivial upper bound

$\displaystyle c_n \leq \frac{3}{2} 3^{-n}.$

There is also an easy submultiplicativity result:

Lemma 2 For any natural numbers ${n_1,n_2}$ , we have

$\displaystyle c_{n_1+n_2-1} \geq c_{n_1} c_{n_2}.$

Proof: Let ${N}$ be an integer not divisible by ${3}$ , then by (4) we have

$\displaystyle \sum_{(a_1,\dots,a_{n_1}) \in S_{n_1,N}} 2^{-a_1-\dots-a_{n_1}} \geq c_{n_1}.$

If we let ${S'_{n_1,N}}$ denote the set of tuples ${(a_1,\dots,a_{n_1-1})}$ that can be formed from the tuples in ${S_{n_1,N}}$ by deleting the final component ${a_{n_1}}$ from each tuple, then we have

$\displaystyle \sum_{(a_1,\dots,a_{n_1-1}) \in S'_{n_1,N}} 2^{-a_1-\dots-a_{n_1-1}} \geq c_{n_1}. \ \ \ \ \ (5)$

Next, observe that if ${(a_1,\dots,a_{n_1-1}) \in S'_{n_1,N}}$ , then

$\displaystyle N = \sum_{m=1}^{n_1-1} 3^{m-1} 2^{-a_1-\dots-a_m} + 3^{n_1-1} 2^{-a_1-\dots-a_{n_1-1}} M$

with ${M = M_{N,n_1,a_1,\dots,a_{n_1-1}}}$ an integer not divisible by three. By definition of ${S_{n_2,M}}$ and a relabeling, we then have

$\displaystyle M = \sum_{m=1}^{n_2} 3^{m-1} 2^{-a_{n_1}-\dots-a_{m+n_1-1}} \hbox{ mod } 3^{n_2}$

for all ${(a_{n_1},\dots,a_{n_1+n_2-1}) \in S_{n_2,M}}$ . For such tuples we then have

$\displaystyle N = \sum_{m=1}^{n_1+n_2-1} 3^{m-1} 2^{-a_1-\dots-a_{n_1+n_2-1}} \hbox{ mod } 3^{n_1+n_2-1}$

so that ${(a_1,\dots,a_{n_1+n_2-1}) \in S_{n_1+n_2-1,N}}$ . Since

$\displaystyle \sum_{(a_{n_1},\dots,a_{n_1+n_2-1}) \in S_{n_2,M}} 2^{-a_{n_1}-\dots-a_{n_1+n_2-1}} \geq c_{n_2}$

for each ${M}$ , the claim follows. $\Box$

From this lemma we see that ${c_n = 3^{-\beta n + o(n)}}$ for some absolute constant ${\beta \geq 1}$ . Heuristically, we expect the Syracuse random variables to be somewhat approximately equidistributed amongst the multiples of ${{\bf Z}/3^n{\bf Z}}$ (in Proposition 1.4 of my previous paper I prove a fine scale mixing result that supports this heuristic). As a consequence it is natural to conjecture that ${\beta=1}$ . I cannot prove this, but I can show that this conjecture would imply that we can take the exponent ${\gamma}$ in (1), (3) arbitrarily close to one:

Proposition 3 Suppose that ${\beta=1}$ (that is to say, ${c_n = 3^{-n+o(n)}}$ as ${n \rightarrow \infty}$ ). Then

$\displaystyle \# \{ N \leq x: N \in (\mathrm{Syr}^{\bf N})^*(1) \} \gg x^{1-o(1)}$

as ${x \rightarrow \infty}$ , or equivalently

$\displaystyle \# \{ N \leq x: N \in (\mathrm{Col}^{\bf N})^*(1) \} \gg x^{1-o(1)}$

as ${x \rightarrow \infty}$ . In other words, (1), (3) hold for all ${\gamma < 1}$ .

I prove this proposition below the fold. A variant of the argument shows that for any value of ${\beta}$ , (1), (3) holds whenever ${\gamma < f(\beta)}$ , where ${f: [0,1] \rightarrow [0,1]}$ is an explicitly computable function with ${f(\beta) \rightarrow 1}$ as ${\beta \rightarrow 1}$ . In principle, one could then improve the Krasikov-Lagarias result ${\gamma = 0.84}$ by getting a sufficiently good upper bound on ${\beta}$ , which is in principle achievable numerically (note for instance that Lemma 2 implies the bound ${c_n \leq 3^{-\beta(n-1)}}$ for any ${n}$ , since ${c_{kn-k+1} \geq c_n^k}$ for any ${k}$ ).

Read the rest of this entry »

Some recent papers

11 January, 2020 in expository, math.AP, math.CA, math.CO, math.NT | Tags: Chowla conjecture, finite time blowup, Frank Merle, Hong Wang, Igor Rodnianski, Jeremie Szeftel, Larry Guth, Mark Shusterman, nonlinear Schrodinger equation, Pierre Raphael, restriction theorems, Ruixiang Zhang, Sarah Peluse, Szemeredi's theorem, twin primes, Will Sawin | by Terence Tao | 4 comments

Just a brief post to record some notable papers in my fields of interest that appeared on the arXiv recently.

“A sharp square function estimate for the cone in ${\bf R}^3$ “, by Larry Guth, Hong Wang, and Ruixiang Zhang. This paper establishes an optimal (up to epsilon losses) square function estimate for the three-dimensional light cone that was essentially conjectured by Mockenhaupt, Seeger, and Sogge, which has a number of other consequences including Sogge’s local smoothing conjecture for the wave equation in two spatial dimensions, which in turn implies the (already known) Bochner-Riesz, restriction, and Kakeya conjectures in two dimensions. Interestingly, modern techniques such as polynomial partitioning and decoupling estimates are not used in this argument; instead, the authors mostly rely on an induction on scales argument and Kakeya type estimates. Many previous authors (including myself) were able to get weaker estimates of this type by an induction on scales method, but there were always significant inefficiencies in doing so; in particular knowing the sharp square function estimate at smaller scales did not imply the sharp square function estimate at the given larger scale. The authors here get around this issue by finding an even stronger estimate that implies the square function estimate, but behaves significantly better with respect to induction on scales.
“On the Chowla and twin primes conjectures over ${\mathbb F}_q[T]$ “, by Will Sawin and Mark Shusterman. This paper resolves a number of well known open conjectures in analytic number theory, such as the Chowla conjecture and the twin prime conjecture (in the strong form conjectured by Hardy and Littlewood), in the case of function fields where the field is a prime power $q=p^j$ which is fixed (in contrast to a number of existing results in the “large $q$ ” limit) but has a large exponent $j$ . The techniques here are orthogonal to those used in recent progress towards the Chowla conjecture over the integers (e.g., in this previous paper of mine); the starting point is an algebraic observation that in certain function fields, the Mobius function behaves like a quadratic Dirichlet character along certain arithmetic progressions. In principle, this reduces problems such as Chowla’s conjecture to problems about estimating sums of Dirichlet characters, for which more is known; but the task is still far from trivial.
“Bounds for sets with no polynomial progressions“, by Sarah Peluse. This paper can be viewed as part of a larger project to obtain quantitative density Ramsey theorems of Szemeredi type. For instance, Gowers famously established a relatively good quantitative bound for Szemeredi’s theorem that all dense subsets of integers contain arbitrarily long arithmetic progressions $a, a+r, \dots, a+(k-1)r$ . The corresponding question for polynomial progressions $a+P_1(r), \dots, a+P_k(r)$ is considered more difficult for a number of reasons. One of them is that dilation invariance is lost; a dilation of an arithmetic progression is again an arithmetic progression, but a dilation of a polynomial progression will in general not be a polynomial progression with the same polynomials $P_1,\dots,P_k$ . Another issue is that the ranges of the two parameters $a,r$ are now at different scales. Peluse gets around these difficulties in the case when all the polynomials $P_1,\dots,P_k$ have distinct degrees, which is in some sense the opposite case to that considered by Gowers (in particular, she avoids the need to obtain quantitative inverse theorems for high order Gowers norms; which was recently obtained in this integer setting by Manners but with bounds that are probably not strong enough to for the bounds in Peluse’s results, due to a degree lowering argument that is available in this case). To resolve the first difficulty one has to make all the estimates rather uniform in the coefficients of the polynomials $P_j$ , so that one can still run a density increment argument efficiently. To resolve the second difficulty one needs to find a quantitative concatenation theorem for Gowers uniformity norms. Many of these ideas were developed in previous papers of Peluse and Peluse-Prendiville in simpler settings.
“On blow up for the energy super critical defocusing non linear Schrödinger equations“, by Frank Merle, Pierre Raphael, Igor Rodnianski, and Jeremie Szeftel. This paper (when combined with two companion papers) resolves a long-standing problem as to whether finite time blowup occurs for the defocusing supercritical nonlinear Schrödinger equation (at least in certain dimensions and nonlinearities). I had a previous paper establishing a result like this if one “cheated” by replacing the nonlinear Schrodinger equation by a system of such equations, but remarkably they are able to tackle the original equation itself without any such cheating. Given the very analogous situation with Navier-Stokes, where again one can create finite time blowup by “cheating” and modifying the equation, it does raise hope that finite time blowup for the incompressible Navier-Stokes and Euler equations can be established… In fact the connection may not just be at the level of analogy; a surprising key ingredient in the proofs here is the observation that a certain blowup ansatz for the nonlinear Schrodinger equation is governed by solutions to the (compressible) Euler equation, and finite time blowup examples for the latter can be used to construct finite time blowup examples for the former.

Elgindi’s approximation of the Biot-Savart law

26 December, 2019 in math.AP, math.CA, math.MP | Tags: Biot-Savart law, incompressible Euler equations, Tarek Elgindi | by Terence Tao | 10 comments

Let ${u: {\bf R}^3 \rightarrow {\bf R}^3}$ be a divergence-free vector field, thus ${\nabla \cdot u = 0}$ , which we interpret as a velocity field. In this post we will proceed formally, largely ignoring the analytic issues of whether the fields in question have sufficient regularity and decay to justify the calculations. The vorticity field ${\omega: {\bf R}^3 \rightarrow {\bf R}^3}$ is then defined as the curl of the velocity:

$\displaystyle \omega = \nabla \times u.$

(From a differential geometry viewpoint, it would be more accurate (especially in other dimensions than three) to define the vorticity as the exterior derivative ${\omega = d(g \cdot u)}$ of the musical isomorphism ${g \cdot u}$ of the Euclidean metric ${g}$ applied to the velocity field ${u}$ ; see these previous lecture notes. However, we will not need this geometric formalism in this post.)

Assuming suitable regularity and decay hypotheses of the velocity field ${u}$ , it is possible to recover the velocity from the vorticity as follows. From the general vector identity ${\nabla \times \nabla \times X = \nabla(\nabla \cdot X) - \Delta X}$ applied to the velocity field ${u}$ , we see that

$\displaystyle \nabla \times \omega = -\Delta u$

and thus (by the commutativity of all the differential operators involved)

$\displaystyle u = - \nabla \times \Delta^{-1} \omega.$

Using the Newton potential formula

$\displaystyle -\Delta^{-1} \omega(x) := \frac{1}{4\pi} \int_{{\bf R}^3} \frac{\omega(y)}{|x-y|}\ dy$

and formally differentiating under the integral sign, we obtain the Biot-Savart law

$\displaystyle u(x) = \frac{1}{4\pi} \int_{{\bf R}^3} \frac{\omega(y) \times (x-y)}{|x-y|^3}\ dy. \ \ \ \ \ (1)$

This law is of fundamental importance in the study of incompressible fluid equations, such as the Euler equations

$\displaystyle \partial_t u + (u \cdot \nabla) u = -\nabla p; \quad \nabla \cdot u = 0$

since on applying the curl operator one obtains the vorticity equation

$\displaystyle \partial_t \omega + (u \cdot \nabla) \omega = (\omega \cdot \nabla) u \ \ \ \ \ (2)$

and then by substituting (1) one gets an autonomous equation for the vorticity field ${\omega}$ . Unfortunately, this equation is non-local, due to the integration present in (1).

In a recent work, it was observed by Elgindi that in a certain regime, the Biot-Savart law can be approximated by a more “low rank” law, which makes the non-local effects significantly simpler in nature. This simplification was carried out in spherical coordinates, and hinged on a study of the invertibility properties of a certain second order linear differential operator in the latitude variable ${\theta}$ ; however in this post I would like to observe that the approximation can also be seen directly in Cartesian coordinates from the classical Biot-Savart law (1). As a consequence one can also initiate the beginning of Elgindi’s analysis in constructing somewhat regular solutions to the Euler equations that exhibit self-similar blowup in finite time, though I have not attempted to execute the entirety of the analysis in this setting.

Elgindi’s approximation applies under the following hypotheses:

(i) (Axial symmetry without swirl) The velocity field ${u}$ is assumed to take the form
$\displaystyle u(x_1,x_2,x_3) = ( u_r(r,x_3) \frac{x_1}{r}, u_r(r,x_3) \frac{x_2}{r}, u_3(r,x_3) ) \ \ \ \ \ (3)$

for some functions ${u_r, u_3: [0,+\infty) \times {\bf R} \rightarrow {\bf R}}$ of the cylindrical radial variable ${r := \sqrt{x_1^2+x_2^2}}$ and the vertical coordinate ${x_3}$ . As a consequence, the vorticity field ${\omega}$ takes the form

$\displaystyle \omega(x_1,x_2,x_3) = (\omega_{r3}(r,x_3) \frac{x_2}{r}, \omega_{r3}(r,x_3) \frac{-x_1}{r}, 0) \ \ \ \ \ (4)$

where ${\omega_{r3}: [0,+\infty) \times {\bf R} \rightarrow {\bf R}}$ is the field

$\displaystyle \omega_{r3} = \partial_r u_3 - \partial_3 u_r.$
(ii) (Odd symmetry) We assume that ${u_3(r,-x_3) = -u_3(r,x_3)}$ and ${u_r(r,-x_3)=u_r(r,x_3)}$ , so that ${\omega_{r3}(r,-x_3)=\omega_{r3}(r,x_3)}$ .

A model example of a divergence-free vector field obeying these properties (but without good decay at infinity) is the linear vector field

$\displaystyle X(x) = (x_1, x_2, -2x_3) \ \ \ \ \ (5)$

which is of the form (3) with ${u_r(r,x_3) = r}$ and ${u_3(r,x_3) = -2x_3}$ . The associated vorticity ${\omega}$ vanishes.

We can now give an illustration of Elgindi’s approximation:

Proposition 1 (Elgindi’s approximation) Under the above hypotheses (and assuing suitable regularity and decay), we have the pointwise bounds

$\displaystyle u(x) = \frac{1}{2} {\mathcal L}_{12}(\omega)(|x|) X(x) + O( |x| \|\omega\|_{L^\infty({\bf R}^3)} )$

for any ${x \in {\bf R}^3}$ , where ${X}$ is the vector field (5), and ${{\mathcal L}_{12}(\omega): {\bf R}^+ \rightarrow {\bf R}}$ is the scalar function

$\displaystyle {\mathcal L}_{12}(\omega)(\rho) := \frac{3}{4\pi} \int_{|y| \geq \rho} \frac{r y_3}{|y|^5} \omega_{r3}(r,y_3)\ dy.$

Thus under the hypotheses (i), (ii), and assuming that ${\omega}$ is slowly varying, we expect ${u}$ to behave like the linear vector field ${X}$ modulated by a radial scalar function. In applications one needs to control the error in various function spaces instead of pointwise, and with ${\omega}$ similarly controlled in other function space norms than the ${L^\infty}$ norm, but this proposition already gives a flavour of the approximation. If one uses spherical coordinates

$\displaystyle \omega_{r3}( \rho \cos \theta, \rho \sin \theta ) = \Omega( \rho, \theta )$

then we have (using the spherical change of variables formula ${dy = \rho^2 \cos \theta d\rho d\theta d\phi}$ and the odd nature of ${\Omega}$ )

$\displaystyle {\mathcal L}_{12}(\omega) = L_{12}(\Omega),$

where

$\displaystyle L_{12}(\Omega)(\rho) = 3 \int_\rho^\infty \int_0^{\pi/2} \frac{\Omega(r, \theta) \sin(\theta) \cos^2(\theta)}{r}\ d\theta dr$

is the operator introduced in Elgindi’s paper.

Proof: By a limiting argument we may assume that ${x}$ is non-zero, and we may normalise ${\|\omega\|_{L^\infty({\bf R}^3)}=1}$ . From the triangle inequality we have

$\displaystyle \int_{|y| \leq 10|x|} \frac{\omega(y) \times (x-y)}{|x-y|^3}\ dy \leq \int_{|y| \leq 10|x|} \frac{1}{|x-y|^2}\ dy$

$\displaystyle \leq \int_{|z| \leq 11 |x|} \frac{1}{|z|^2}\ dz$

$\displaystyle = O( |x| )$

and hence by (1)

$\displaystyle u(x) = \frac{1}{4\pi} \int_{|y| > 10|x|} \frac{\omega(y) \times (x-y)}{|x-y|^3}\ dy + O(|x|).$

In the regime ${|y| > 2|x|}$ we may perform the Taylor expansion

$\displaystyle \frac{x-y}{|x-y|^3} = \frac{x-y}{|y|^3} (1 - \frac{2 x \cdot y}{|y|^2} + \frac{|x|^2}{|y|^2})^{-3/2}$

$\displaystyle = \frac{x-y}{|y|^3} (1 + \frac{3 x \cdot y}{|y|^2} + O( \frac{|x|^2}{|y|^2} ) )$

$\displaystyle = -\frac{y}{|y|^3} + \frac{x}{|y|^3} - \frac{3 (x \cdot y) y}{|y|^5} + O( \frac{|x|^2}{|y|^4} ).$

Since

$\displaystyle \int_{|y| > 10|x|} \frac{|x|^2}{|y|^4}\ dy = O(|x|)$

we see from the triangle inequality that the error term contributes ${O(|x|)}$ to ${u(x)}$ . We thus have

$\displaystyle u(x) = -A_0(x) + A_1(x) - 3A'_1(x) + O(|x|)$

where ${A_0}$ is the constant term

$\displaystyle A_0 := \int_{|y| > 10|x|} \frac{\omega(y) \times y}{|y|^3}\ dy,$

and ${A_1, A'_1}$ are the linear term

$\displaystyle A_1 := \int_{|y| > 10|x|} \frac{\omega(y) \times x}{|y|^3}\ dy,$

$\displaystyle A'_1 := \int_{|y| > 10|x|} (x \cdot y) \frac{\omega(y) \times y}{|y|^5}\ dy.$

By the hypotheses (i), (ii), we have the symmetries

$\displaystyle \omega(y_1,y_2,-y_3) = - \omega(y_1,y_2,y_3) \ \ \ \ \ (6)$

and

$\displaystyle \omega(-y_1,-y_2,y_3) = - \omega(y_1,y_2,y_3) \ \ \ \ \ (7)$

and hence also

$\displaystyle \omega(-y_1,-y_2,-y_3) = \omega(y_1,y_2,y_3). \ \ \ \ \ (8)$

The even symmetry (8) ensures that the integrand in ${A_0}$ is odd, so ${A_0}$ vanishes. The symmetry (6) or (7) similarly ensures that ${\int_{|y| > 10|x|} \frac{\omega(y)}{|y|^3}\ dy = 0}$ , so ${A_1}$ vanishes. Since ${\int_{|x| < y \leq 10|x|} \frac{|x \cdot y| |y|}{|y|^5}\ dy = O( |x| )}$ , we conclude that

$\displaystyle \omega(x) = -3\int_{|y| \geq |x|} (x \cdot y) \frac{\omega(y) \times y}{|y|^5}\ dy + O(|x|).$

Using (4), the right-hand side is

$\displaystyle -3\int_{|y| \geq |x|} (x_1 y_1 + x_2 y_2 + x_3 y_3) \frac{\omega_{r3}(r,y_3) (-y_1 y_3, -y_2 y_3, y_1^2+y_2^2)}{r|y|^5}\ dy$

$\displaystyle + O(|x|)$

where ${r := \sqrt{y_1^2+y_2^2}}$ . Because of the odd nature of ${\omega_{r3}}$ , only those terms with one factor of ${y_3}$ give a non-vanishing contribution to the integral. Using the rotation symmetry ${(y_1,y_2,y_3) \mapsto (-y_2,y_1,y_3)}$ we also see that any term with a factor of ${y_1 y_2}$ also vanishes. We can thus simplify the above expression as

$\displaystyle -3\int_{|y| \geq |x|} \frac{\omega_{r3}(r,y_3) (-x_1 y_1^2 y_3, -x_2 y_2^2 y_3, x_3 (y_1^2+y_2^2) y_3)}{r|y|^5}\ dy + O(|x|).$

Using the rotation symmetry ${(y_1,y_2,y_3) \mapsto (-y_2,y_1,y_3)}$ again, we see that the term ${y_1^2}$ in the first component can be replaced by ${y_2^2}$ or by ${\frac{1}{2} (y_1^2+y_2^2) = \frac{r^2}{2}}$ , and similarly for the ${y_2^2}$ term in the second component. Thus the above expression is

$\displaystyle \frac{3}{2} \int_{|y| \geq |x|} \frac{\omega_{r3}(r,y_3) (x_1 , x_2, -2x_3) r y_3}{|y|^5}\ dy + O(|x|)$

giving the claim. $\Box$

Example 2 Consider the divergence-free vector field ${u := \nabla \times \psi}$ , where the vector potential ${\psi}$ takes the form

$\displaystyle \psi(x_1,x_2,x_3) := (x_2 x_3, -x_1 x_3, 0) \eta(|x|)$

for some bump function ${\eta: {\bf R} \rightarrow {\bf R}}$ supported in ${(0,+\infty)}$ . We can then calculate

$\displaystyle u(x_1,x_2,x_3) = X(x) \eta(|x|) + (x_1 x_3, x_2 x_3, -x_1^2-x_2^2) \frac{\eta'(|x|) x_3}{|x|}.$

and

$\displaystyle \omega(x_1,x_2,x_3) = (-6x_2 x_3, 6x_1 x_3, 0) \frac{\eta'(|x|)}{|x|} + (-x_2 x_3, x_1 x_3, 0) \eta''(|x|).$

In particular the hypotheses (i), (ii) are satisfied with

$\displaystyle \omega_{r3}(r,x_3) = - 6 \eta'(|x|) \frac{x_3 r}{|x|} - \eta''(|x|) x_3 r.$

One can then calculate

$\displaystyle L_{12}(\omega)(\rho) = -\frac{3}{4\pi} \int_{|y| \geq \rho} (6\frac{\eta'(|y|)}{|y|^6} + \frac{\eta''(|y|)}{|y|^5}) r^2 y_3^2\ dy$

$\displaystyle = -\frac{2}{5} \int_\rho^\infty 6\eta'(s) + s\eta''(s)\ ds$

$\displaystyle = 2\eta(\rho) + \frac{2}{5} \rho \eta'(\rho).$

If we take the specific choice

$\displaystyle \eta(\rho) = \varphi( \rho^\alpha )$

where ${\varphi}$ is a fixed bump function supported some interval ${[c,C] \subset (0,+\infty)}$ and ${\alpha>0}$ is a small parameter (so that ${\eta}$ is spread out over the range ${\rho \in [c^{1/\alpha},C^{1/\alpha}]}$ ), then we see that

$\displaystyle \| \omega \|_{L^\infty} = O( \alpha )$

(with implied constants allowed to depend on ${\varphi}$ ),

$\displaystyle L_{12}(\omega)(\rho) = 2\eta(\rho) + O(\alpha),$

and

$\displaystyle u = X(x) \eta(|x|) + O( \alpha |x| ),$

which is completely consistent with Proposition 1.

One can use this approximation to extract a plausible ansatz for a self-similar blowup to the Euler equations. We let ${\alpha>0}$ be a small parameter and let ${\omega_{rx_3}}$ be a time-dependent vorticity field obeying (i), (ii) of the form

$\displaystyle \omega_{rx_3}(t,r,x_3) \approx \alpha \Omega( t, R ) \mathrm{sgn}(x_3)$

where ${R := |x|^\alpha = (r^2+x_3^2)^{\alpha/2}}$ and ${\Omega: {\bf R} \times [0,+\infty) \rightarrow {\bf R}}$ is a smooth field to be chosen later. Admittedly the signum function ${\mathrm{sgn}}$ is not smooth at ${x_3}$ , but let us ignore this issue for now (to rigorously make an ansatz one will have to smooth out this function a little bit; Elgindi uses the choice ${(|\sin \theta| \cos^2 \theta)^{\alpha/3} \mathrm{sgn}(x_3)}$ , where ${\theta := \mathrm{arctan}(x_3/r)}$ ). With this ansatz one may compute

$\displaystyle {\mathcal L}_{12}(\omega(t))(\rho) \approx \frac{3\alpha}{2\pi} \int_{|y| \geq \rho; y_3 \geq 0} \Omega(t,R) \frac{r y_3}{|y|^5}\ dy$

$\displaystyle = \alpha \int_\rho^\infty \Omega(t, s^\alpha) \frac{ds}{s}$

$\displaystyle = \int_{\rho^\alpha}^\infty \Omega(t,s) \frac{ds}{s}.$

By Proposition 1, we thus expect to have the approximation

$\displaystyle u(t,x) \approx \frac{1}{2} \int_{|x|^\alpha}^\infty \Omega(t,s) \frac{ds}{s} X(x).$

We insert this into the vorticity equation (2). The transport term ${(u \cdot \nabla) \omega}$ will be expected to be negligible because ${R}$ , and hence ${\omega_{rx_3}}$ , is slowly varying (the discontinuity of ${\mathrm{sgn}(x_3)}$ will not be encountered because the vector field ${X}$ is parallel to this singularity). The modulating function ${\frac{1}{2} \int_{|x|^\alpha}^\infty \Omega(t,s) \frac{ds}{s}}$ is similarly slowly varying, so derivatives falling on this function should be lower order. Neglecting such terms, we arrive at the approximation

$\displaystyle (\omega \cdot \nabla) u \approx \frac{1}{2} \int_{|x|^\alpha}^\infty \Omega(t,s) \frac{ds}{s} \omega$

and so in the limit ${\alpha \rightarrow 0}$ we expect obtain a simple model equation for the evolution of the vorticity envelope ${\Omega}$ :

$\displaystyle \partial_t \Omega(t,R) = \frac{1}{2} \int_R^\infty \Omega(t,S) \frac{dS}{S} \Omega(t,R).$

If we write ${L(t,R) := \int_R^\infty \Omega(t,S)\frac{dS}{S}}$ for the logarithmic primitive of ${\Omega}$ , then we have ${\Omega = - R \partial_R L}$ and hence

$\displaystyle \partial_t (R \partial_R L) = \frac{1}{2} L (R \partial_R L)$

which integrates to the Ricatti equation

$\displaystyle \partial_t L = \frac{1}{4} L^2$

which can be explicitly solved as

$\displaystyle L(t,R) = \frac{2}{f(R) - t/2}$

where ${f(R)}$ is any function of ${R}$ that one pleases. (In Elgindi’s work a time dilation is used to remove the unsightly factor of ${1/2}$ appearing here in the denominator.) If for instance we set ${f(R) = 1+R}$ , we obtain the self-similar solution

$\displaystyle L(t,R) = \frac{2}{1+R-t/2}$

and then on applying ${-R \partial_R}$

$\displaystyle \Omega(t,R) = \frac{2R}{(1+R-t/2)^2}.$

Thus, we expect to be able to construct a self-similar blowup to the Euler equations with a vorticity field approximately behaving like

$\displaystyle \omega(t,x) \approx \alpha \frac{2R}{(1+R-t/2)^2} \mathrm{sgn}(x_3) (\frac{x_2}{r}, -\frac{x_1}{r}, 0)$

and velocity field behaving like

$\displaystyle u(t,x) \approx \frac{1}{1+R-t/2} X(x).$

In particular, ${u}$ would be expected to be of regularity ${C^{1,\alpha}}$ (and smooth away from the origin), and blows up in (say) ${L^\infty}$ norm at time ${t/2 = 1}$ , and one has the self-similarity

$\displaystyle u(t,x) = (1-t/2)^{\frac{1}{\alpha}-1} u( 0, \frac{x}{(1-t/2)^{1/\alpha}} )$

and

$\displaystyle \omega(t,x) = (1-t/2)^{-1} \omega( 0, \frac{x}{(1-t/2)^{1/\alpha}} ).$

A self-similar solution of this approximate shape is in fact constructed rigorously in Elgindi’s paper (using spherical coordinates instead of the Cartesian approach adopted here), using a nonlinear stability analysis of the above ansatz. It seems plausible that one could also carry out this stability analysis using this Cartesian coordinate approach, although I have not tried to do this in detail.

254A, Notes 10 – mean values of nonpretentious multiplicative functions

17 December, 2019 in 254A - analytic prime number theory, math.NT | Tags: Halasz's theorem, Matomaki-Radziwill theorem, multiplicative number theory, pretentious number theory | by Terence Tao | 8 comments

Let us call an arithmetic function ${f: {\bf N} \rightarrow {\bf C}}$ ${1}$ -bounded if we have ${|f(n)| \leq 1}$ for all ${n \in {\bf N}}$ . In this section we focus on the asymptotic behaviour of ${1}$ -bounded multiplicative functions. Some key examples of such functions include:

The Möbius function ${\mu}$ ;
The Liouville function ${\lambda}$ ;
“Archimedean” characters ${n \mapsto n^{it}}$ (which I call Archimedean because they are pullbacks of a Fourier character ${x \mapsto x^{it}}$ on the multiplicative group ${{\bf R}^+}$ , which has the Archimedean property);
Dirichlet characters (or “non-Archimedean” characters) ${\chi}$ (which are essentially pullbacks of Fourier characters on a multiplicative cyclic group ${({\bf Z}/q{\bf Z})^\times}$ with the discrete (non-Archimedean) metric);
Hybrid characters ${n \mapsto \chi(n) n^{it}}$ .

The space of ${1}$ -bounded multiplicative functions is also closed under multiplication and complex conjugation.

Given a multiplicative function ${f}$ , we are often interested in the asymptotics of long averages such as

$\displaystyle \frac{1}{X} \sum_{n \leq X} f(n)$

for large values of ${X}$ , as well as short sums

$\displaystyle \frac{1}{H} \sum_{x \leq n \leq x+H} f(n)$

where ${H}$ and ${x}$ are both large, but ${H}$ is significantly smaller than ${x}$ . (Throughout these notes we will try to normalise most of the sums and integrals appearing here as averages that are trivially bounded by ${O(1)}$ ; note that other normalisations are preferred in some of the literature cited here.) For instance, as we established in Theorem 58 of Notes 1, the prime number theorem is equivalent to the assertion that

$\displaystyle \frac{1}{X} \sum_{n \leq X} \mu(n) = o(1) \ \ \ \ \ (1)$

as ${X \rightarrow \infty}$ . The Liouville function behaves almost identically to the Möbius function, in that estimates for one function almost always imply analogous estimates for the other:

Exercise 1 Without using the prime number theorem, show that (1) is also equivalent to

$\displaystyle \frac{1}{X} \sum_{n \leq X} \lambda(n) = o(1) \ \ \ \ \ (2)$

as ${X \rightarrow \infty}$ . (Hint: use the identities ${\lambda(n) = \sum_{d^2|n} \mu(n/d^2)}$ and ${\mu(n) = \sum_{d^2|n} \mu(d) \lambda(n/d^2)}$ .)

Henceforth we shall focus our discussion more on the Liouville function, and turn our attention to averages on shorter intervals. From (2) one has

$\displaystyle \frac{1}{H} \sum_{x \leq n \leq x+H} \lambda(n) = o(1) \ \ \ \ \ (3)$

as ${x \rightarrow \infty}$ if ${H = H(x)}$ is such that ${H \geq \varepsilon x}$ for some fixed ${\varepsilon>0}$ . However it is significantly more difficult to understand what happens when ${H}$ grows much slower than this. By using the techniques based on zero density estimates discussed in Notes 6, it was shown by Motohashi and that one can also establish \eqref. On the Riemann Hypothesis Maier and Montgomery lowered the threshold to ${H \geq x^{1/2} \log^C x}$ for an absolute constant ${C}$ (the bound ${H \geq x^{1/2+\varepsilon}}$ is more classical, following from Exercise 33 of Notes 2). On the other hand, the randomness heuristics from Supplement 4 suggest that ${H}$ should be able to be taken as small as ${x^\varepsilon}$ , and perhaps even ${\log^{1+\varepsilon} x}$ if one is particularly optimistic about the accuracy of these probabilistic models. On the other hand, the Chowla conjecture (mentioned for instance in Supplement 4) predicts that ${H}$ cannot be taken arbitrarily slowly growing in ${x}$ , due to the conjectured existence of arbitrarily long strings of consecutive numbers where the Liouville function does not change sign (and in fact one can already show from the known partial results towards the Chowla conjecture that (3) fails for some sequence ${x \rightarrow \infty}$ and some sufficiently slowly growing ${H = H(x)}$ , by modifying the arguments in these papers of mine).

The situation is better when one asks to understand the mean value on almost all short intervals, rather than all intervals. There are several equivalent ways to formulate this question:

Exercise 2 Let ${H = H(X)}$ be a function of ${X}$ such that ${H \rightarrow \infty}$ and ${H = o(X)}$ as ${X \rightarrow \infty}$ . Let ${f: {\bf N} \rightarrow {\bf C}}$ be a ${1}$ -bounded function. Show that the following assertions are equivalent:

(i) One has
$\displaystyle \frac{1}{H} \sum_{x \leq n \leq x+H} f(n) = o(1)$

as ${X \rightarrow \infty}$ , uniformly for all ${x \in [X,2X]}$ outside of a set of measure ${o(X)}$ .

(ii) One has
$\displaystyle \frac{1}{X} \int_X^{2X} |\frac{1}{H} \sum_{x \leq n \leq x+H} f(n)|\ dx = o(1)$

as ${X \rightarrow \infty}$ .

(iii) One has
$\displaystyle \frac{1}{X} \int_X^{2X} |\frac{1}{H} \sum_{x \leq n \leq x+H} f(n)|^2\ dx = o(1) \ \ \ \ \ (4)$

as ${X \rightarrow \infty}$ .

As it turns out the second moment formulation in (iii) will be the most convenient for us to work with in this set of notes, as it is well suited to Fourier-analytic techniques (and in particular the Plancherel theorem).

Using zero density methods, for instance, it was shown by Ramachandra that

$\displaystyle \frac{1}{X} \int_X^{2X} |\frac{1}{H} \sum_{x \leq n \leq x+H} \lambda(n)|^2\ dx \ll_{A,\varepsilon} \log^{-A} X$

whenever ${X^{1/6+\varepsilon} \leq H \leq X}$ and ${\varepsilon>0}$ . With this quality of bound (saving arbitrary powers of ${\log X}$ over the trivial bound of ${O(1)}$ ), this is still the lowest value of ${H}$ one can reach unconditionally. However, in a striking recent breakthrough, it was shown by Matomaki and Radziwill that as long as one is willing to settle for weaker bounds (saving a small power of ${\log X}$ or ${\log H}$ , or just a qualitative decay of ${o(1)}$ ), one can obtain non-trivial estimates on far shorter intervals. For instance, they show

Theorem 3 (Matomaki-Radziwill theorem for Liouville) For any ${2 \leq H \leq X}$ , one has

$\displaystyle \frac{1}{X} \int_X^{2X} |\frac{1}{H} \sum_{x \leq n \leq x+H} \lambda(n)|^2\ dx \ll \log^{-c} H$

for some absolute constant ${c>0}$ .

In fact they prove a slightly more precise result: see Theorem 1 of that paper. In particular, they obtain the asymptotic (4) for any function ${H = H(X)}$ that goes to infinity as ${X \rightarrow \infty}$ , no matter how slowly! This ability to let ${H}$ grow slowly with ${X}$ is important for several applications; for instance, in order to combine this type of result with the entropy decrement methods from Notes 9, it is essential that ${H}$ be allowed to grow more slowly than ${\log X}$ . See also this survey of Soundararajan for further discussion.

Exercise 4 In this exercise you may use Theorem 3 freely.

(i) Establish the lower bound
$\displaystyle \frac{1}{X} \sum_{n \leq X} \lambda(n)\lambda(n+1) > -1+c$

for some absolute constant ${c>0}$ and all sufficiently large ${X}$ . (Hint: if this bound failed, then ${\lambda(n)=\lambda(n+1)}$ would hold for almost all ${n}$ ; use this to create many intervals ${[x,x+H]}$ for which ${\frac{1}{H} \sum_{x \leq n \leq x+H} \lambda(n)}$ is extremely large.)

(ii) Show that Theorem 3 also holds with ${\lambda(n)}$ replaced by ${\chi_2 \lambda(n)}$ , where ${\chi_2}$ is the principal character of period ${2}$ . (Use the fact that ${\lambda(2n)=-\lambda(n)}$ for all ${n}$ .) Use this to establish the corresponding upper bound
$\displaystyle \frac{1}{X} \sum_{n \leq X} \lambda(n)\lambda(n+1) < 1-c$

to (i).

(There is a curious asymmetry to the difficulty level of these bounds; the upper bound in (ii) was established much earlier by Harman, Pintz, and Wolke, but the lower bound in (i) was only established in the Matomaki-Radziwill paper.)

The techniques discussed previously were highly complex-analytic in nature, relying in particular on the fact that functions such as ${\mu}$ or ${\lambda}$ have Dirichlet series ${{\mathcal D} \mu(s) = \frac{1}{\zeta(s)}}$ , ${{\mathcal D} \lambda(s) = \frac{\zeta(2s)}{\zeta(s)}}$ that extend meromorphically into the critical strip. In contrast, the Matomaki-Radziwill theorem does not rely on such meromorphic continuations, and in fact holds for more general classes of ${1}$ -bounded multiplicative functions ${f}$ , for which one typically does not expect any meromorphic continuation into the strip. Instead, one can view the Matomaki-Radziwill theory as following the philosophy of a slightly different approach to multiplicative number theory, namely the pretentious multiplicative number theory of Granville and Soundarajan (as presented for instance in their draft monograph). A basic notion here is the pretentious distance between two ${1}$ -bounded multiplicative functions ${f,g}$ (at a given scale ${X}$ ), which informally measures the extent to which ${f}$ “pretends” to be like ${g}$ (or vice versa). The precise definition is

Definition 5 (Pretentious distance) Given two ${1}$ -bounded multiplicative functions ${f,g}$ , and a threshold ${X>0}$ , the pretentious distance ${\mathbb{D}(f,g;X)}$ between ${f}$ and ${g}$ up to scale ${X}$ is given by the formula

$\displaystyle \mathbb{D}(f,g;X) := \left( \sum_{p \leq X} \frac{1 - \mathrm{Re}(f(p) \overline{g(p)})}{p} \right)^{1/2}$

Note that one can also define an infinite version ${\mathbb{D}(f,g;\infty)}$ of this distance by removing the constraint ${p \leq X}$ , though in such cases the pretentious distance may then be infinite. The pretentious distance is not quite a metric (because ${\mathbb{D}(f,f;X)}$ can be non-zero, and furthermore ${\mathbb{D}(f,g;X)}$ can vanish without ${f,g}$ being equal), but it is still quite close to behaving like a metric, in particular it obeys the triangle inequality; see Exercise 16 below. The philosophy of pretentious multiplicative number theory is that two ${1}$ -bounded multiplicative functions ${f,g}$ will exhibit similar behaviour at scale ${X}$ if their pretentious distance ${\mathbb{D}(f,g;X)}$ is bounded, but will become uncorrelated from each other if this distance becomes large. A simple example of this philosophy is given by the following “weak Halasz theorem”, proven in Section 2:

Proposition 6 (Logarithmically averaged version of Halasz) Let ${X}$ be sufficiently large. Then for any ${1}$ -bounded multiplicative functions ${f,g}$ , one has

$\displaystyle \frac{1}{\log X} \sum_{n \leq X} \frac{f(n) \overline{g(n)}}{n} \ll \exp( - c \mathbb{D}(f, g;X)^2 )$

for an absolute constant ${c>0}$ .

In particular, if ${f}$ does not pretend to be ${1}$ , then the logarithmic average ${\frac{1}{\log X} \sum_{n \leq X} \frac{f(n)}{n}}$ will be small. This condition is basically necessary, since of course ${\frac{1}{\log X} \sum_{n \leq X} \frac{1}{n} = 1 + o(1)}$ .

If one works with non-logarithmic averages ${\frac{1}{X} \sum_{n \leq X} f(n)}$ , then not pretending to be ${1}$ is insufficient to establish decay, as was already observed in Exercise 11 of Notes 1: if ${f}$ is an Archimedean character ${f(n) = n^{it}}$ for some non-zero real ${t}$ , then ${\frac{1}{\log X} \sum_{n \leq X} \frac{f(n)}{n}}$ goes to zero as ${X \rightarrow \infty}$ (which is consistent with Proposition 6), but ${\frac{1}{X} \sum_{n \leq X} f(n)}$ does not go to zero. However, this is in some sense the “only” obstruction to these averages decaying to zero, as quantified by the following basic result:

Theorem 7 (Halasz’s theorem) Let ${X}$ be sufficiently large. Then for any ${1}$ -bounded multiplicative function ${f}$ , one has

$\displaystyle \frac{1}{X} \sum_{n \leq X} f(n) \ll \exp( - c \min_{|t| \leq T} \mathbb{D}(f, n \mapsto n^{it};X)^2 ) + \frac{1}{T}$

for an absolute constant ${c>0}$ and any ${T > 0}$ .

Informally, we refer to a ${1}$ -bounded multiplicative function as “pretentious’; if it pretends to be a character such as ${n^{it}}$ , and “non-pretentious” otherwise. The precise distinction is rather malleable, as the precise class of characters that one views as “obstructions” varies from situation to situation. For instance, in Proposition 6 it is just the trivial character ${1}$ which needs to be considered, but in Theorem 7 it is the characters ${n \mapsto n^{it}}$ with ${|t| \leq T}$ . In other contexts one may also need to add Dirichlet characters ${\chi(n)}$ or hybrid characters such as ${\chi(n) n^{it}}$ to the list of characters that one might pretend to be. The division into pretentious and non-pretentious functions in multiplicative number theory is faintly analogous to the division into major and minor arcs in the circle method applied to additive number theory problems; see Notes 8. The Möbius and Liouville functions are model examples of non-pretentious functions; see Exercise 24.

In the contrapositive, Halasz’ theorem can be formulated as the assertion that if one has a large mean

$\displaystyle |\frac{1}{X} \sum_{n \leq X} f(n)| \geq \eta$

for some ${\eta > 0}$ , then one has the pretentious property

$\displaystyle \mathbb{D}( f, n \mapsto n^{it}; X ) \ll \sqrt{\log(1/\eta)}$

for some ${t \ll \eta^{-1}}$ . This has the flavour of an “inverse theorem”, of the type often found in arithmetic combinatorics.

Among other things, Halasz’s theorem gives yet another proof of the prime number theorem (1); see Section 2.

We now give a version of the Matomaki-Radziwill theorem for general (non-pretentious) multiplicative functions that is formulated in a similar contrapositive (or “inverse theorem”) fashion, though to simplify the presentation we only state a qualitative version that does not give explicit bounds.

Theorem 8 ((Qualitative) Matomaki-Radziwill theorem) Let ${\eta>0}$ , and let ${1 \leq H \leq X}$ , with ${H}$ sufficiently large depending on ${\eta}$ . Suppose that ${f}$ is a ${1}$ -bounded multiplicative function such that

$\displaystyle \frac{1}{X} \int_X^{2X} |\frac{1}{H} \sum_{x \leq n \leq x+H} f(n)|^2\ dx \geq \eta^2.$

Then one has

$\displaystyle \mathbb{D}(f, n \mapsto n^{it};X) \ll_\eta 1$

for some ${t \ll_\eta \frac{X}{H}}$ .

The condition ${t \ll_\eta \frac{X}{H}}$ is basically optimal, as the following example shows:

Exercise 9 Let ${\varepsilon>0}$ be a sufficiently small constant, and let ${1 \leq H \leq X}$ be such that ${\frac{1}{\varepsilon} \leq H \leq \varepsilon X}$ . Let ${f}$ be the Archimedean character ${f(n) = n^{it}}$ for some ${|t| \leq \varepsilon \frac{X}{H}}$ . Show that

$\displaystyle \frac{1}{X} \int_X^{2X} |\frac{1}{H} \sum_{x \leq n \leq x+H} f(n)|^2\ dx \asymp 1.$

Combining Theorem 8 with standard non-pretentiousness facts about the Liouville function (see Exercise 24), we recover Theorem 3 (but with a decay rate of only ${o(1)}$ rather than ${\log^{-c} H}$ ). We refer the reader to the original paper of Matomaki-Radziwill (as well as this followup paper with myself) for the quantitative version of Theorem 8 that is strong enough to recover the full version of Theorem 3, and which can also handle real-valued pretentious functions.

With our current state of knowledge, the only arguments that can establish the full strength of Halasz and Matomaki-Radziwill theorems are Fourier analytic in nature, relating sums involving an arithmetic function ${f}$ with its Dirichlet series

$\displaystyle {\mathcal D} f(s) := \sum_{n=1}^\infty \frac{f(n)}{n^s}$

which one can view as a discrete Fourier transform of ${f}$ (or more precisely of the measure ${\sum_{n=1}^\infty \frac{f(n)}{n} \delta_{\log n}}$ , if one evaluates the Dirichlet series on the right edge ${\{ 1+it: t \in {\bf R} \}}$ of the critical strip). In this aspect, the techniques resemble the complex-analytic methods from Notes 2, but with the key difference that no analytic or meromorphic continuation into the strip is assumed. The key identity that allows us to pass to Dirichlet series is the following variant of Proposition 7 of Notes 2:

Proposition 10 (Parseval type identity) Let ${f,g: {\bf N} \rightarrow {\bf C}}$ be finitely supported arithmetic functions, and let ${\psi: {\bf R} \rightarrow {\bf R}}$ be a Schwartz function. Then

$\displaystyle \sum_{n=1}^\infty \sum_{m=1}^\infty \frac{f(n)}{n} \frac{\overline{g(m)}}{m} \psi(\log n - \log m) = \frac{1}{2\pi} \int_{\bf R} {\mathcal D} f(1+it) \overline{{\mathcal D} g(1+it)} \hat \psi(t)\ dt$

where ${\hat \psi(t) := \int_{\bf R} \psi(u) e^{itu}\ du}$ is the Fourier transform of ${\psi}$ . (Note that the finite support of ${f,g}$ and the Schwartz nature of ${\psi,\hat \psi}$ ensure that both sides of the identity are absolutely convergent.)

The restriction that ${f,g}$ be finitely supported will be slightly annoying in places, since most multiplicative functions will fail to be finitely supported, but this technicality can usually be overcome by suitably truncating the multiplicative function, and taking limits if necessary.

Proof: By expanding out the Dirichlet series, it suffices to show that

$\displaystyle \psi(\log n - \log m) = \frac{1}{2\pi} \int_{\bf R} \frac{1}{n^{it}} \frac{1}{m^{-it}} \hat \psi(t)\ dt$

for any natural numbers ${n,m}$ . But this follows from the Fourier inversion formula ${\psi(u) = \frac{1}{2\pi} \int_{\bf R} e^{-itu} \hat \psi(t)\ dt}$ applied at ${u = \log n - \log m}$ . $\Box$

For applications to Halasz type theorems, one sets ${g(n)}$ equal to the Kronecker delta ${\delta_{n=1}}$ , producing weighted integrals of ${{\mathcal D} f(1+it)}$ of “ ${L^1}$ ” type. For applications to Matomaki-Radziwill theorems, one instead sets ${f=g}$ , and more precisely uses the following corollary of the above proposition, to obtain weighted integrals of ${|{\mathcal D} f(1+it)|^2}$ of “ ${L^2}$ ” type:

Exercise 11 (Plancherel type identity) If ${f: {\bf N} \rightarrow {\bf C}}$ is finitely supported, and ${\varphi: {\bf R} \rightarrow {\bf R}}$ is a Schwartz function, establish the identity

$\displaystyle \int_0^\infty |\sum_{n=1}^\infty \frac{f(n)}{n} \varphi(\log n - \log y)|^2 \frac{dy}{y} = \frac{1}{2\pi} \int_{\bf R} |{\mathcal D} f(1+it)|^2 |\hat \varphi(t)|^2\ dt.$

In contrast, information about the non-pretentious nature of a multiplicative function ${f}$ will give “pointwise” or “ ${L^\infty}$ ” type control on the Dirichlet series ${{\mathcal D} f(1+it)}$ , as is suggested from the Euler product factorisation of ${{\mathcal D} f}$ .

It will be convenient to formalise the notion of ${L^1}$ , ${L^2}$ , and ${L^\infty}$ control of the Dirichlet series ${{\mathcal D} f}$ , which as previously mentioned can be viewed as a sort of “Fourier transform” of ${f}$ :

Definition 12 (Fourier norms) Let ${f: {\bf N} \rightarrow {\bf C}}$ be finitely supported, and let ${\Omega \subset {\bf R}}$ be a bounded measurable set. We define the Fourier ${L^\infty}$ norm

$\displaystyle \| f\|_{FL^\infty(\Omega)} := \sup_{t \in \Omega} |{\mathcal D} f(1+it)|,$

the Fourier ${L^2}$ norm

$\displaystyle \| f\|_{FL^2(\Omega)} := \left(\int_\Omega |{\mathcal D} f(1+it)|^2\ dt\right)^{1/2},$

and the Fourier ${L^1}$ norm

$\displaystyle \| f\|_{FL^1(\Omega)} := \int_\Omega |{\mathcal D} f(1+it)|\ dt.$

One could more generally define ${FL^p}$ norms for other exponents ${p}$ , but we will only need the exponents ${p=1,2,\infty}$ in this current set of notes. It is clear that all the above norms are in fact (semi-)norms on the space of finitely supported arithmetic functions.

As mentioned above, Halasz’s theorem gives good control on the Fourier ${L^\infty}$ norm for restrictions of non-pretentious functions to intervals:

Exercise 13 (Fourier ${L^\infty}$ control via Halasz) Let ${f: {\bf N} \rightarrow {\bf C}}$ be a ${1}$ -bounded multiplicative function, let ${I}$ be an interval in ${[C^{-1} X, CX]}$ for some ${X \geq C \geq 1}$ , let ${R \geq 1}$ , and let ${\Omega \subset {\bf R}}$ be a bounded measurable set. Show that

$\displaystyle \| f 1_I \|_{FL^\infty(\Omega)} \ll_C \exp( - c \min_{t: \mathrm{dist}(t,\Omega) \leq R} \mathbb{D}(f, n \mapsto n^{it};X)^2 ) + \frac{1}{R}.$

(Hint: you will need to use summation by parts (or an equivalent device) to deal with a ${\frac{1}{n}}$ weight.)

Meanwhile, the Plancherel identity in Exercise 11 gives good control on the Fourier ${L^2}$ norm for functions on long intervals (compare with Exercise 2 from Notes 6):

Exercise 14 ( ${L^2}$ mean value theorem) Let ${T \geq 1}$ , and let ${f: {\bf N} \rightarrow {\bf C}}$ be finitely supported. Show that

$\displaystyle \| f \|_{FL^2([-T,T])}^2 \ll \sum_n \frac{1}{n} (\frac{T}{n} \sum_{m: |n-m| \leq n/T} |f(m)|)^2.$

Conclude in particular that if ${f}$ is supported in ${[C^{-1} N, C N]}$ for some ${C \geq 1}$ and ${N \gg T}$ , then

$\displaystyle \| f \|_{FL^2([-T,T])}^2 \ll C^{O(1)} \frac{1}{N} \sum_n |f(n)|^2.$

In the simplest case of the logarithmically averaged Halasz theorem (Proposition 6), Fourier ${L^\infty}$ estimates are already sufficient to obtain decent control on the (weighted) Fourier ${L^1}$ type expressions that show up. However, these estimates are not enough by themselves to establish the full Halasz theorem or the Matomaki-Radziwill theorem. To get from Fourier ${L^\infty}$ control to Fourier ${L^1}$ or ${L^2}$ control more efficiently, the key trick is use Hölder’s inequality, which when combined with the basic Dirichlet series identity

$\displaystyle {\mathcal D}(f*g) = ({\mathcal D} f) ({\mathcal D} g)$

gives the inequalities

$\displaystyle \| f*g \|_{FL^1(\Omega)} \leq \|f\|_{FL^2(\Omega)} \|g\|_{FL^2(\Omega)} \ \ \ \ \ (5)$

and

$\displaystyle \| f*g \|_{FL^2(\Omega)} \leq \|f\|_{FL^2(\Omega)} \|g\|_{FL^\infty(\Omega)} \ \ \ \ \ (6)$

The strategy is then to factor (or approximately factor) the original function ${f}$ as a Dirichlet convolution (or average of convolutions) of various components, each of which enjoys reasonably good Fourier ${L^2}$ or ${L^\infty}$ estimates on various regions ${\Omega}$ , and then combine them using the Hölder inequalities (5), (6) and the triangle inequality. For instance, to prove Halasz’s theorem, we will split ${f}$ into the Dirichlet convolution of three factors, one of which will be estimated in ${FL^\infty}$ using the non-pretentiousness hypothesis, and the other two being estimated in ${FL^2}$ using Exercise 14. For the Matomaki-Radziwill theorem, one uses a significantly more complicated decomposition of ${f}$ into a variety of Dirichlet convolutions of factors, and also splits up the Fourier domain ${[-T,T]}$ into several subregions depending on whether the Dirichlet series associated to some of these components are large or small. In each region and for each component of these decompositions, all but one of the factors will be estimated in ${FL^\infty}$ , and the other in ${FL^2}$ ; but the precise way in which this is done will vary from component to component. For instance, in some regions a key factor will be small in ${FL^\infty}$ by construction of the region; in other places, the ${FL^\infty}$ control will come from Exercise 13. Similarly, in some regions, satisfactory ${FL^2}$ control is provided by Exercise 14, but in other regions one must instead use “large value” theorems (in the spirit of Proposition 9 from Notes 6), or amplify the power of the standard ${L^2}$ mean value theorems by combining the Dirichlet series with other Dirichlet series that are known to be large in this region.

There are several ways to achieve the desired factorisation. In the case of Halasz’s theorem, we can simply work with a crude version of the Euler product factorisation, dividing the primes into three categories (“small”, “medium”, and “large” primes) and expressing ${f}$ as a triple Dirichlet convolution accordingly. For the Matomaki-Radziwill theorem, one instead exploits the Turan-Kubilius phenomenon (Section 5 of Notes 1, or Lemma 2 of Notes 9)) that for various moderately wide ranges ${[P,Q]}$ of primes, the number of prime divisors of a large number ${n}$ in the range ${[P,Q]}$ is almost always close to ${\log\log Q - \log\log P}$ . Thus, if we introduce the arithmetic functions

$\displaystyle w_{[P,Q]}(n) = \frac{1}{\log\log Q - \log\log P} \sum_{P \leq p \leq Q} 1_{n=p} \ \ \ \ \ (7)$

then we have

$\displaystyle 1 \approx 1 * w_{[P,Q]}$

and more generally we have a twisted approximation

$\displaystyle f \approx f * fw_{[P,Q]}$

for multiplicative functions ${f}$ . (Actually, for technical reasons it will be convenient to work with a smoothed out version of these functions; see Section 3.) Informally, these formulas suggest that the “ ${FL^2}$ energy” of a multiplicative function ${f}$ is concentrated in those regions where ${f w_{[P,Q]}}$ is extremely large in a ${FL^\infty}$ sense. Iterations of this formula (or variants of this formula, such as an identity due to Ramaré) will then give the desired (approximate) factorisation of ${{\mathcal D} f}$ .

Read the rest of this entry »

Maryam Mirzakhani New Frontiers Prize

10 December, 2019 in advertising | by Terence Tao | 13 comments

Just a short post to announce that nominations are now open for the Maryam Mirzakhani New Frontiers Prize, which is a newly announced annual $50,000 award from the Breakthrough Prize Foundation presented to early-career, women mathematicians who have completed their PhDs within the past two years, and recognizes outstanding research achievement. (I will be serving on the prize committee.) Nominations for this (and other breakthrough prizes) can be made at this page.

Eigenvectors from Eigenvalues: a survey of a basic identity in linear algebra

3 December, 2019 in math.CO, math.HO, math.NA, math.RA, update | Tags: eigenvalues, eigenvectors, Peter Denton, Stephen Parke, Xining Zhang | by Terence Tao | 36 comments

Peter Denton, Stephen Parke, Xining Zhang, and I have just uploaded to the arXiv a completely rewritten version of our previous paper, now titled “Eigenvectors from Eigenvalues: a survey of a basic identity in linear algebra“. This paper is now a survey of the various literature surrounding the following basic identity in linear algebra, which we propose to call the eigenvector-eigenvalue identity:

Theorem 1 (Eigenvector-eigenvalue identity) Let ${A}$ be an ${n \times n}$ Hermitian matrix, with eigenvalues ${\lambda_1(A),\dots,\lambda_n(A)}$ . Let ${v_i}$ be a unit eigenvector corresponding to the eigenvalue ${\lambda_i(A)}$ , and let ${v_{i,j}}$ be the ${j^{th}}$ component of ${v_i}$ . Then

$\displaystyle |v_{i,j}|^2 \prod_{k=1; k \neq i}^n (\lambda_i(A) - \lambda_k(A)) = \prod_{k=1}^{n-1} (\lambda_i(A) - \lambda_k(M_j))$

where ${M_j}$ is the ${n-1 \times n-1}$ Hermitian matrix formed by deleting the ${j^{th}}$ row and column from ${A}$ .

When we posted the first version of this paper, we were unaware of previous appearances of this identity in the literature; a related identity had been used by Erdos-Schlein-Yau and by myself and Van Vu for applications to random matrix theory, but to our knowledge this specific identity appeared to be new. Even two months after our preprint first appeared on the arXiv in August, we had only learned of one other place in the literature where the identity showed up (by Forrester and Zhang, who also cite an earlier paper of Baryshnikov).

The situation changed rather dramatically with the publication of a popular science article in Quanta on this identity in November, which gave this result significantly more exposure. Within a few weeks we became informed (through private communication, online discussion, and exploration of the citation tree around the references we were alerted to) of over three dozen places where the identity, or some other closely related identity, had previously appeared in the literature, in such areas as numerical linear algebra, various aspects of graph theory (graph reconstruction, chemical graph theory, and walks on graphs), inverse eigenvalue problems, random matrix theory, and neutrino physics. As a consequence, we have decided to completely rewrite our article in order to collate this crowdsourced information, and survey the history of this identity, all the known proofs (we collect seven distinct ways to prove the identity (or generalisations thereof)), and all the applications of it that we are currently aware of. The citation graph of the literature that this ad hoc crowdsourcing effort produced is only very weakly connected, which we found surprising:

The earliest explicit appearance of the eigenvector-eigenvalue identity we are now aware of is in a 1966 paper of Thompson, although this paper is only cited (directly or indirectly) by a fraction of the known literature, and also there is a precursor identity of Löwner from 1934 that can be shown to imply the identity as a limiting case. At the end of the paper we speculate on some possible reasons why this identity only achieved a modest amount of recognition and dissemination prior to the November 2019 Quanta article.

An uncountable Moore-Schmidt theorem

28 November, 2019 in math.DS, math.LO, math.PR, paper | Tags: abstract measure theory, Asgar Jamneshan, cocycles, compact abelian groups, ergodic theory, sigma algebras | by Terence Tao | 7 comments

Asgar Jamneshan and I have just uploaded to the arXiv our paper “An uncountable Moore-Schmidt theorem“. This paper revisits a classical theorem of Moore and Schmidt in measurable cohomology of measure-preserving systems. To state the theorem, let ${X = (X,{\mathcal X},\mu)}$ be a probability space, and ${\mathrm{Aut}(X, {\mathcal X}, \mu)}$ be the group of measure-preserving automorphisms of this space, that is to say the invertible bimeasurable maps ${T: X \rightarrow X}$ that preserve the measure ${\mu}$ : ${T_* \mu = \mu}$ . To avoid some ambiguity later in this post when we introduce abstract analogues of measure theory, we will refer to measurable maps as concrete measurable maps, and measurable spaces as concrete measurable spaces. (One could also call ${X = (X,{\mathcal X}, \mu)}$ a concrete probability space, but we will not need to do so here as we will not be working explicitly with abstract probability spaces.)

Let ${\Gamma = (\Gamma,\cdot)}$ be a discrete group. A (concrete) measure-preserving action of ${\Gamma}$ on ${X}$ is a group homomorphism ${\gamma \mapsto T^\gamma}$ from ${\Gamma}$ to ${\mathrm{Aut}(X, {\mathcal X}, \mu)}$ , thus ${T^1}$ is the identity map and ${T^{\gamma_1} \circ T^{\gamma_2} = T^{\gamma_1 \gamma_2}}$ for all ${\gamma_1,\gamma_2 \in \Gamma}$ . A large portion of ergodic theory is concerned with the study of such measure-preserving actions, especially in the classical case when ${\Gamma}$ is the integers (with the additive group law).

Let ${K = (K,+)}$ be a compact Hausdorff abelian group, which we can endow with the Borel ${\sigma}$ -algebra ${{\mathcal B}(K)}$ . A (concrete measurable) ${K}$ –cocycle is a collection ${\rho = (\rho_\gamma)_{\gamma \in \Gamma}}$ of concrete measurable maps ${\rho_\gamma: X \rightarrow K}$ obeying the cocycle equation

$\displaystyle \rho_{\gamma_1 \gamma_2}(x) = \rho_{\gamma_1} \circ T^{\gamma_2}(x) + \rho_{\gamma_2}(x) \ \ \ \ \ (1)$

for ${\mu}$ -almost every ${x \in X}$ . (Here we are glossing over a measure-theoretic subtlety that we will return to later in this post – see if you can spot it before then!) Cocycles arise naturally in the theory of group extensions of dynamical systems; in particular (and ignoring the aforementioned subtlety), each cocycle induces a measure-preserving action ${\gamma \mapsto S^\gamma}$ on ${X \times K}$ (which we endow with the product of ${\mu}$ with Haar probability measure on ${K}$ ), defined by

$\displaystyle S^\gamma( x, k ) := (T^\gamma x, k + \rho_\gamma(x) ).$

This connection with group extensions was the original motivation for our study of measurable cohomology, but is not the focus of the current paper.

A special case of a ${K}$ -valued cocycle is a (concrete measurable) ${K}$ -valued coboundary, in which ${\rho_\gamma}$ for each ${\gamma \in \Gamma}$ takes the special form

$\displaystyle \rho_\gamma(x) = F \circ T^\gamma(x) - F(x)$

for ${\mu}$ -almost every ${x \in X}$ , where ${F: X \rightarrow K}$ is some measurable function; note that (ignoring the aforementioned subtlety), every function of this form is automatically a concrete measurable ${K}$ -valued cocycle. One of the first basic questions in measurable cohomology is to try to characterize which ${K}$ -valued cocycles are in fact ${K}$ -valued coboundaries. This is a difficult question in general. However, there is a general result of Moore and Schmidt that at least allows one to reduce to the model case when ${K}$ is the unit circle ${\mathbf{T} = {\bf R}/{\bf Z}}$ , by taking advantage of the Pontryagin dual group ${\hat K}$ of characters ${\hat k: K \rightarrow \mathbf{T}}$ , that is to say the collection of continuous homomorphisms ${\hat k: k \mapsto \langle \hat k, k \rangle}$ to the unit circle. More precisely, we have

Theorem 1 (Countable Moore-Schmidt theorem) Let ${\Gamma}$ be a discrete group acting in a concrete measure-preserving fashion on a probability space ${X}$ . Let ${K}$ be a compact Hausdorff abelian group. Assume the following additional hypotheses:

(i) ${\Gamma}$ is at most countable.

(ii) ${X}$ is a standard Borel space.

(iii) ${K}$ is metrisable.

Then a ${K}$ -valued concrete measurable cocycle ${\rho = (\rho_\gamma)_{\gamma \in \Gamma}}$ is a concrete coboundary if and only if for each character ${\hat k \in \hat K}$ , the ${\mathbf{T}}$ -valued cocycles ${\langle \hat k, \rho \rangle = ( \langle \hat k, \rho_\gamma \rangle )_{\gamma \in \Gamma}}$ are concrete coboundaries.

The hypotheses (i), (ii), (iii) are saying in some sense that the data ${\Gamma, X, K}$ are not too “large”; in all three cases they are saying in some sense that the data are only “countably complicated”. For instance, (iii) is equivalent to ${K}$ being second countable, and (ii) is equivalent to ${X}$ being modeled by a complete separable metric space. It is because of this restriction that we refer to this result as a “countable” Moore-Schmidt theorem. This theorem is a useful tool in several other applications, such as the Host-Kra structure theorem for ergodic systems; I hope to return to these subsequent applications in a future post.

Let us very briefly sketch the main ideas of the proof of Theorem 1. Ignore for now issues of measurability, and pretend that something that holds almost everywhere in fact holds everywhere. The hard direction is to show that if each ${\langle \hat k, \rho \rangle}$ is a coboundary, then so is ${\rho}$ . By hypothesis, we then have an equation of the form

$\displaystyle \langle \hat k, \rho_\gamma(x) \rangle = \alpha_{\hat k} \circ T^\gamma(x) - \alpha_{\hat k}(x) \ \ \ \ \ (2)$

for all ${\hat k, \gamma, x}$ and some functions ${\alpha_{\hat k}: X \rightarrow {\mathbf T}}$ , and our task is then to produce a function ${F: X \rightarrow K}$ for which

$\displaystyle \rho_\gamma(x) = F \circ T^\gamma(x) - F(x)$

for all ${\gamma,x}$ .

Comparing the two equations, the task would be easy if we could find an ${F: X \rightarrow K}$ for which

$\displaystyle \langle \hat k, F(x) \rangle = \alpha_{\hat k}(x) \ \ \ \ \ (3)$

for all ${\hat k, x}$ . However there is an obstruction to this: the left-hand side of (3) is additive in ${\hat k}$ , so the right-hand side would have to be also in order to obtain such a representation. In other words, for this strategy to work, one would have to first establish the identity

$\displaystyle \alpha_{\hat k_1 + \hat k_2}(x) - \alpha_{\hat k_1}(x) - \alpha_{\hat k_2}(x) = 0 \ \ \ \ \ (4)$

for all ${\hat k_1, \hat k_2, x}$ . On the other hand, the good news is that if we somehow manage to obtain the equation, then we can obtain a function ${F}$ obeying (3), thanks to Pontryagin duality, which gives a one-to-one correspondence between ${K}$ and the homomorphisms of the (discrete) group ${\hat K}$ to ${\mathbf{T}}$ .

Now, it turns out that one cannot derive the equation (4) directly from the given information (2). However, the left-hand side of (2) is additive in ${\hat k}$ , so the right-hand side must be also. Manipulating this fact, we eventually arrive at

$\displaystyle (\alpha_{\hat k_1 + \hat k_2} - \alpha_{\hat k_1} - \alpha_{\hat k_2}) \circ T^\gamma(x) = (\alpha_{\hat k_1 + \hat k_2} - \alpha_{\hat k_1} - \alpha_{\hat k_2})(x).$

In other words, we don’t get to show that the left-hand side of (4) vanishes, but we do at least get to show that it is ${\Gamma}$ -invariant. Now let us assume for sake of argument that the action of ${\Gamma}$ is ergodic, which (ignoring issues about sets of measure zero) basically asserts that the only ${\Gamma}$ -invariant functions are constant. So now we get a weaker version of (4), namely

$\displaystyle \alpha_{\hat k_1 + \hat k_2}(x) - \alpha_{\hat k_1}(x) - \alpha_{\hat k_2}(x) = c_{\hat k_1, \hat k_2} \ \ \ \ \ (5)$

for some constants ${c_{\hat k_1, \hat k_2} \in \mathbf{T}}$ .

Now we need to eliminate the constants. This can be done by the following group-theoretic projection. Let ${L^0({\bf X} \rightarrow {\bf T})}$ denote the space of concrete measurable maps ${\alpha}$ from ${{\bf X}}$ to ${{\bf T}}$ , up to almost everywhere equivalence; this is an abelian group where the various terms in (5) naturally live. Inside this group we have the subgroup ${{\bf T}}$ of constant functions (up to almost everywhere equivalence); this is where the right-hand side of (5) lives. Because ${{\bf T}}$ is a divisible group, there is an application of Zorn’s lemma (a good exercise for those who are not acquainted with these things) to show that there exists a retraction ${w: L^0({\bf X} \rightarrow {\bf T}) \rightarrow {\bf T}}$ , that is to say a group homomorphism that is the identity on the subgroup ${{\bf T}}$ . We can use this retraction, or more precisely the complement ${\alpha \mapsto \alpha - w(\alpha)}$ , to eliminate the constant in (5). Indeed, if we set

$\displaystyle \tilde \alpha_{\hat k}(x) := \alpha_{\hat k}(x) - w(\alpha_{\hat k})$

then from (5) we see that

$\displaystyle \tilde \alpha_{\hat k_1 + \hat k_2}(x) - \tilde \alpha_{\hat k_1}(x) - \tilde \alpha_{\hat k_2}(x) = 0$

while from (2) one has

$\displaystyle \langle \hat k, \rho_\gamma(x) \rangle = \tilde \alpha_{\hat k} \circ T^\gamma(x) - \tilde \alpha_{\hat k}(x)$

and now the previous strategy works with ${\alpha_{\hat k}}$ replaced by ${\tilde \alpha_{\hat k}}$ . This concludes the sketch of proof of Theorem 1.

In making the above argument rigorous, the hypotheses (i)-(iii) are used in several places. For instance, to reduce to the ergodic case one relies on the ergodic decomposition, which requires the hypothesis (ii). Also, most of the above equations only hold outside of a set of measure zero, and the hypothesis (i) and the hypothesis (iii) (which is equivalent to ${\hat K}$ being at most countable) to avoid the problem that an uncountable union of sets of measure zero could have positive measure (or fail to be measurable at all).

My co-author Asgar Jamneshan and I are working on a long-term project to extend many results in ergodic theory (such as the aforementioned Host-Kra structure theorem) to “uncountable” settings in which hypotheses analogous to (i)-(iii) are omitted; thus we wish to consider actions on uncountable groups, on spaces that are not standard Borel, and cocycles taking values in groups that are not metrisable. Such uncountable contexts naturally arise when trying to apply ergodic theory techniques to combinatorial problems (such as the inverse conjecture for the Gowers norms), as one often relies on the ultraproduct construction (or something similar) to generate an ergodic theory translation of these problems, and these constructions usually give “uncountable” objects rather than “countable” ones. (For instance, the ultraproduct of finite groups is a hyperfinite group, which is usually uncountable.). This paper marks the first step in this project by extending the Moore-Schmidt theorem to the uncountable setting.

If one simply drops the hypotheses (i)-(iii) and tries to prove the Moore-Schmidt theorem, several serious difficulties arise. We have already mentioned the loss of the ergodic decomposition and the possibility that one has to control an uncountable union of null sets. But there is in fact a more basic problem when one deletes (iii): the addition operation ${+: K \times K \rightarrow K}$ , while still continuous, can fail to be measurable as a map from ${(K \times K, {\mathcal B}(K) \otimes {\mathcal B}(K))}$ to ${(K, {\mathcal B}(K))}$ ! Thus for instance the sum of two measurable functions ${F: X \rightarrow K}$ need not remain measurable, which makes even the very definition of a measurable cocycle or measurable coboundary problematic (or at least unnatural). This phenomenon is known as the Nedoma pathology. A standard example arises when ${K}$ is the uncountable torus ${{\mathbf T}^{{\bf R}}}$ , endowed with the product topology. Crucially, the Borel ${\sigma}$ -algebra ${{\mathcal B}(K)}$ generated by this uncountable product is not the product ${{\mathcal B}(\mathbf{T})^{\otimes {\bf R}}}$ of the factor Borel ${\sigma}$ -algebras (the discrepancy ultimately arises from the fact that topologies permit uncountable unions, but ${\sigma}$ -algebras do not); relating to this, the product ${\sigma}$ -algebra ${{\mathcal B}(K) \otimes {\mathcal B}(K)}$ is not the same as the Borel ${\sigma}$ -algebra ${{\mathcal B}(K \times K)}$ , but is instead a strict sub-algebra. If the group operations on ${K}$ were measurable, then the diagonal set

$\displaystyle K^\Delta := \{ (k,k') \in K \times K: k = k' \} = \{ (k,k') \in K \times K: k - k' = 0 \}$

would be measurable in ${{\mathcal B}(K) \otimes {\mathcal B}(K)}$ . But it is an easy exercise in manipulation of ${\sigma}$ -algebras to show that if ${(X, {\mathcal X}), (Y, {\mathcal Y})}$ are any two measurable spaces and ${E \subset X \times Y}$ is measurable in ${{\mathcal X} \otimes {\mathcal Y}}$ , then the fibres ${E_x := \{ y \in Y: (x,y) \in E \}}$ of ${E}$ are contained in some countably generated subalgebra of ${{\mathcal Y}}$ . Thus if ${K^\Delta}$ were ${{\mathcal B}(K) \otimes {\mathcal B}(K)}$ -measurable, then all the points of ${K}$ would lie in a single countably generated ${\sigma}$ -algebra. But the cardinality of such an algebra is at most ${2^{\alpha_0}}$ while the cardinality of ${K}$ is ${2^{2^{\alpha_0}}}$ , and Cantor’s theorem then gives a contradiction.

To resolve this problem, we give ${K}$ a coarser ${\sigma}$ -algebra than the Borel ${\sigma}$ -algebra, namely the Baire ${\sigma}$ -algebra ${{\mathcal B}^\otimes(K)}$ , thus coarsening the measurable space structure on ${K = (K,{\mathcal B}(K))}$ to a new measurable space ${K_\otimes := (K, {\mathcal B}^\otimes(K))}$ . In the case of compact Hausdorff abelian groups, ${{\mathcal B}^{\otimes}(K)}$ can be defined as the ${\sigma}$ -algebra generated by the characters ${\hat k: K \rightarrow {\mathbf T}}$ ; for more general compact abelian groups, one can define ${{\mathcal B}^{\otimes}(K)}$ as the ${\sigma}$ -algebra generated by all continuous maps into metric spaces. This ${\sigma}$ -algebra is equal to ${{\mathcal B}(K)}$ when ${K}$ is metrisable but can be smaller for other ${K}$ . With this measurable structure, ${K_\otimes}$ becomes a measurable group; it seems that once one leaves the metrisable world that ${K_\otimes}$ is a superior (or at least equally good) space to work with than ${K}$ for analysis, as it avoids the Nedoma pathology. (For instance, from Plancherel’s theorem, we see that if ${m_K}$ is the Haar probability measure on ${K}$ , then ${L^2(K,m_K) = L^2(K_\otimes,m_K)}$ (thus, every ${K}$ -measurable set is equivalent modulo ${m_K}$ -null sets to a ${K_\otimes}$ -measurable set), so there is no damage to Plancherel caused by passing to the Baire ${\sigma}$ -algebra.

Passing to the Baire ${\sigma}$ -algebra ${K_\otimes}$ fixes the most severe problems with an uncountable Moore-Schmidt theorem, but one is still faced with an issue of having to potentially take an uncountable union of null sets. To avoid this sort of problem, we pass to the framework of abstract measure theory, in which we remove explicit mention of “points” and can easily delete all null sets at a very early stage of the formalism. In this setup, the category of concrete measurable spaces is replaced with the larger category of abstract measurable spaces, which we formally define as the opposite category of the category of ${\sigma}$ -algebras (with Boolean algebra homomorphisms). Thus, we define an abstract measurable space to be an object of the form ${{\mathcal X}^{\mathrm{op}}}$ , where ${{\mathcal X}}$ is an (abstract) ${\sigma}$ -algebra and ${\mathrm{op}}$ is a formal placeholder symbol that signifies use of the opposite category, and an abstract measurable map ${T: {\mathcal X}^{\mathrm{op}} \rightarrow {\mathcal Y}^{\mathrm{op}}}$ is an object of the form ${(T^*)^{\mathrm{op}}}$ , where ${T^*: {\mathcal Y} \rightarrow {\mathcal X}}$ is a Boolean algebra homomorphism and ${\mathrm{op}}$ is again used as a formal placeholder; we call ${T^*}$ the pullback map associated to ${T}$ . [UPDATE: It turns out that this definition of a measurable map led to technical issues. In a forthcoming revision of the paper we also impose the requirement that the abstract measurable map be $\sigma$ -complete (i.e., it respects countable joins).] The composition ${S \circ T: {\mathcal X}^{\mathrm{op}} \rightarrow {\mathcal Z}^{\mathrm{op}}}$ of two abstract measurable maps ${T: {\mathcal X}^{\mathrm{op}} \rightarrow {\mathcal Y}^{\mathrm{op}}}$ , ${S: {\mathcal Y}^{\mathrm{op}} \rightarrow {\mathcal Z}^{\mathrm{op}}}$ is defined by the formula ${S \circ T := (T^* \circ S^*)^{\mathrm{op}}}$ , or equivalently ${(S \circ T)^* = T^* \circ S^*}$ .

Every concrete measurable space ${X = (X,{\mathcal X})}$ can be identified with an abstract counterpart ${{\mathcal X}^{op}}$ , and similarly every concrete measurable map ${T: X \rightarrow Y}$ can be identified with an abstract counterpart ${(T^*)^{op}}$ , where ${T^*: {\mathcal Y} \rightarrow {\mathcal X}}$ is the pullback map ${T^* E := T^{-1}(E)}$ . Thus the category of concrete measurable spaces can be viewed as a subcategory of the category of abstract measurable spaces. The advantage of working in the abstract setting is that it gives us access to more spaces that could not be directly defined in the concrete setting. Most importantly for us, we have a new abstract space, the opposite measure algebra ${X_\mu}$ of ${X}$ , defined as ${({\bf X}/{\bf N})^*}$ where ${{\bf N}}$ is the ideal of null sets in ${{\bf X}}$ . Informally, ${X_\mu}$ is the space ${X}$ with all the null sets removed; there is a canonical abstract embedding map ${\iota: X_\mu \rightarrow X}$ , which allows one to convert any concrete measurable map ${f: X \rightarrow Y}$ into an abstract one ${[f]: X_\mu \rightarrow Y}$ . One can then define the notion of an abstract action, abstract cocycle, and abstract coboundary by replacing every occurrence of the category of concrete measurable spaces with their abstract counterparts, and replacing ${X}$ with the opposite measure algebra ${X_\mu}$ ; see the paper for details. Our main theorem is then

Theorem 2 (Uncountable Moore-Schmidt theorem) Let ${\Gamma}$ be a discrete group acting abstractly on a ${\sigma}$ -finite measure space ${X}$ . Let ${K}$ be a compact Hausdorff abelian group. Then a ${K_\otimes}$ -valued abstract measurable cocycle ${\rho = (\rho_\gamma)_{\gamma \in \Gamma}}$ is an abstract coboundary if and only if for each character ${\hat k \in \hat K}$ , the ${\mathbf{T}}$ -valued cocycles ${\langle \hat k, \rho \rangle = ( \langle \hat k, \rho_\gamma \rangle )_{\gamma \in \Gamma}}$ are abstract coboundaries.

With the abstract formalism, the proof of the uncountable Moore-Schmidt theorem is almost identical to the countable one (in fact we were able to make some simplifications, such as avoiding the use of the ergodic decomposition). A key tool is what we call a “conditional Pontryagin duality” theorem, which asserts that if one has an abstract measurable map ${\alpha_{\hat k}: X_\mu \rightarrow {\bf T}}$ for each ${\hat k \in K}$ obeying the identity ${ \alpha_{\hat k_1 + \hat k_2} - \alpha_{\hat k_1} - \alpha_{\hat k_2} = 0}$ for all ${\hat k_1,\hat k_2 \in \hat K}$ , then there is an abstract measurable map ${F: X_\mu \rightarrow K_\otimes}$ such that ${\alpha_{\hat k} = \langle \hat k, F \rangle}$ for all ${\hat k \in \hat K}$ . This is derived from the usual Pontryagin duality and some other tools, most notably the completeness of the ${\sigma}$ -algebra of ${X_\mu}$ , and the Sikorski extension theorem.

We feel that it is natural to stay within the abstract measure theory formalism whenever dealing with uncountable situations. However, it is still an interesting question as to when one can guarantee that the abstract objects constructed in this formalism are representable by concrete analogues. The basic questions in this regard are:

(i) Suppose one has an abstract measurable map ${f: X_\mu \rightarrow Y}$ into a concrete measurable space. Does there exist a representation of ${f}$ by a concrete measurable map ${\tilde f: X \rightarrow Y}$ ? Is it unique up to almost everywhere equivalence?
(ii) Suppose one has a concrete cocycle that is an abstract coboundary. When can it be represented by a concrete coboundary?

For (i) the answer is somewhat interesting (as I learned after posing this MathOverflow question):

If ${Y}$ does not separate points, or is not compact metrisable or Polish, there can be counterexamples to uniqueness. If ${Y}$ is not compact or Polish, there can be counterexamples to existence.
If ${Y}$ is a compact metric space or a Polish space, then one always has existence and uniqueness.
If ${Y}$ is a compact Hausdorff abelian group, one always has existence.
If ${X}$ is a complete measure space, then one always has existence (from a theorem of Maharam).
If ${X}$ is the unit interval with the Borel ${\sigma}$ -algebra and Lebesgue measure, then one has existence for all compact Hausdorff ${Y}$ assuming the continuum hypothesis (from a theorem of von Neumann) but existence can fail under other extensions of ZFC (from a theorem of Shelah, using the method of forcing).
For more general ${X}$ , existence for all compact Hausdorff ${Y}$ is equivalent to the existence of a lifting from the ${\sigma}$ -algebra ${\mathcal{X}/\mathcal{N}}$ to ${\mathcal{X}}$ (or, in the language of abstract measurable spaces, the existence of an abstract retraction from ${X}$ to ${X_\mu}$ ).
It is a long-standing open question (posed for instance by Fremlin) whether it is relatively consistent with ZFC that existence holds whenever ${Y}$ is compact Hausdorff.

Our understanding of (ii) is much less complete:

If ${K}$ is metrisable, the answer is “always” (which among other things establishes the countable Moore-Schmidt theorem as a corollary of the uncountable one).
If ${\Gamma}$ is at most countable and ${X}$ is a complete measure space, then the answer is again “always”.

In view of the answers to (i), I would not be surprised if the full answer to (ii) was also sensitive to axioms of set theory. However, such set theoretic issues seem to be almost completely avoided if one sticks with the abstract formalism throughout; they only arise when trying to pass back and forth between the abstract and concrete categories.

254A, Notes 9 – second moment and entropy methods

12 November, 2019 in 254A - analytic prime number theory, math.IT, math.NT | Tags: correlation, entropy decrement argument, multiplicative functions, second moment method, Shannon entropy | by Terence Tao | 16 comments

In these notes we presume familiarity with the basic concepts of probability theory, such as random variables (which could take values in the reals, vectors, or other measurable spaces), probability, and expectation. Much of this theory is in turn based on measure theory, which we will also presume familiarity with. See for instance this previous set of lecture notes for a brief review.

The basic objects of study in analytic number theory are deterministic; there is nothing inherently random about the set of prime numbers, for instance. Despite this, one can still interpret many of the averages encountered in analytic number theory in probabilistic terms, by introducing random variables into the subject. Consider for instance the form

$\displaystyle \sum_{n \leq x} \mu(n) = o(x) \ \ \ \ \ (1)$

of the prime number theorem (where we take the limit ${x \rightarrow \infty}$ ). One can interpret this estimate probabilistically as

$\displaystyle {\mathbb E} \mu(\mathbf{n}) = o(1) \ \ \ \ \ (2)$

where ${\mathbf{n} = \mathbf{n}_{\leq x}}$ is a random variable drawn uniformly from the natural numbers up to ${x}$ , and ${{\mathbb E}}$ denotes the expectation. (In this set of notes we will use boldface symbols to denote random variables, and non-boldface symbols for deterministic objects.) By itself, such an interpretation is little more than a change of notation. However, the power of this interpretation becomes more apparent when one then imports concepts from probability theory (together with all their attendant intuitions and tools), such as independence, conditioning, stationarity, total variation distance, and entropy. For instance, suppose we want to use the prime number theorem (1) to make a prediction for the sum

$\displaystyle \sum_{n \leq x} \mu(n) \mu(n+1).$

After dividing by ${x}$ , this is essentially

$\displaystyle {\mathbb E} \mu(\mathbf{n}) \mu(\mathbf{n}+1).$

With probabilistic intuition, one may expect the random variables ${\mu(\mathbf{n}), \mu(\mathbf{n}+1)}$ to be approximately independent (there is no obvious relationship between the number of prime factors of ${\mathbf{n}}$ , and of ${\mathbf{n}+1}$ ), and so the above average would be expected to be approximately equal to

$\displaystyle ({\mathbb E} \mu(\mathbf{n})) ({\mathbb E} \mu(\mathbf{n}+1))$

which by (2) is equal to ${o(1)}$ . Thus we are led to the prediction

$\displaystyle \sum_{n \leq x} \mu(n) \mu(n+1) = o(x). \ \ \ \ \ (3)$

The asymptotic (3) is widely believed (it is a special case of the Chowla conjecture, which we will discuss in later notes; while there has been recent progress towards establishing it rigorously, it remains open for now.

How would one try to make these probabilistic intuitions more rigorous? The first thing one needs to do is find a more quantitative measurement of what it means for two random variables to be “approximately” independent. There are several candidates for such measurements, but we will focus in these notes on two particularly convenient measures of approximate independence: the “ ${L^2}$ ” measure of independence known as covariance, and the “ ${L \log L}$ ” measure of independence known as mutual information (actually we will usually need the more general notion of conditional mutual information that measures conditional independence). The use of ${L^2}$ type methods in analytic number theory is well established, though it is usually not described in probabilistic terms, being referred to instead by such names as the “second moment method”, the “large sieve” or the “method of bilinear sums”. The use of ${L \log L}$ methods (or “entropy methods”) is much more recent, and has been able to control certain types of averages in analytic number theory that were out of reach of previous methods such as ${L^2}$ methods. For instance, in later notes we will use entropy methods to establish the logarithmically averaged version

$\displaystyle \sum_{n \leq x} \frac{\mu(n) \mu(n+1)}{n} = o(\log x) \ \ \ \ \ (4)$

of (3), which is implied by (3) but strictly weaker (much as the prime number theorem (1) implies the bound ${\sum_{n \leq x} \frac{\mu(n)}{n} = o(\log x)}$ , but the latter bound is much easier to establish than the former).

As with many other situations in analytic number theory, we can exploit the fact that certain assertions (such as approximate independence) can become significantly easier to prove if one only seeks to establish them on average, rather than uniformly. For instance, given two random variables ${\mathbf{X}}$ and ${\mathbf{Y}}$ of number-theoretic origin (such as the random variables ${\mu(\mathbf{n})}$ and ${\mu(\mathbf{n}+1)}$ mentioned previously), it can often be extremely difficult to determine the extent to which ${\mathbf{X},\mathbf{Y}}$ behave “independently” (or “conditionally independently”). However, thanks to second moment tools or entropy based tools, it is often possible to assert results of the following flavour: if ${\mathbf{Y}_1,\dots,\mathbf{Y}_k}$ are a large collection of “independent” random variables, and ${\mathbf{X}}$ is a further random variable that is “not too large” in some sense, then ${\mathbf{X}}$ must necessarily be nearly independent (or conditionally independent) to many of the ${\mathbf{Y}_i}$ , even if one cannot pinpoint precisely which of the ${\mathbf{Y}_i}$ the variable ${\mathbf{X}}$ is independent with. In the case of the second moment method, this allows us to compute correlations such as ${{\mathbb E} {\mathbf X} \mathbf{Y}_i}$ for “most” ${i}$ . The entropy method gives bounds that are significantly weaker quantitatively than the second moment method (and in particular, in its current incarnation at least it is only able to say non-trivial assertions involving interactions with residue classes at small primes), but can control significantly more general quantities ${{\mathbb E} F( {\mathbf X}, \mathbf{Y}_i )}$ for “most” ${i}$ thanks to tools such as the Pinsker inequality.

Read the rest of this entry »

	Student on Almost all Collatz orbits atta…
	Martin Lotz on Some slides from Basel
	Anonymous on 275A, Notes 0: Foundations of…
	Anonymous on 275A, Notes 0: Foundations of…
	Intuition for torus on Open question: What is a quant…
	Michael R on Some slides from Basel
	Michael R on Some slides from Basel
	Alexandre on Almost all Collatz orbits atta…
	Terence Tao on Almost all Collatz orbits atta…
	OUFASKA on On writing
	OUFASKA on On writing
	OUFASKA on On writing
	Alexandre on Almost all Collatz orbits atta…
	Robert Silverman on Some slides from Basel
	Anonymous on Some slides from Basel

What's new

Some slides from Basel

Louis Nirenberg

Equidistribution of Syracuse random variables and density of Collatz preimages

Some recent papers

Elgindi’s approximation of the Biot-Savart law

254A, Notes 10 – mean values of nonpretentious multiplicative functions

Maryam Mirzakhani New Frontiers Prize

Eigenvectors from Eigenvalues: a survey of a basic identity in linear algebra

An uncountable Moore-Schmidt theorem

254A, Notes 9 – second moment and entropy methods

Recent Comments

Articles by others

Diversions

Mathematics

Selected articles

Software

The sciences

Top Posts

Archives

Categories

The Polymath Blog

For commenters