Mathlib.Probability.ConvergingTogether
This namespace collects the reusable pieces for the converging-together theorem.
CharFunBound 1 core · 3 supporting The "converging-together" theorem is proved through characteristic functions, and its load-bearing analytic input is the Lipschitz-in-L¹ bound on the difference of two pushforward characteristic functions: > for almost-e ★ norm_charFun_sub_le_L2
The characteristic-function approximation bound
The "converging-together" theorem is proved through characteristic functions, and its load-bearing
analytic input is the Lipschitz-in-L¹ bound on the difference of two pushforward
characteristic functions:
> for almost-everywhere measurable, real, integrable S T : Ω → ℝ on a finite measure μ
> and a frequency t : ℝ,
> ‖charFun (μ.map S) t − charFun (μ.map T) t‖ ≤ |t| · ∫ ω, |S ω − T ω| ∂μ.
The elementary ingredient is the pointwise estimate ‖cexp (a·I) − cexp (b·I)‖ ≤ |a − b|
(norm_cexp_mul_I_sub_cexp_mul_I_le). Applying Cauchy–Schwarz to the L¹ bound upgrades it to
the L² form ≤ |t| · √(∫ (S − T)²) (norm_charFun_sub_le_L2), the shape consumed by the
diagonal ε/3 argument of the converging-together theorem.
These are fully general real-random-variable statements; nothing here is specific to a network / m-dependent setting.
Characteristic-function approximation bound (L² form). Let be a probability measure and let be real random variables on the same space, with almost-everywhere measurable and almost-everywhere measurable; assume further that their difference is square-integrable under . Then for every real frequency , the characteristic functions of the laws of and differ at by at most times the norm of : .
Formal statement
Proof (Lean source)
3 supporting declarations (lemmas, instances)
-
norm_cexp_mul_I_sub_cexp_mul_I_letheorem — Pointwise Lipschitz bound for the unit-circle exponential. For real arguments a b, the chord between the points e^{ia} and e^{ib} on the unit circle is no longer than the arc, i.e. ‖exp (a·I) − exp (b·I)‖ ≤ |a − b|. This is the elementary input to the characteristic-function approximation bound.Proof (Lean source)
theorem norm_cexp_mul_I_sub_cexp_mul_I_le (a b : ℝ) : ‖Complex.exp (a * I) - exp (b * I)‖ ≤ |a - b| := by have harg : (a : ℂ) * I = (b : ℂ) * I + ((a - b : ℝ) : ℂ) * I := by norm_num [sub_eq_add_neg] ring calc ‖Complex.exp (a * I) - exp (b * I)‖ = ‖Complex.exp (b * I) * (exp (((a - b : ℝ) : ℂ) * I) - 1)‖ := by rw [harg, Complex.exp_add] ring_nf _ = ‖Complex.exp (b * I)‖ * ‖Complex.exp (((a - b : ℝ) : ℂ) * I) - 1‖ := by rw [norm_mul] _ = ‖Complex.exp (((a - b : ℝ) : ℂ) * I) - 1‖ := by rw [Complex.norm_exp_ofReal_mul_I] norm_num _ = ‖Complex.exp (I * ((a - b : ℝ) : ℂ)) - 1‖ := by rw [mul_comm] _ ≤ ‖a - b‖ := Real.norm_exp_I_mul_ofReal_sub_one_le _ = |a - b| := Real.norm_eq_abs _ -
norm_charFun_sub_letheorem — Almost-everywhere measurable real variables with an integrable difference have characteristic functions whose distance is at most the frequency magnitude times their expected absolute difference.hypothesesμ :S T :Ω → ℝhS :AEMeasurable S μhT :AEMeasurable T μhint :Integrable (fun ω => S ω - T ω) μt :ℝconclusion‖charFun (μ.map S) t - charFun (μ.map T) t‖ ≤ |t| * ∫ ω, |S ω - T ω| ∂μProof (Lean source)
theorem norm_charFun_sub_le (μ : Measure Ω) [IsFiniteMeasure μ] {S T : Ω → ℝ} (hS : AEMeasurable S μ) (hT : AEMeasurable T μ) (hint : Integrable (fun ω => S ω - T ω) μ) (t : ℝ) : ‖charFun (μ.map S) t - charFun (μ.map T) t‖ ≤ |t| * ∫ ω, |S ω - T ω| ∂μ := by let gS : Ω → ℂ := fun ω => exp ((t : ℂ) * (S ω : ℂ) * I) let gT : Ω → ℂ := fun ω => exp ((t : ℂ) * (T ω : ℂ) * I) have hgS_int : Integrable gS μ := by refine Integrable.of_bound ?_ 1 (ae_of_all μ fun ω => ?_) · dsimp [gS] fun_prop · dsimp [gS] calc ‖Complex.exp ((t : ℂ) * (S ω : ℂ) * I)‖ = ‖Complex.exp (((t * S ω : ℝ) : ℂ) * I)‖ := by congr 2 norm_num _ = 1 := Complex.norm_exp_ofReal_mul_I _ _ ≤ 1 := le_rfl have hgT_int : Integrable gT μ := by refine Integrable.of_bound ?_ 1 (ae_of_all μ fun ω => ?_) · dsimp [gT] fun_prop · dsimp [gT] calc ‖Complex.exp ((t : ℂ) * (T ω : ℂ) * I)‖ = ‖Complex.exp (((t * T ω : ℝ) : ℂ) * I)‖ := by congr 2 norm_num _ = 1 := Complex.norm_exp_ofReal_mul_I _ _ ≤ 1 := le_rfl have hcharS : charFun (μ.map S) t = ∫ ω, gS ω ∂μ := by rw [MeasureTheory.charFun_apply_real] exact MeasureTheory.integral_map hS (by fun_prop) have hcharT : charFun (μ.map T) t = ∫ ω, gT ω ∂μ := by rw [MeasureTheory.charFun_apply_real] exact MeasureTheory.integral_map hT (by fun_prop) have hdiff_int : Integrable (fun ω => gS ω - gT ω) μ := hgS_int.sub hgT_int have hnorm_int : Integrable (fun ω => ‖gS ω - gT ω‖) μ := hdiff_int.norm have hright_int : Integrable (fun ω => |t| * |S ω - T ω|) μ := hint.abs.const_mul |t| have hpoint : ∀ ω, ‖gS ω - gT ω‖ ≤ |t| * |S ω - T ω| := by intro ω calc ‖gS ω - gT ω‖ = ‖Complex.exp (((t * S ω : ℝ) : ℂ) * I) - exp (((t * T ω : ℝ) : ℂ) * I)‖ := by dsimp [gS, gT] congr 1 norm_num _ ≤ |t * S ω - t * T ω| := norm_cexp_mul_I_sub_cexp_mul_I_le (t * S ω) (t * T ω) _ = |t| * |S ω - T ω| := by rw [← mul_sub, abs_mul] rw [hcharS, hcharT] calc ‖(∫ ω, gS ω ∂μ) - ∫ ω, gT ω ∂μ‖ = ‖∫ ω, gS ω - gT ω ∂μ‖ := by rw [integral_sub hgS_int hgT_int] _ ≤ ∫ ω, ‖gS ω - gT ω‖ ∂μ := norm_integral_le_integral_norm _ _ ≤ ∫ ω, |t| * |S ω - T ω| ∂μ := integral_mono hnorm_int hright_int hpoint _ = |t| * ∫ ω, |S ω - T ω| ∂μ := by rw [integral_const_mul] -
integral_abs_le_sqrt_integral_sqtheorem — On a probability space, the expected norm of a square-integrable variable is at most the square root of its expected squared norm.hypothesesconclusion∫ ω, ‖f ω‖ ∂μ ≤ sqrt (∫ ω, ‖f ω‖ ^ 2 ∂μ)Proof (Lean source)
theorem integral_abs_le_sqrt_integral_sq (μ : Measure Ω) [IsProbabilityMeasure μ] {E : Type*} [NormedAddCommGroup E] (f : Ω → E) (hf : MemLp f 2 μ) : ∫ ω, ‖f ω‖ ∂μ ≤ sqrt (∫ ω, ‖f ω‖ ^ 2 ∂μ) := by have hpq : (2 : ℝ).HolderConjugate 2 := by rw [Real.holderConjugate_iff] constructor <;> norm_num have hf2 : MemLp (fun ω => ‖f ω‖) (ofReal 2) μ := by simpa only [show ofReal 2 = 2 by norm_num] using hf.norm have h1 : MemLp (fun _ : Ω => (1 : ℝ)) (ofReal 2) μ := by rw [show ofReal 2 = 2 by norm_num] exact memLp_const (1 : ℝ) have hkey := integral_mul_norm_le_Lp_mul_Lq (μ := μ) hpq hf2 h1 have hleft : (∫ ω, ‖f ω‖ * ‖(1 : ℝ)‖ ∂μ) = ∫ ω, ‖f ω‖ ∂μ := by simp have hsqrt : ∀ c : ℝ, c ^ (1 / (2:ℝ)) = sqrt c := by intro c rw [Real.sqrt_eq_rpow] have hnormsq : (∫ ω, ‖f ω‖ ^ (2 : ℝ) ∂μ) = ∫ ω, ‖f ω‖ ^ 2 ∂μ := by congr with ω exact Real.rpow_two _ have honesq : (∫ _ω : Ω, ‖(1 : ℝ)‖ ^ (2:ℝ) ∂μ) = 1 := by simp calc ∫ ω, ‖f ω‖ ∂μ = ∫ ω, ‖f ω‖ * ‖(1 : ℝ)‖ ∂μ := hleft.symm _ ≤ (∫ ω, ‖f ω‖ ^ (2:ℝ) ∂μ) ^ (1 / (2:ℝ)) * (∫ _ω : Ω, ‖(1 : ℝ)‖ ^ (2:ℝ) ∂μ) ^ (1 / (2:ℝ)) := by simpa using hkey _ = sqrt (∫ ω, ‖f ω‖ ^ 2 ∂μ) * sqrt 1 := by rw [hnormsq, hsqrt, hsqrt, honesq] _ = sqrt (∫ ω, ‖f ω‖ ^ 2 ∂μ) := by simp
Diagonal 3 core · 1 supporting This file proves the general converging-together theorem: a sequence of real random variables that is approximated in L² by a triangular family, each row of which converges in distribution to a common limit law G, itself ★ tendsto_inDistribution_of_l2_approx★ clt_of_l2_approx
The converging-together theorem (Billingsley Thm 3.2 / Slutsky for ⇒)
This file proves the general converging-together theorem: a sequence of real random variables
that is approximated in L² by a triangular family, each row of which converges in distribution to
a common limit law G, itself converges in distribution to G. This is the load-bearing diagonal
step of every approximation-based CLT (m-dependent approximation of a mixing field, blocking
arguments, …).
The proof is the standard characteristic-function ε/3 argument:
* for each frequency t, split
`‖charFun (law S n) t − charFun G t‖ ≤ ‖charFun (law S n) t − charFun (law T m n) t‖
+ ‖charFun (law T m n) t − charFun G t‖`;
* bound the first summand by the approximation bound charFun_sub_enorm_le_L2 plus the iterated
L² control (H2);
* the second summand tends to 0 by the per-row weak convergence (H1) (the easy direction of
Lévy continuity, tendsto_iff_tendsto_charFun.mp);
* pick m large then n large to conclude pointwise charFun (law S n) t → charFun G t;
* upgrade pointwise characteristic-function convergence to weak convergence with the clt
package's Lévy continuity theorem
MeasureTheory.ProbabilityMeasure.tendsto_iff_tendsto_charFun.
The L² discrepancies are controlled in ℝ≥0∞ via Filter.limsup, which sidesteps the
boundedness side-conditions of the real-valued limsup; the squared L² integral
∫ ω, (S n ω − T m n ω)² ∂(μ n) is wrapped with ENNReal.ofReal, a faithful rendering of
Billingsley's hypothesis limsupₙ ∫ |S − T|² ≤ ε.
Everything is stated for a general limit law G : ProbabilityMeasure ℝ; clt_of_l2_approx
specializes to the standard normal gaussianReal 0 1, the shape an m-dependent-approximation CLT
consumes.
Bundle a probability measure on ℝ (with an explicit IsProbabilityMeasure proof) as a ProbabilityMeasure ℝ. A thin wrapper around the subtype constructor whose declared return type keeps the bundled ProbabilityMeasure topology in scope (avoiding the raw-subtype unfolding that breaks 𝓝).
Definition (Lean source)
The converging-together theorem (Billingsley Thm 3.2). Let be a limit probability law on the reals, let be a sequence of real random variables, one on each probability space in a sequence, and for every row index let be the -th approximating triangular row of real random variables on the same spaces, with every square-integrable and every square-integrable. Suppose for every fixed row the law of converges weakly to as , and for every tolerance some row makes the limit superior over of at most , i.e. row approximates in uniformly enough in the iterated-limsup sense. Then the law of converges weakly to as .
Formal statement
Proof (Lean source)
Converging-together corollary for the standard normal (the CLT diagonal step). The specialization of tendsto_inDistribution_of_l2_approx to the standard normal limit law: let be a sequence of real random variables, one on each probability space in a sequence, and for every row index let be the -th approximating triangular row on the same spaces, with every square-integrable and every square-integrable. If for every fixed row the law of converges weakly to the standard normal as , i.e. row obeys its own standard-normal central limit theorem, and for every tolerance some row makes the limit superior over of at most , so row approximates in in the iterated-limsup sense, then the law of converges weakly to the standard normal as .
Formal statement
Proof (Lean source)
1 supporting declaration (lemmas, instances)
-
lawPM_coelemmaProof (Lean source)
@[simp] lemma lawPM_coe (m : Measure ℝ) (h : IsProbabilityMeasure m) : (lawPM m h : Measure ℝ) = m := rfl