← All blueprints

Essential Coding Theory — Blueprint

25 Appendix B. Some Useful Facts

25.1 B.1 Some Useful Inequalities

Lemma 561 Lower bound on the binomial coefficient, Lemma B.1.1
#

For all integers

\(\)1 ≤a ≤b\(, we have \[ \binom {b}{a} \geq \left(\frac{b}{a}\right)^a. \] \)

Lemma
#
Lemma 562 Stirling’s Approximation, Lemma B.1.2
#

For every integer

\(\)n ≥1\(, we have \[ \sqrt{2\pi n}\left(\frac{n}{e}\right)^n e^{\lambda _1(n)} {\lt} n! {\lt} \sqrt{2\pi n}\left(\frac{n}{e}\right)^n e^{\lambda _2(n)}, \] where \[ \lambda _1(n) = \frac{1}{12n+1} \quad \text{and} \quad \lambda _2(n) = \frac{1}{12n}. \] \)

Lemma
#
Lemma 563 Upper bound on the binomial coefficient, Lemma B.1.3
#

For all integers

\(\)1 ≤a ≤b\(, we have \[ \binom {b}{a} \leq \left(\frac{eb}{a}\right)^a. \] \)

Lemma
#
Lemma 564 Bernoulli’s Inequality, Lemma B.1.4
#

For every real numbers

\(\)k ≥1\( and \)x ≥-1\(, we have \[ (1+x)^k \geq 1 + kx. \] \)

Lemma
#
Lemma 565 Square-root approximation, Lemma B.1.5
#

For

\(\)|x| ≤1\(, \[ \sqrt{1+x} \leq 1 + \frac{x}{2} - \frac{x^2}{16}. \] \)

Lemma
#
Lemma 566 Cauchy–Schwarz inequality, Lemma B.1.6
#

For any vectors

\(\)x, y R^n\(, we have \[ |\langle x, y \rangle | \leq \| x\| _2 \cdot \| y\| _2. \] \)

Lemma
#

25.2 B.2 Some Useful Identities and Bounds

Lemma 567 Mediant inequality, Lemma B.2.1
#

Let

\(\)a, b, c, d > 0\(. Then \)ba ≤dc\( if and only if \)aa+b ≤cc+d\(. \)

Lemma
#
Lemma 568 Logarithm power series, Lemma B.2.2
#

For

\(\)|x| < 1\(, \[ \ln (1+x) = x - \frac{x^2}{2} + \frac{x^3}{3} - \cdots . \] \)

Lemma
#
Lemma 569 Logarithm bounds, Lemma B.2.3
#

For

\(\)0 ≤x < 1\(, we have \[ x - \frac{x^2}{2} \leq \ln (1+x) \leq x, \] and for \)0 ≤x ≤1/2\(, we have \[ -x - x^2 \leq \ln (1-x) \leq -x. \] \)

Lemma
#
Lemma 570 Entropy function bounds, Lemma B.2.4
#

For

\(\)x ≤1/4\(, we have \[ 1 - 5x^2 \leq H(1/2 - x) \leq 1 - x^2, \] where \)H\( denotes the binary entropy function. \)

Lemma
#
Lemma 571 Bound on (1+1/x)^x\(, Lemma B.2.5\)
#

For every real \(\)x > 0\(, \[ \left(1 + \frac{1}{x}\right)^x \leq e. \] \)