MarketDigamma function
Company Profile

Digamma function

In mathematics, the digamma function is defined as the logarithmic derivative of the gamma function:

Relation to harmonic numbers
The gamma function obeys the equation :\Gamma(z+1)=z\Gamma(z). \, Taking the logarithm on both sides and using the functional equation property of the log-gamma function gives: :\log \Gamma(z+1)=\log(z)+\log \Gamma(z), Differentiating both sides with respect to gives: :\psi(z+1)=\psi(z)+\frac{1}{z} Since the harmonic numbers are defined for positive integers as :H_n=\sum_{k=1}^n \frac 1 k, the digamma function is related to them by :\psi(n)=H_{n-1}-\gamma, where and is the Euler–Mascheroni constant. For half-integer arguments the digamma function takes the values : \psi \left(n+\tfrac12\right)=-\gamma-2\ln 2 +\sum_{k=1}^n \frac 2 {2k-1} = -\gamma-2\ln 2 + 2H_{2n}-H_n. ==Integral representations==
Integral representations
If the real part of is positive then the digamma function has the following integral representation due to Gauss: :\psi(z) = \int_0^\infty \left(\frac{e^{-t}}{t} - \frac{e^{-zt}}{1-e^{-t}}\right)\,dt. Combining this expression with an integral identity for the Euler–Mascheroni constant \gamma gives: :\psi(z + 1) = -\gamma + \int_0^1 \left(\frac{1-t^z}{1-t}\right)\,dt. The integral is Euler's harmonic number H_z, so the previous formula may also be written :\psi(z + 1) = \psi(1) + H_z. A consequence is the following generalization of the recurrence relation: :\psi(w + 1) - \psi(z + 1) = H_w - H_z. An integral representation due to Dirichlet is: :\psi(z) = \log z - \frac{1}{2z} - \int_0^\infty \left(\frac{1}{2} - \frac{1}{t} + \frac{1}{e^t - 1}\right)e^{-tz}\,dt. This formula is also a consequence of Binet's first integral for the gamma function. The integral may be recognized as a Laplace transform. Binet's second integral for the gamma function gives a different formula for \psi which also gives the first few terms of the asymptotic expansion: :\psi(z) = \log z - \frac{1}{2z} - 2\int_0^\infty \frac{t\,dt}{(t^2 + z^2)(e^{2\pi t} - 1)}. From the definition of \psi and the integral representation of the gamma function, one obtains :\psi(z) = \frac{1}{\Gamma(z)} \int_0^\infty t^{z-1} \ln (t) e^{-t}\,dt, with \Re z > 0. ==Infinite product representation==
Infinite product representation
The function \psi(z)/\Gamma(z) is an entire function, and it can be represented by the infinite product : \frac{\psi(z)}{\Gamma(z)}=-e^{2\gamma z}\prod_{k=0}^\infty\left(1-\frac{z}{x_k} \right)e^{\frac{z}{x_k}}. Here x_k is the kth zero of \psi (see below), and \gamma is the Euler–Mascheroni constant. Note: This is also equal to -\frac{d}{dz}\frac{1}{\Gamma(z)} due to the definition of the digamma function: \frac{\Gamma'(z)}{\Gamma(z)}=\psi(z). == Series representation ==
Series representation
Series formula Euler's product formula for the gamma function, combined with the functional equation and an identity for the Euler–Mascheroni constant, yields the following expression for the digamma function, valid in the complex plane outside the negative integers (Abramowitz and Stegun 6.3.16): reads :\begin{align} \psi(s) &= -\gamma + (s-1) - \frac{(s-1)(s-2)}{2\cdot2!} + \frac{(s-1)(s-2)(s-3)}{3\cdot3!}\cdots,\quad\Re(s)> 0, \\ &= -\gamma - \sum_{k=1}^\infty \frac{(-1)^k}{k} \binom{s-1}{k}\cdots,\quad\Re(s)> 0. \end{align} where is the binomial coefficient. It may also be generalized to :\psi(s+1) = -\gamma - \frac{1}{m} \sum_{k=1}^{m-1}\frac{m-k}{s+k} - \frac{1}{m}\sum_{k=1}^\infty\frac{(-1)^k}{k}\left\{\binom{s+m}{k+1}-\binom{s}{k+1}\right\},\qquad \Re(s)>-1, where Similar series with the Cauchy numbers of the second kind reads : \psi(v)=\ln(v-1) + \sum_{n=1}^\infty\frac{C_{n}(n-1)!}{(v)_{n}},\qquad \Re(v) >1, A series with the Bernoulli polynomials of the second kind has the following form : \psi(v)=\ln(v+a) + \sum_{n=1}^\infty\frac{(-1)^n\psi_{n}(a)\,(n-1)!}{(v)_{n}},\qquad \Re(v)>-a, where are the Bernoulli polynomials of the second kind defined by the generating equation : \frac{z(1+z)^a}{\ln(1+z)}= \sum_{n=0}^\infty z^n \psi_n(a) \,,\qquad |z| It may be generalized to : \psi(v)= \frac{1}{r}\sum_{l=0}^{r-1}\ln(v+a+l) + \frac{1}{r}\sum_{n=1}^\infty\frac{(-1)^n N_{n,r}(a)(n-1)!}{(v)_{n}}, \qquad \Re(v)>-a, \quad r=1,2,3,\ldots where the polynomials are given by the following generating equation : \frac{(1+z)^{a+m}-(1+z)^{a}}{\ln(1+z)}=\sum_{n=0}^\infty N_{n,m}(a) z^n , \qquad |z| so that . Similar expressions with the logarithm of the gamma function involve these formulas : \psi(v)= \frac{1}{v+a-\tfrac12}\left\{\ln\Gamma(v+a) + v - \frac12\ln2\pi - \frac12 + \sum_{n=1}^\infty\frac{(-1)^n \psi_{n+1}(a)}{(v)_{n}}(n-1)!\right\},\qquad \Re(v)>-a, and : \psi(v)= \frac{1}{\tfrac{1}{2}r+v+a-1}\left\{\ln\Gamma(v+a) + v - \frac12\ln2\pi - \frac12 + \frac{1}{r}\sum_{n=0}^{r-2} (r-n-1)\ln(v+a+n) +\frac{1}{r}\sum_{n=1}^\infty\frac{(-1)^n N_{n+1,r}(a)}{(v)_{n}}(n-1)!\right\}, where \Re(v)>-a and r=2,3,4,\ldots. ==Reflection formula==
Reflection formula
The digamma and polygamma functions satisfy reflection formulas similar to that of the gamma function: :\psi(1-x)-\psi(x)=\pi \cot \pi x. :\psi'(-x)+\psi'(x) = \frac{\pi^2}{\sin^2(\pi x)}+\frac{1}{x^2}. :\psi(-x)-\psi(x) = \frac{2\pi^3 \cot(\pi x)}{\sin^2(\pi x)}+\frac{2}{x^3}. ==Recurrence formula and characterization==
Recurrence formula and characterization
The digamma function satisfies the recurrence relation :\psi(x+1)=\psi(x)+\frac{1}{x}. Thus, it can be said to "telescope" , for one has :\Delta [\psi](x)=\frac{1}{x} where is the forward difference operator. This satisfies the recurrence relation of a partial sum of the harmonic series, thus implying the formula :\psi(n)=H_{n-1}-\gamma where is the Euler–Mascheroni constant. Actually, is the only solution of the functional equation :F(x+1)=F(x)+\frac{1}{x} that is monotonic on and satisfies . This fact follows immediately from the uniqueness of the function given its recurrence equation and convexity restriction. This implies the useful difference equation: : \psi(x+N)-\psi(x)=\sum_{k=0}^{N-1} \frac{1}{x+k} ==Some finite sums involving the digamma function==
Some finite sums involving the digamma function
There are numerous finite summation formulas for the digamma function. Basic summation formulas, such as :\sum_{r=1}^m \psi\left(\frac{r}{m}\right)=-m(\gamma+\ln m), :\sum_{r=1}^m \psi\left(\frac{r}{m}\right)\cdot\exp\dfrac{2\pi rki}{m} = m\ln \left(1-\exp\frac{2\pi ki}{m}\right), \qquad k\in\Z,\quad m\in\N,\ k\ne m :\sum_{r=1}^{m-1} \psi\left(\frac{r}{m}\right)\cdot\cos\dfrac{2\pi rk}{m} = m \ln \left(2\sin\frac{k\pi}{m}\right)+\gamma, \qquad k=1, 2,\ldots, m-1 : \sum_{r=1}^{m-1}\psi \left(\frac{r}{m}\right) \cdot\sin\frac{2\pi rk}{m} =\frac{\pi}{2} (2k-m), \qquad k=1, 2,\ldots, m-1 are due to Gauss. More complicated formulas, such as : \sum_{r=0}^{m-1} \psi \left(\frac{2r+1}{2m}\right)\cdot\cos\frac{(2r+1)k\pi }{m} = m\ln\left(\tan\frac{\pi k}{2m}\right) ,\qquad k=1, 2,\ldots, m-1 : \sum_{r=0}^{m-1} \psi \left(\frac{2r+1}{2m}\right)\cdot\sin\dfrac{(2r+1)k\pi }{m} = -\frac{\pi m}{2}, \qquad k=1, 2,\ldots, m-1 :\sum_{r=1}^{m-1} \psi\left(\frac{r}{m}\right)\cdot\cot\frac{\pi r}{m}= -\frac{\pi(m-1)(m-2)}{6} :\sum_{r=1}^{m-1}\psi \left(\frac{r}{m}\right)\cdot \frac{r}{m}=-\frac{\gamma}{2}(m-1)-\frac{m}{2}\ln m -\frac{\pi}{2}\sum_{r=1}^{m-1} \frac{r}{m}\cdot\cot\frac{\pi r}{m} :\sum_{r=1}^{m-1}\psi \left(\frac{r}{m}\right) \cdot\cos\dfrac{(2\ell+1)\pi r}{m}= -\frac{\pi}{m}\sum_{r=1}^{m-1} \frac{r \cdot\sin\dfrac{2\pi r}{m}}{\cos\dfrac{2\pi r}{m} -\cos\dfrac{(2\ell+1)\pi }{m} }, \qquad \ell\in\mathbb{Z} :\sum_{r=1}^{m-1}\psi \left(\frac{r}{m}\right) \cdot\sin\dfrac{(2\ell+1)\pi r}{m}=-(\gamma+\ln2m)\cot\frac{(2\ell+1)\pi}{2m} + \sin\dfrac{(2\ell+1)\pi }{m}\sum_{r=1}^{m-1} \frac{\ln\sin\dfrac{\pi r}{m}} {\cos\dfrac{2\pi r}{m} -\cos\dfrac{(2\ell+1)\pi }{m} } , \qquad \ell\in\mathbb{Z} :\sum_{r=1}^{m-1} \psi^2\left(\frac{r}{m}\right)= (m-1)\gamma^2 + m(2\gamma+\ln4m)\ln{m} -m(m-1)\ln^2 2 +\frac{\pi^2 (m^2-3m+2)}{12} +m\sum_{\ell=1}^{ m-1 } \ln^2 \sin\frac{\pi\ell}{m} are due to works of certain modern authors (see e.g. Appendix B in Blagouchine (2014)). We also have : 1+\frac{1}{2}+\frac{1}{3}+...+\frac{1}{k-1}-\gamma-\ln k=\frac{1}{k}\sum_{n=0}^{k-1}\psi\left(1+\frac{n}{k}\right), k=2,3, ... ==Gauss's digamma theorem==
Gauss's digamma theorem
For positive integers and (), the digamma function may be expressed in terms of Euler's constant and a finite number of elementary functions :\psi\left(\frac{r}{m}\right) = -\gamma -\ln(2m) -\frac{\pi}{2}\cot\left(\frac{r\pi}{m}\right) +2\sum_{n=1}^{\left\lfloor \frac{m-1}{2} \right\rfloor} \cos\left(\frac{2\pi nr}{m} \right) \ln\sin\left(\frac{\pi n}{m}\right) which holds, because of its recurrence equation, for all rational arguments. ==Multiplication theorem==
Multiplication theorem
The multiplication theorem of the \Gamma-function is equivalent to :\psi(nz)=\frac{1}{n}\sum_{k=0}^{n-1} \psi\left(z+\frac{k}{n}\right) +\ln n . ==Asymptotic expansion==
Asymptotic expansion
The digamma function has the asymptotic expansion :\psi(z) \sim \ln z + \sum_{n=1}^\infty \frac{\zeta(1-n)}{z^n} = \ln z - \sum_{n=1}^\infty \frac{B_n}{nz^n}, where is the th Bernoulli number and is the Riemann zeta function. The first few terms of this expansion are: :\psi(z) \sim \ln z - \frac{1}{2z} - \frac{1}{12z^2} + \frac{1}{120z^4} - \frac{1}{252z^6} + \frac{1}{240z^8} - \frac{1}{132z^{10}} + \frac{691}{32760z^{12}} - \frac{1}{12z^{14}} + \cdots. Although the infinite sum does not converge for any , any finite partial sum becomes increasingly accurate as increases. The expansion can be found by applying the Euler–Maclaurin formula to the sum :\sum_{n=1}^\infty \left(\frac{1}{n} - \frac{1}{z + n}\right) The expansion can also be derived from the integral representation coming from Binet's second integral formula for the gamma function. Expanding t / (t^2 + z^2) as a geometric series and substituting an integral representation of the Bernoulli numbers leads to the same asymptotic series as above. Furthermore, expanding only finitely many terms of the series gives a formula with an explicit error term: :\psi(z) = \ln z - \frac{1}{2z} - \sum_{n=1}^N \frac{B_{2n}}{2nz^{2n}} + (-1)^{N+1}\frac{2}{z^{2N}} \int_0^\infty \frac{t^{2N+1}\,dt}{(t^2 + z^2)(e^{2\pi t} - 1)}. ==Inequalities==
Inequalities
When , the function :\ln x - \frac{1}{2x} - \psi(x) is completely monotonic and in particular positive. This is a consequence of Bernstein's theorem on monotone functions applied to the integral representation coming from Binet's first integral for the gamma function. Additionally, by the convexity inequality 1 + t \le e^t, the integrand in this representation is bounded above by e^{-tz}/2. :\frac{1}{x} - \ln x + \psi(x) is also completely monotonic. It follows that, for all , :\ln x - \frac{1}{x} \le \psi(x) \le \ln x - \frac{1}{2x}. This recovers a theorem of Horst Alzer. Alzer also proved that, for , :\frac{1 - s}{x + s} Related bounds were obtained by Elezovic, Giordano, and Pecaric, who proved that, for , :\ln(x + \tfrac{1}{2}) - \frac{1}{x} where \gamma=-\psi(1) is the Euler–Mascheroni constant. The constants (0.5 and e^{-\gamma}\approx0.56) appearing in these bounds are the best possible. The mean value theorem implies the following analog of Gautschi's inequality: If , where is the unique positive real root of the digamma function, and if , then :\exp\left((1 - s)\frac{\psi'(x + 1)}{\psi(x + 1)}\right) \le \frac{\psi(x + 1)}{\psi(x + s)} \le \exp\left((1 - s)\frac{\psi'(x + s)}{\psi(x + s)}\right). Moreover, equality holds if and only if . Inspired by the harmonic mean value inequality for the classical gamma function, Horzt Alzer and Graham Jameson proved, among other things, a harmonic mean-value inequality for the digamma function: -\gamma \leq \frac{2 \psi(x) \psi(\frac{1}{x})}{\psi(x)+\psi(\frac{1}{x})} for x>0 Equality holds if and only if x=1. ==Computation and approximation==
Computation and approximation
The asymptotic expansion gives an easy way to compute when the real part of is large. To compute for small , the recurrence relation : \psi(x+1) = \frac{1}{x} + \psi(x) can be used to shift the value of to a higher value. Beal suggests using the above recurrence to shift to a value greater than 6 and then applying the above expansion with terms above cut off, which yields "more than enough precision" (at least 12 digits except near the zeroes). As goes to infinity, gets arbitrarily close to both and . Going down from to , decreases by , decreases by , which is more than , and decreases by , which is less than . From this we see that for any positive greater than , :\psi(x)\in \left(\ln\left(x-\tfrac12\right), \ln x\right) or, for any positive , :\exp \psi(x)\in\left(x-\tfrac12,x\right). The exponential is approximately for large , but gets closer to at small , approaching 0 at . For , we can calculate limits based on the fact that between 1 and 2, , so :\psi(x)\in\left(-\frac{1}{x}-\gamma, 1-\frac{1}{x}-\gamma\right),\quad x\in(0, 1) or :\exp \psi(x)\in\left(\exp\left(-\frac{1}{x}-\gamma\right),e\exp\left(-\frac{1}{x}-\gamma\right)\right). From the above asymptotic series for , one can derive an asymptotic series for . The series matches the overall behaviour well, that is, it behaves asymptotically as it should for large arguments, and has a zero of unbounded multiplicity at the origin too. : \frac{1}{\exp \psi(x)} \sim \frac{1}{x}+\frac{1}{2\cdot x^2}+\frac{5}{4\cdot3!\cdot x^3}+\frac{3}{2\cdot4!\cdot x^4}+\frac{47}{48\cdot5!\cdot x^5} - \frac{5}{16\cdot6!\cdot x^6} + \cdots This is similar to a Taylor expansion of at , but it does not converge. (The function is not analytic at infinity.) A similar series exists for which starts with \exp \psi(x) \sim x- \frac 12. If one calculates the asymptotic series for it turns out that there are no odd powers of (there is no −1 term). This leads to the following asymptotic expansion, which saves computing terms of even order. : \exp \psi\left(x+\tfrac{1}{2}\right) \sim x + \frac{1}{4!\cdot x} - \frac{37}{8\cdot6!\cdot x^3} + \frac{10313}{72\cdot8!\cdot x^5} - \frac{5509121}{384\cdot10!\cdot x^7} + \cdots Similar in spirit to the Lanczos approximation of the \Gamma-function is Spouge's approximation. Another alternative is to use the recurrence relation or the multiplication formula to shift the argument of \psi(x) into the range 1\le x\le 3 and to evaluate the Chebyshev series there. ==Special values==
Special values
The digamma function has values in closed form for rational numbers, as a result of Gauss's digamma theorem. Some are listed below: :\begin{align} \psi(1) &= -\gamma \\ \psi\left(\tfrac{1}{2}\right) &= -2\ln{2} - \gamma \\ \psi\left(\tfrac{1}{3}\right) &= -\frac{\pi}{2\sqrt{3}} -\frac{3\ln{3}}{2} - \gamma \\ \psi\left(\tfrac{1}{4}\right) &= -\frac{\pi}{2} - 3\ln{2} - \gamma \\ \psi\left(\tfrac{1}{6}\right) &= -\frac{\pi\sqrt{3}}{2} -2\ln{2} -\frac{3\ln{3}}{2} - \gamma \\ \psi\left(\tfrac{1}{8}\right) &= -\frac{\pi}{2} - 4\ln{2} - \frac {\pi + \ln \left (\sqrt{2} + 1 \right ) - \ln \left (\sqrt{2} - 1 \right ) }{\sqrt{2}} - \gamma. \end{align} Moreover, by taking the logarithmic derivative of |\Gamma (bi)|^2 or |\Gamma (\tfrac{1}{2}+bi)|^2 where b is real-valued, it can easily be deduced that :\operatorname{Im} \psi(bi) = \frac{1}{2b}+\frac{\pi}{2}\coth (\pi b), :\operatorname{Im} \psi(\tfrac{1}{2}+bi) = \frac{\pi}{2}\tanh (\pi b). Apart from Gauss's digamma theorem, no such closed formula is known for the real part in general. We have, for example, at the imaginary unit the numerical approximation :\operatorname{Re} \psi(i) = -\gamma-\sum_{n=0}^\infty\frac{n-1}{n^3+n^2+n+1} \approx 0.09465. ==Roots of the digamma function==
Roots of the digamma function
The roots of the digamma function are the saddle points of the complex-valued gamma function. Thus they lie all on the real axis. The only one on the positive real axis is the unique minimum of the real-valued gamma function on at . All others occur single between the poles on the negative axis: : : : : :\vdots Already in 1881, Charles Hermite observed that :x_n = -n + \frac{1}{\ln n} + O\left(\frac{1}{(\ln n)^2}\right) holds asymptotically. A better approximation of the location of the roots is given by :x_n \approx -n + \frac{1}{\pi}\arctan\left(\frac{\pi}{\ln n}\right)\qquad n \ge 2 and using a further term it becomes still better :x_n \approx -n + \frac{1}{\pi}\arctan\left(\frac{\pi}{\ln n + \frac{1}{8n}}\right)\qquad n \ge 1 which both spring off the reflection formula via :0 = \psi(1-x_n) = \psi(x_n) + \frac{\pi}{\tan \pi x_n} and substituting by its not convergent asymptotic expansion. The correct second term of this expansion is , where the given one works well to approximate roots with small . Another improvement of Hermite's formula can be given: :\begin{align} \sum_{n=0}^\infty\frac{1}{x_n^2}&=\gamma^2+\frac{\pi^2}{2}, \\ \sum_{n=0}^\infty\frac{1}{x_n^3}&=-4\zeta(3)-\gamma^3-\frac{\gamma\pi^2}{2}, \\ \sum_{n=0}^\infty\frac{1}{x_n^4}&=\gamma^4+\frac{\pi^4}{9} + \frac23 \gamma^2 \pi^2 + 4\gamma\zeta(3). \end{align} In general, the function : Z(k)=\sum_{n=0}^\infty\frac{1}{x_n^k} can be determined and it is studied in detail by the cited authors. The following results :\begin{align} \sum_{n=0}^\infty\frac{1}{x_n^2+x_n}&=-2, \\ \sum_{n=0}^\infty\frac{1}{x_n^2-x_n}&=\gamma+\frac{\pi^2}{6\gamma} \end{align} also hold true. ==Regularization==
Regularization
The digamma function appears in the regularization of divergent integrals : \int_0^\infty \frac{dx}{x+a}, this integral can be approximated by a divergent general Harmonic series, but the following value can be attached to the series : \sum_{n=0}^\infty \frac{1}{n+a}= - \psi (a). ==In applied mathematics==
In applied mathematics
Many notable probability distributions use the gamma function in the definition of their probability density or mass functions. Then in statistics when doing maximum likelihood estimation on models involving such distributions, the digamma function naturally appears when the derivative of the log-likelihood is taken for finding the maxima. ==See also==
tickerdossier.comtickerdossier.substack.com