Leibniz integral rule

{{math theorem | math_statement = Let f(x,t) be a function such that both f(x,t) and its partial derivative f_x(x, t) are continuous in t and x in some region of the xt-plane, including a(x) \leq t \leq b(x), x_0 \leq x \leq x_1. Also suppose that the functions a(x) and b(x) are both continuous and both have continuous derivatives for x_0 \leq x \leq x_1. Then, for x_0 \leq x \leq x_1, \frac{d}{dx} \left(\int_{a(x)}^{b(x)} f(x, t) \,dt\right) = f\big(x, b(x)\big) \cdot \frac{d}{dx} b(x) - f\big(x, a(x)\big) \cdot \frac{d}{dx} a(x) + \int_{a(x)}^{b(x)} \frac{\partial}{\partial x} f(x, t) \,dt.}} The right hand side may also be written using Lagrange's notation as: f(x, b(x)) \, b^\prime(x) - f(x, a(x)) \, a^\prime(x) + \displaystyle\int_{a(x)}^{b(x)} f_x(x, t) \,dt. Stronger versions of the theorem only require that the partial derivative exist almost everywhere, and not that it be continuous. This formula is the general form of the Leibniz integral rule and can be derived using the fundamental theorem of calculus. The (first) fundamental theorem of calculus is just the particular case of the above formula where a(x) = a \in \Reals is constant, b(x) = x, and f(x, t) = f(t) does not depend on x. If both upper and lower limits are taken as constants, then the formula takes the shape of an operator equation: \mathcal{I}_t \partial_x = \partial_x \mathcal{I}_t where \partial_x is the partial derivative with respect to x and \mathcal{I}_t is the integral operator with respect to t over a fixed interval. That is, it is related to the symmetry of second derivatives, but involving integrals as well as derivatives. This case is also known as the Leibniz integral rule. The following three basic theorems on the interchange of limits are essentially equivalent: • the interchange of a derivative and an integral (differentiation under the integral sign; i.e., Leibniz integral rule); • the change of order of partial derivatives; • the change of order of integration (integration under the integral sign; i.e., Fubini's theorem). == Three-dimensional, time-dependent case ==

A Leibniz integral rule for a two dimensional surface moving in three dimensional space is \frac {d}{dt} \iint_{\Sigma (t)} \mathbf{F} (\mathbf{r}, t) \cdot d \mathbf{A} = \iint_{\Sigma (t)} \left(\mathbf{F}_t (\mathbf{r}, t) + \left[\nabla \cdot \mathbf{F} (\mathbf{r}, t) \right] \mathbf{v} \right) \cdot d \mathbf{A} - \oint_{\partial \Sigma (t)} \left[ \mathbf{v} \times \mathbf{F} ( \mathbf{r}, t) \right] \cdot d \mathbf{s}, where: • is a vector field at the spatial position at time , • is the partial time derivative of the vector field, • is a surface bounded by the closed curve , • is a vector element of the surface , • is a vector element of the curve , • is the velocity of movement of the region , • is the vector divergence, • is the vector cross product, • The double integrals are surface integrals over the surface , and the line integral is over the bounding curve . == Higher dimensions ==

The Leibniz integral rule can be extended to multidimensional integrals. In two and three dimensions, this rule is better known from the field of fluid dynamics as the Reynolds transport theorem: \frac{d}{dt} \int_{D(t)} F(\mathbf x, t) \,dV = \int_{D(t)} \frac{\partial}{\partial t} F(\mathbf x, t)\,dV + \int_{\partial D(t)} F(\mathbf x, t) \mathbf v_b \cdot d\mathbf{\Sigma}, where F(\mathbf x, t) is a scalar function, and denote a time-varying connected region of R3 and its boundary, respectively, \mathbf v_b is the Eulerian velocity of the boundary (see Lagrangian and Eulerian coordinates) and is the unit normal component of the surface element. The general statement of the Leibniz integral rule requires concepts from differential geometry, specifically differential forms, exterior derivatives, wedge products and interior products. With those tools, the Leibniz integral rule in n dimensions is \frac{d}{dt}\int_{\Omega(t)}\omega=\int_{\Omega(t)} i_{\mathbf v}(d_x\omega)+\int_{\partial \Omega(t)} i_{\mathbf v} \omega + \int_{\Omega(t)} \dot{\omega}, where is a time-varying domain of integration, ω is a p-form, \mathbf v=\frac{\partial \mathbf x}{\partial t} is the vector field of the velocity, i_{\mathbf v} denotes the interior product with \mathbf v, ''d'x'ω is the exterior derivative of ω with respect to the space variables only and \dot{\omega} is the time derivative of ω''. The above formula can be deduced directly from the fact that the Lie derivative interacts nicely with integration of differential forms \frac{d}{dt}\int_{\Omega(t)} \omega = \int_{\Omega(t)} \mathcal{L}_\Psi \omega, for the spacetime manifold M = \mathbb{R} \times \mathbb{R}^3 , where the spacetime exterior derivative of \omega is d\omega= dt\wedge \dot\omega + d_x\omega and the surface \Omega(t) has spacetime velocity field \Psi=\frac{\partial}{\partial t}+ \mathbf v. Since \omega has only spatial components, the Lie derivative can be simplified using Cartan's magic formula, to \mathcal{L}_\Psi \omega = \mathcal{L}_{\mathbf v} \omega + \mathcal{L}_{\frac{\partial}{\partial t}} \omega = i_{\mathbf v} d\omega + d i_{\mathbf v} \omega + i_{\frac{\partial}{\partial t}} d \omega = i_{\mathbf v} d_{x} \omega + d i_{\mathbf v} \omega + \dot\omega which, after integrating over \Omega(t) and using generalized Stokes' theorem on the second term, reduces to the three desired terms. == Measure theory statement ==

Let X be an open subset of \mathbf{R}, and \Omega be a measure space. Suppose f\colon X \times \Omega \to \mathbf{R} satisfies the following conditions: • f(x,\omega) is a Lebesgue-integrable function of \omega for each x \in X. • For almost all \omega \in \Omega , the partial derivative f_x exists for all x \in X. • There is an integrable function \theta \colon \Omega \to \mathbf{R} such that |f_x(x,\omega)| \leq \theta ( \omega) for all x \in X and almost every \omega \in \Omega. Then, for all x \in X, \frac{d}{dx} \int_\Omega f(x, \omega) \, d\omega = \int_{\Omega} f_x (x, \omega) \, d\omega. The proof relies on the dominated convergence theorem and the mean value theorem (details below). == Proofs ==

Proof of basic form We first prove the case of constant limits of integration a and b. We use Fubini's theorem to change the order of integration. For every and , such that and both and are within , we have: \begin{align} \int_x^{x+h} \int_a^b f_x(x,t) \,dt \,dx &= \int_a^b \int_x^{x+h} f_x(x,t) \,dx \,dt \\[2ex] &= \int_a^b \left(f(x+h,t) - f(x,t)\right) \,dt \\[2ex] &= \int_a^b f(x+h,t) \,dt - \int_a^b f(x,t) \,dt \end{align} Note that the integrals at hand are well defined since f_x(x,t) is continuous at the closed rectangle [x_0, x_1] \times [a,b] and thus also uniformly continuous there; thus its integrals by either dt or dx are continuous in the other variable and also integrable by it (essentially this is because for uniformly continuous functions, one may pass the limit through the integration sign, as elaborated below). Therefore: \begin{align} \frac{ \int_a^b f(x+h,t) \,dt - \int_a^b f(x,t) \,dt }{h} &= \frac{1}{h}\int_x^{x+h} \int_a^b f_x(x,t) \,dt \,dx \\[2ex] &= \frac{F(x+h)-F(x)}{h} \end{align} Where we have defined: F(u) := \int_{x_0}^{u} \int_a^b f_x(x,t) \,dt \,dx (we may replace x0 here by any other point between x0 and x) F is differentiable with derivative \int_a^b f_x(x,t) \,dt , so we can take the limit where approaches zero. For the left hand side this limit is: \frac{d}{dx}\int_a^b f(x,t) \, dt For the right hand side, we get: F'(x) = \int_a^b f_x(x,t) \, dt And we thus prove the desired result: \frac{d}{dx}\int_a^b f(x,t) \, dt = \int_a^b f_x(x,t) \, dt Another proof using the bounded convergence theorem If the integrals at hand are Lebesgue integrals, we may use the bounded convergence theorem (valid for these integrals, but not for Riemann integrals) in order to show that the limit can be passed through the integral sign. Note that this proof is weaker in the sense that it only shows that fx(x,t) is Lebesgue integrable, but not that it is Riemann integrable. In the former (stronger) proof, if f(x,t) is Riemann integrable, then so is fx(x,t) (and thus is obviously also Lebesgue integrable). Let By the definition of the derivative, {{NumBlk||u'(x) = \lim_{h \to 0} \frac{u(x + h) - u(x)}{h}. |}} Substitute equation () into equation (). The difference of two integrals equals the integral of the difference, and 1/h is a constant, so \begin{align} u'(x) &= \lim_{h \to 0} \frac{\int_a^bf(x + h, t)\,dt - \int_a^b f(x, t)\,dt}{h} \\ &= \lim_{h \to 0} \frac{\int_a^b\left( f(x + h, t) - f(x,t) \right)\,dt}{h} \\ &= \lim_{h \to 0} \int_a^b \frac{f(x + h, t) - f(x, t)}{h} \,dt. \end{align} We now show that the limit can be passed through the integral sign. We claim that the passage of the limit under the integral sign is valid by the bounded convergence theorem (a corollary of the dominated convergence theorem). For each δ > 0, consider the difference quotient f_\delta(x, t) = \frac{f(x + \delta, t) - f(x, t)}{\delta}. For t fixed, the mean value theorem implies there exists z in the interval [x, x + δ] such that f_\delta(x, t) = f_x(z, t). Continuity of fx(x, t) and compactness of the domain together imply that fx(x, t) is bounded. The above application of the mean value theorem therefore gives a uniform (independent of t) bound on f_\delta(x, t). The difference quotients converge pointwise to the partial derivative fx by the assumption that the partial derivative exists. The above argument shows that for every sequence {δn} → 0, the sequence \{f_{\delta_n}(x, t)\} is uniformly bounded and converges pointwise to fx. The bounded convergence theorem states that if a sequence of functions on a set of finite measure is uniformly bounded and converges pointwise, then passage of the limit under the integral is valid. In particular, the limit and integral may be exchanged for every sequence {δn} → 0. Therefore, the limit as δ → 0 may be passed through the integral sign. If instead we only know that there is an integrable function \theta \colon \Omega \to \mathbf{R} such that |f_x(x,\omega)| \leq \theta ( \omega), then |f_\delta(x, t)| = |f_x(z, t)|\leq \theta(\omega) and the dominated convergence theorem allows us to move the limit inside of the integral. Variable limits form For a continuous real valued function g of one real variable, and real valued differentiable functions f_1 and f_2 of one real variable, \frac{d}{dx} \left( \int_{f_1(x)}^{f_2(x)} g(t) \,dt \right )= g\left(f_2(x)\right) {f_2'(x)} - g\left(f_1(x)\right) {f_1'(x)}. This follows from the chain rule and the First Fundamental Theorem of Calculus. Define G(x) = \int_{f_1(x)}^{f_2(x)} g(t) \, dt, and \Gamma(x) = \int_{0}^{x} g(t) \, dt. (The lower limit just has to be some number in the domain of g ) Then, G(x) can be written as a composition: G(x) = (\Gamma \circ f_2)(x) - (\Gamma \circ f_1)(x) . The Chain Rule then implies that G'(x) = \Gamma'\left(f_2(x)\right) f_2'(x) - \Gamma'\left(f_1(x)\right) f_1'(x). By the First Fundamental Theorem of Calculus, \Gamma'(x) = g(x) . Therefore, substituting this result above, we get the desired equation: G'(x) = g\left(f_2(x)\right) {f_2'(x)} - g\left(f_1(x)\right) {f_1'(x)}. Note: This form can be particularly useful if the expression to be differentiated is of the form: \int_{f_1(x)}^{f_2(x)} h(x) \, g(t) \,dt Because h(x) does not depend on the limits of integration, it may be moved out from under the integral sign, and the above form may be used with the Product rule, i.e., \begin{align} \frac{d}{dx} \left( \int_{f_1(x)}^{f_2(x)} h(x)g(t) \,dt \right ) &= \frac{d}{dx} \left(h(x) \int_{f_1(x)}^{f_2(x)} g(t) \,dt \right ) \\ &= h'(x)\int_{f_1(x)}^{f_2(x)} g(t) \,dt + h(x) \frac{d}{dx} \left(\int_{f_1(x)}^{f_2(x)} g(t) \,dt \right ) \end{align} General form with variable limits Set \varphi(\alpha) = \int_a^b f(x,\alpha)\,dx, where a and b are functions of α that exhibit increments Δa and Δb, respectively, when α is increased by Δα. Then, \begin{align} \Delta\varphi &= \varphi(\alpha + \Delta\alpha) - \varphi(\alpha) \\[4pt] &= \int_{a + \Delta a}^{b + \Delta b}f(x, \alpha + \Delta\alpha)\,dx - \int_a^b f(x, \alpha)\,dx \\[4pt] &= \int_{a + \Delta a}^af(x, \alpha + \Delta\alpha)\,dx + \int_a^bf(x, \alpha + \Delta\alpha)\,dx + \int_b^{b + \Delta b} f(x, \alpha+\Delta\alpha)\,dx - \int_a^b f(x, \alpha)\,dx \\[4pt] &= -\int_a^{a + \Delta a} f(x, \alpha + \Delta\alpha)\,dx + \int_a^b [f(x, \alpha + \Delta\alpha) - f(x,\alpha)]\,dx + \int_b^{b + \Delta b} f(x, \alpha + \Delta\alpha)\,dx. \end{align} A form of the mean value theorem, \int_a^b f(x)\,dx = (b - a)f(\xi), where a \Delta\varphi = -\Delta a f(\xi_1, \alpha + \Delta\alpha) + \int_a^b [f(x, \alpha + \Delta\alpha) - f(x,\alpha)]\,dx + \Delta b f(\xi_2, \alpha + \Delta\alpha). Divide by Δα and let Δα → 0. Notice ξ1 → a and ξ2 → b. We may pass the limit through the integral sign: \lim_{\Delta\alpha\to 0}\int_a^b \frac{f(x,\alpha + \Delta\alpha) - f(x,\alpha)}{\Delta\alpha}\,dx = \int_a^b \frac{\partial}{\partial\alpha}f(x, \alpha)\,dx, again by the bounded convergence theorem. This yields the general form of the Leibniz integral rule, \frac{d\varphi}{d\alpha} = \int_a^b \frac{\partial}{\partial\alpha}f(x, \alpha)\,dx + f(b, \alpha) \frac{db}{d\alpha} - f(a, \alpha)\frac{da}{d\alpha}. Alternative proof of the general form with variable limits, using the chain rule The general form of Leibniz's Integral Rule with variable limits can be derived as a consequence of the basic form of Leibniz's Integral Rule, the multivariable chain rule, and the first fundamental theorem of calculus. Suppose f is defined in a rectangle in the x - t plane, for x \in [x_1, x_2] and t \in [t_1, t_2] . Also, assume f and the partial derivative \frac{\partial f}{\partial x} are both continuous functions on this rectangle. Suppose a, b are differentiable real valued functions defined on [x_1, x_2], with values in [t_1, t_2] (i.e. for every x \in [x_1, x_2], a(x) , b(x) \in [t_1, t_2] ). Now, set F(x,y) = \int_{t_1}^{y} f(x,t)\,dt , \qquad \text{for} ~ x \in [x_1, x_2] ~\text{and}~ y \in [t_1, t_2] and G(x) = \int_{a(x)}^{b(x)} f(x,t)\,dt , \quad \text{for} ~ x \in [x_1, x_2] Then, by properties of definite Integrals, we can write G(x) = \int_{t_1}^{b(x)} f(x,t)\,dt - \int_{t_1}^{a(x)} f(x,t)\,dt = F(x, b(x)) - F(x, a(x)) Since the functions F, a, b are all differentiable (see the remark at the end of the proof), by the multivariable chain rule, it follows that G is differentiable, and its derivative is given by the formula: G'(x) = \left(\frac{\partial F}{\partial x} (x, b(x)) + \frac{\partial F}{\partial b(x)} (x, b(x) ) b'(x) \right) - \left(\frac{\partial F}{\partial x} (x, a(x)) + \frac{\partial F}{\partial a(x)} (x, a(x)) a'(x) \right) Now, note that for every x \in [x_1, x_2] , and for every y \in [t_1, t_2] , we have that \frac{\partial F}{\partial x}(x, y) = \int_{t_1}^y \frac{\partial f}{\partial x}(x,t) \, dt , because when taking the partial derivative with respect to x of F , we are keeping y fixed in the expression \int_{t_1}^{y} f(x,t)\,dt ; thus the basic form of Leibniz's Integral Rule with constant limits of integration applies. Next, by the first fundamental theorem of calculus, we have that \frac{\partial F}{\partial y}(x, y) = f(x,y) ; because when taking the partial derivative with respect to y of F , the first variable x is fixed, so the fundamental theorem can indeed be applied. Substituting these results into the equation for G'(x) above gives: \begin{align} G'(x) &= \left(\int_{t_1}^{b(x)} \frac{\partial f}{\partial x}(x,t) \, dt + f(x, b(x)) b'(x) \right) - \left(\int_{t_1}^{a(x)} \dfrac{\partial f}{\partial x}(x,t) \, dt + f(x, a(x)) a'(x) \right) \\[2pt] &= f(x,b(x)) b'(x) - f(x,a(x)) a'(x) + \int_{a(x)}^{b(x)} \frac{\partial f}{\partial x}(x,t) \, dt, \end{align} as desired. There is a technical point in the proof above which is worth noting: applying the Chain Rule to G requires that F already be differentiable. This is where we use our assumptions about f . As mentioned above, the partial derivatives of F are given by the formulas \frac{\partial F}{\partial x}(x, y) = \int_{t_1}^y \frac{\partial f}{\partial x}(x,t) \, dt and \frac{\partial F}{\partial y}(x, y) = f(x,y) . Since \dfrac{\partial f}{\partial x} is continuous, its integral is also a continuous function, and since f is also continuous, these two results show that both the partial derivatives of F are continuous. Since continuity of partial derivatives implies differentiability of the function, F is indeed differentiable. Three-dimensional, time-dependent form At time t the surface Σ in Figure 1 contains a set of points arranged about a centroid \mathbf{C}(t). The function \mathbf{F}(\mathbf{r}, t) can be written as \mathbf{F}(\mathbf{C}(t) + \mathbf{r} - \mathbf{C}(t), t) = \mathbf{F}(\mathbf{C}(t) + \mathbf{I}, t), with \mathbf{I} independent of time. Variables are shifted to a new frame of reference attached to the moving surface, with origin at \mathbf{C}(t). For a rigidly translating surface, the limits of integration are then independent of time, so: \frac {d}{dt} \left (\iint_{\Sigma (t)} d \mathbf{A}_{\mathbf{r}}\cdot \mathbf{F}(\mathbf{r}, t) \right) = \iint_\Sigma d \mathbf{A}_{\mathbf{I}} \cdot \frac {d}{dt}\mathbf{F}(\mathbf{C}(t) + \mathbf{I}, t), where the limits of integration confining the integral to the region Σ no longer are time dependent so differentiation passes through the integration to act on the integrand only: \frac {d}{dt}\mathbf{F}( \mathbf{C}(t) + \mathbf{I}, t) = \mathbf{F}_t(\mathbf{C}(t) + \mathbf{I}, t) + \mathbf{v \cdot \nabla F}(\mathbf{C}(t) + \mathbf{I}, t) = \mathbf{F}_t(\mathbf{r}, t) + \mathbf{v} \cdot \nabla \mathbf{F}(\mathbf{r}, t), with the velocity of motion of the surface defined by \mathbf{v} = \frac {d}{dt} \mathbf{C} (t). This equation expresses the material derivative of the field, that is, the derivative with respect to a coordinate system attached to the moving surface. Having found the derivative, variables can be switched back to the original frame of reference. We notice that (see article on curl) \nabla \times \left(\mathbf{v} \times \mathbf{F}\right) = (\nabla \cdot \mathbf{F} + \mathbf{F} \cdot \nabla) \mathbf{v}- (\nabla \cdot \mathbf{v} + \mathbf{v} \cdot \nabla) \mathbf{F}, and that Stokes theorem equates the surface integral of the curl over Σ with a line integral over : \frac{d}{dt} \left(\iint_{\Sigma (t)} \mathbf{F} (\mathbf{r}, t) \cdot d \mathbf{A}\right) = \iint_{\Sigma (t)} \big(\mathbf{F}_t (\mathbf{r}, t) + \left(\mathbf{F \cdot \nabla} \right)\mathbf{v} + \left(\nabla \cdot \mathbf{F} \right) \mathbf{v} - (\nabla \cdot \mathbf{v})\mathbf{F}\big)\cdot d\mathbf{A} - \oint_{\partial \Sigma (t)}\left(\mathbf{v} \times \mathbf{F}\right)\cdot d\mathbf{s}. The sign of the line integral is based on the right-hand rule for the choice of direction of line element ds. To establish this sign, for example, suppose the field F points in the positive z-direction, and the surface Σ is a portion of the xy-plane with perimeter ∂Σ. We adopt the normal to Σ to be in the positive z-direction. Positive traversal of ∂Σ is then counterclockwise (right-hand rule with thumb along z-axis). Then the integral on the left-hand side determines a positive flux of F through Σ. Suppose Σ translates in the positive x-direction at velocity v. An element of the boundary of Σ parallel to the y-axis, say ds, sweeps out an area vt × ds in time t. If we integrate around the boundary ∂Σ in a counterclockwise sense, vt × ds points in the negative z-direction on the left side of ∂Σ (where ds points downward), and in the positive z-direction on the right side of ∂Σ (where ds points upward), which makes sense because Σ is moving to the right, adding area on the right and losing it on the left. On that basis, the flux of F is increasing on the right of ∂Σ and decreasing on the left. However, the dot product . Consequently, the sign of the line integral is taken as negative. If v is a constant, \frac {d}{dt} \iint_{\Sigma (t)} \mathbf{F} (\mathbf{r}, t) \cdot d \mathbf{A} = \iint_{\Sigma (t)} \big(\mathbf{F}_t (\mathbf{r}, t) + \left(\nabla \cdot \mathbf{F} \right) \mathbf{v}\big) \cdot d \mathbf{A} - \oint_{\partial \Sigma (t)}\left(\mathbf{v} \times \mathbf{F}\right) \cdot \,d\mathbf{s}, which is the quoted result. This proof does not consider the possibility of the surface deforming as it moves. Alternative derivation Lemma. One has: \frac{\partial}{\partial b} \left (\int_a^b f(x) \,dx \right ) = f(b), \qquad \frac{\partial}{\partial a} \left (\int_a^b f(x) \,dx \right )= -f(a). Proof. From the proof of the fundamental theorem of calculus, \begin{align} \frac{\partial}{\partial b} \left(\int_a^b f(x) \,dx\right) &= \lim_{\Delta b \to 0} \frac{1}{\Delta b} \left( \int_a^{b+\Delta b} f(x)\,dx - \int_a^b f(x)\,dx \right) \\[1ex] &= \lim_{\Delta b \to 0} \frac{1}{\Delta b} \left( \int_a^b f(x) \, dx + \int_b^{b+\Delta b} f(x)\,dx - \int_a^b f(x)\,dx \right) \\[1ex] &= \lim_{\Delta b \to 0} \frac{1}{\Delta b} \int_b^{b+\Delta b} f(x)\,dx \\[1ex] &= \lim_{\Delta b \to 0} \frac{1}{\Delta b} \left[ f(b) \Delta b + O\left(\Delta b^2\right) \right] \\[1ex] &= f(b), \end{align} and \begin{align} \frac{\partial}{\partial a} \left (\int_a^b f(x) \,dx \right )&= \lim_{\Delta a \to 0} \frac{1}{\Delta a} \left[ \int_{a+\Delta a}^b f(x)\,dx - \int_a^b f(x)\,dx \right] \\[6pt] &= \lim_{\Delta a \to 0} \frac{1}{\Delta a} \int_{a+\Delta a}^a f(x)\,dx \\[6pt] &= \lim_{\Delta a \to 0} \frac{1}{\Delta a} \left[ -f(a) \Delta a + O\left(\Delta a^2\right) \right]\\[6pt] &= -f(a). \end{align} Suppose a and b are constant, and that f(x) involves a parameter α which is constant in the integration but may vary to form different integrals. Assume that f(x, α) is a continuous function of x and α in the compact set {(x, α) : α0 ≤ α ≤ α1 and a ≤ x ≤ b}, and that the partial derivative fα(x, α) exists and is continuous. If one defines: \varphi(\alpha) = \int_a^b f(x,\alpha)\,dx, then \varphi may be differentiated with respect to α by differentiating under the integral sign, i.e., \frac{d\varphi}{d\alpha}=\int_a^b\frac{\partial}{\partial\alpha}f(x,\alpha)\,dx. By the Heine–Cantor theorem it is uniformly continuous in that set. In other words, for any ε > 0 there exists Δα such that for all values of x in [a, b], |f(x,\alpha+\Delta \alpha)-f(x,\alpha)| On the other hand, \begin{align} \Delta\varphi &=\varphi(\alpha+\Delta \alpha)-\varphi(\alpha) \\[6pt] &=\int_a^b f(x,\alpha+\Delta\alpha)\,dx - \int_a^b f(x,\alpha)\, dx \\[6pt] &=\int_a^b \left (f(x,\alpha+\Delta\alpha)-f(x,\alpha) \right )\,dx \\[6pt] &\leq \varepsilon (b-a). \end{align} Hence φ(α) is a continuous function. Similarly if \frac{\partial}{\partial\alpha} f(x,\alpha) exists and is continuous, then for all ε > 0 there exists Δα such that: \forall x \in [a, b], \quad \left|\frac{f(x,\alpha+\Delta \alpha)-f(x,\alpha)}{\Delta \alpha} - \frac{\partial f}{\partial\alpha}\right| Therefore, \frac{\Delta \varphi}{\Delta \alpha}=\int_a^b\frac{f(x,\alpha+\Delta\alpha)-f(x,\alpha)}{\Delta \alpha}\,dx = \int_a^b \frac{\partial f(x,\alpha)}{\partial \alpha}\,dx + R, where |R| Now, ε → 0 as Δα → 0, so \lim_{{\Delta \alpha} \to 0}\frac{\Delta\varphi}{\Delta \alpha}= \frac{d\varphi}{d\alpha} = \int_a^b \frac{\partial}{\partial \alpha} f(x,\alpha)\,dx. This is the formula we set out to prove. Now, suppose \int_a^b f(x,\alpha)\,dx=\varphi(\alpha), where a and b are functions of α which take increments Δa and Δb, respectively, when α is increased by Δα. Then, \begin{align} \Delta\varphi &=\varphi(\alpha+\Delta\alpha)-\varphi(\alpha) \\[6pt] &=\int_{a+\Delta a}^{b+\Delta b}f(x,\alpha+\Delta\alpha)\,dx -\int_a^b f(x,\alpha)\,dx \\[6pt] &=\int_{a+\Delta a}^af(x,\alpha+\Delta\alpha)\,dx+\int_a^bf(x,\alpha+\Delta\alpha)\,dx+\int_b^{b+\Delta b}f(x,\alpha+\Delta\alpha)\,dx -\int_a^b f(x,\alpha)\,dx \\[6pt] &=-\int_a^{a+\Delta a} f(x,\alpha+\Delta\alpha)\,dx+\int_a^b[f(x,\alpha+\Delta\alpha)-f(x,\alpha)]\,dx+\int_b^{b+\Delta b} f(x,\alpha+\Delta\alpha)\,dx. \end{align} A form of the mean value theorem, \int_a^b f(x)\,dx=(b-a)f(\xi), where a \Delta\varphi=-\Delta a\,f(\xi_1,\alpha+\Delta\alpha)+\int_a^b[f(x,\alpha+\Delta\alpha)-f(x,\alpha)]\,dx+\Delta b\,f(\xi_2,\alpha+\Delta\alpha). Dividing by Δα, letting Δα → 0, noticing ξ1 → a and ξ2 → b and using the above derivation for \frac{d\varphi}{d\alpha} = \int_a^b\frac{\partial}{\partial \alpha} f(x,\alpha)\,dx yields \frac{d\varphi}{d\alpha} = \int_a^b\frac{\partial}{\partial \alpha} f(x,\alpha)\,dx+f(b,\alpha)\frac{\partial b}{\partial \alpha}-f(a,\alpha)\frac{\partial a}{\partial \alpha}. This is the general form of the Leibniz integral rule. == Examples ==

Example 1: Fixed limits Consider the function :\varphi(\alpha)=\int_0^1\frac{\alpha}{x^2+\alpha^2}\,dx. The function under the integral sign is not continuous at the point (x,\alpha)=(0,0), and the function \varphi(\alpha) has a discontinuity at \alpha=0 because \varphi(\alpha) approaches \pm\pi/2 as \alpha\to0^{\pm}. If we differentiate \varphi(\alpha) with respect to \alpha under the integral sign, we get \frac{d}{d\alpha} \varphi(\alpha)=\int_0^1\frac{\partial}{\partial\alpha}\left(\frac{\alpha}{x^2+\alpha^2}\right)\,dx=\int_0^1\frac{x^2-\alpha^2}{(x^2+\alpha^2)^2} dx=\left.-\frac{x}{x^2+\alpha^2}\right|_0^1=-\frac{1}{1+\alpha^2}, for \alpha\neq0. This may be integrated (with respect to \alpha) to find \varphi(\alpha) = \begin{cases} 0, & \alpha = 0, \\ -\arctan({\alpha})+\frac{\pi}{2}, & \alpha \neq 0. \end{cases} Example 2: Variable limits An example with variable limits: \begin{align} \frac{d}{dx} \int_{\sin x}^{\cos x} \cosh t^2\,dt &= \cosh\left(\cos^2 x\right) \frac{d}{dx}(\cos x) - \cosh\left(\sin^2 x\right) \frac{d}{dx} (\sin x) + \int_{\sin x}^{\cos x} \frac{\partial}{\partial x} (\cosh t^2) \, dt \\[6pt] &= \cosh(\cos^2 x) (-\sin x) - \cosh(\sin^2 x) (\cos x) + 0 \\[6pt] &= - \cosh(\cos^2 x) \sin x - \cosh(\sin^2 x) \cos x. \end{align} == Applications ==

Evaluating definite integrals The formula \frac{d}{dx} \left (\int_{a(x)}^{b(x)}f(x,t) \, dt \right) = f\big(x,b(x)\big)\cdot \frac{d}{dx} b(x) - f\big(x,a(x)\big)\cdot \frac{d}{dx} a(x) + \int_{a(x)}^{b(x)}\frac{\partial}{\partial x} f(x,t) \, dt can be of use when evaluating certain definite integrals. When used in this context, the Leibniz integral rule for differentiating under the integral sign is also known as '''Feynman's trick''' for integration. Example 3 Consider \varphi(\alpha)=\int_0^\pi \ln \left (1-2\alpha\cos(x)+\alpha^2 \right )\,dx, \qquad |\alpha| \neq 1. Its derivative, known as the Poisson integral, is given by \begin{align} \frac{d}{d\alpha} \varphi(\alpha) &=\int_0^\pi \frac{-2\cos(x)+2\alpha }{1-2\alpha \cos(x)+\alpha^2} dx \\[6pt] &=\frac{1}{\alpha}\int_0^\pi \left(1-\frac{1-\alpha^2}{1-2\alpha \cos(x)+\alpha^2} \right) dx \\[6pt] &=\left. \frac{\pi}{\alpha}-\frac{2}{\alpha}\left\{\arctan\left(\frac{1+\alpha}{1-\alpha} \tan\left(\frac{x}{2}\right)\right) \right\} \right|_0^\pi. \end{align} As x varies from 0 to \pi, we have \begin{cases} \frac{1+\alpha}{1-\alpha} \tan\left(\frac{x}{2}\right) \geq 0, & |\alpha| 1. \end{cases} Hence, \left. \arctan\left(\frac{1+\alpha}{1-\alpha}\tan\left(\frac{x}{2}\right)\right)\right|_0^\pi= \begin{cases} \frac{\pi}{2}, & |\alpha| 1. \end{cases} Therefore, \frac{d}{d\alpha} \varphi(\alpha)= \begin{cases} 0, & |\alpha| 1. \end{cases} Integrating both sides with respect to \alpha, we get: \varphi (\alpha) = \begin{cases} C_1, & |\alpha| 1. \end{cases} C_{1} = 0 follows from evaluating \varphi (0): \varphi(0) =\int_0^\pi \ln(1)\,dx =\int_0^\pi 0\,dx=0. To determine C_2 in the same manner, we should need to substitute in a value of \alpha greater than 1 in \varphi (\alpha). This is somewhat inconvenient. Instead, we substitute \alpha = \frac{1}{\beta}, where |\beta| . Then, \begin{align} \varphi(\alpha) &=\int_0^\pi\left(\ln \left (1-2\beta \cos(x)+\beta^2 \right )-2\ln|\beta|\right) dx \\[6pt] &= \int_0^\pi \ln \left (1-2\beta \cos(x)+\beta^2 \right )\,dx -\int_0^\pi 2\ln|\beta| dx \\[6pt] &=0-2\pi\ln|\beta| \\[6pt] &=2\pi\ln|\alpha|. \end{align} Therefore, C_{2} = 0 The calculation of \varphi (\alpha) is now complete: \varphi (\alpha) = \begin{cases} 0, & |\alpha| 1. \end{cases} The foregoing discussion, of course, does not apply when \alpha = \pm 1, since the conditions for differentiability are not met. Example 4 I = \int_0^{\pi/2} \frac{1}{\left(a\cos^2 x +b\sin^2 x\right)^2}\,dx,\qquad a,b > 0. First we calculate: \begin{align} J &= \int_0^{\pi/2} \frac{1}{a\cos^2 x + b \sin^2 x} dx \\[6pt] &= \int_0^{\pi/2} \frac{\frac{1}{\cos^2 x}}{a + b \frac{\sin^2 x}{\cos^2 x}} dx \\[6pt] &= \int_0^{\pi/2} \frac{\sec^2 x}{a +b \tan^2 x} dx \\[6pt] &= \frac{1}{b} \int_0^{\pi/2} \frac{1}{\left(\sqrt{\frac{a}{b}}\right)^2+\tan^2 x}\,d(\tan x) \\[6pt] &= \left.\frac{1}{\sqrt{ab}}\arctan \left(\sqrt{\frac{b}{a}}\tan x\right) \right|_0^{\pi/2} \\[6pt] &= \frac{\pi}{2\sqrt{ab}}. \end{align} The limits of integration being independent of a, we have: \frac{\partial J}{\partial a}=-\int_0^{\pi/2} \frac{\cos^2 x}{\left(a\cos^2 x+b \sin^2 x\right)^2}\,dx On the other hand: \frac{\partial J}{\partial a}= \frac{\partial}{\partial a} \left(\frac{\pi}{2\sqrt{ab}}\right) =-\frac{\pi}{4\sqrt{a^3b}}. Equating these two relations then yields \int_0^{\pi/2} \frac{\cos^2 x}{\left(a \cos^2 x+b \sin^2 x\right)^2}\,dx=\frac{\pi}{4\sqrt{a^3b}}. In a similar fashion, pursuing \frac{\partial J}{\partial b} yields \int_0^{\pi/2}\frac{\sin^2 x}{\left(a\cos^2 x+b\sin^2 x\right)^2}\,dx = \frac{\pi}{4\sqrt{ab^3}}. Adding the two results then produces I = \int_0^{\pi/2}\frac{1}{\left(a\cos^2x+b\sin^2x\right)^2}\,dx=\frac{\pi}{4\sqrt{ab}}\left(\frac{1}{a}+\frac{1}{b}\right), which computes I as desired. This derivation may be generalized. Note that if we define I_n = \int_0^{\pi/2} \frac{1}{\left(a\cos^2 x+b\sin^2 x\right)^n}\,dx, it can easily be shown that (1-n) I_n = \frac{\partial I_{n-1}}{\partial a} + \frac{\partial I_{n-1}}{\partial b} Given I_1, this integral reduction formula can be used to compute all of the values of I_n for n > 1. Integrals like I and J may also be handled using the Weierstrass substitution. Example 5 Here, we consider the integral I(\alpha) = \int_0^{\pi/2} \frac{\ln (1+\cos\alpha \cos x)}{\cos x}\,dx, \qquad 0 Differentiating under the integral with respect to \alpha, we have \begin{align} \frac{d}{d\alpha} I(\alpha) &= \int_0^{\pi/2} \frac{\partial}{\partial\alpha} \left(\frac{\ln(1 + \cos\alpha \cos x)}{\cos x}\right) \, dx \\[6pt] &=-\int_0^{\pi/2}\frac{\sin \alpha}{1+\cos \alpha \cos x}\,dx \\ &=-\int_0^{\pi/2}\frac{\sin \alpha}{\left(\cos^2 \frac{x}{2}+\sin^2 \frac{x}{2}\right)+\cos \alpha \left(\cos^2 \frac{x}{2}-\sin^2 \frac{x}{2}\right)} \, dx \\[6pt] &=-\frac{\sin\alpha}{1-\cos\alpha} \int_0^{\pi/2} \frac{1}{\cos^2\frac{x}{2}} \frac{1}{\frac{1+\cos \alpha}{1-\cos \alpha} +\tan^2 \frac{x}{2}} \, dx \\[6pt] &=-\frac{2\sin\alpha}{1-\cos\alpha} \int_0^{\pi/2} \frac{\frac{1}{2} \sec^2 \frac{x}{2}}{\frac{2 \cos^2 \frac{\alpha}{2}}{2 \sin^2\frac{\alpha}{2}} + \tan^2 \frac{x}{2}} \, dx \\[6pt] &=-\frac{2\left(2 \sin \frac{\alpha}{2} \cos \frac{\alpha}{2}\right)}{2 \sin^2 \frac{\alpha}{2}} \int_0^{\pi/2} \frac{1}{\cot^2\frac{\alpha}{2} + \tan^2 \frac{x}{2}} \, d\left(\tan \frac{x}{2}\right)\\[6pt] &=-2\cot \frac{\alpha}{2}\int_0^{\pi/2} \frac{1}{\cot^2\frac{\alpha}{2} + \tan^2\frac{x}{2}}\,d\left(\tan \frac{x}{2}\right)\\[6pt] &=-2\arctan \left(\tan \frac{\alpha}{2} \tan \frac{x}{2} \right) \bigg|_0^{\pi/2}\\[6pt] &=-\alpha. \end{align} Therefore: I(\alpha) = C - \frac{\alpha^2}{2}. But I{\left(\frac{\pi}{2} \right)} = 0 by definition so C = \frac{\pi^2}{8} and I(\alpha) = \frac{\pi^2}{8}-\frac{\alpha^2}{2}. Example 6 Here, we consider the integral \int_0^{2\pi} e^{\cos\theta} \cos(\sin\theta) \, d\theta. We introduce a new variable φ and rewrite the integral as f(\varphi) = \int_0^{2\pi} e^{\varphi\cos\theta} \cos(\varphi\sin\theta)\,d\theta. When φ = 1 this equals the original integral. However, this more general integral may be differentiated with respect to \varphi: \frac{df}{d\varphi} = \int_0^{2\pi} \frac{\partial}{\partial\varphi}\left[e^{\varphi\cos\theta} \cos(\varphi\sin\theta)\right] d\theta = \int_0^{2\pi} e^{\varphi\cos\theta} \left[ \cos\theta\cos(\varphi\sin\theta)-\sin\theta\sin(\varphi\sin\theta) \right] d\theta. Now, fix φ, and consider the vector field on \Reals^2 defined by \mathbf{F}(x,y) = (F_1(x,y), F_2(x,y)) := (e^{\varphi x} \sin (\varphi y), e^{\varphi x} \cos (\varphi y)) . Further, choose the positive oriented parameterization of the unit circle S^1 given by \mathbf{r} \colon [0, 2\pi) \to \Reals^2 , \mathbf{r}(\theta) := (\cos \theta, \sin \theta) , so that \mathbf{r}'(t) = (-\sin \theta, \cos \theta) . Then the final integral above is precisely \begin{align} & \int_0^{2\pi} e^{\varphi\cos\theta} \left[ \cos\theta\cos(\varphi\sin\theta)-\sin\theta\sin(\varphi\sin\theta) \right] d\theta \\[6pt] = {} & \int_0^{2\pi} \begin{bmatrix} e^{\varphi \cos \theta} \sin (\varphi \sin \theta) \\ e^{\varphi \cos \theta} \cos (\varphi \sin \theta) \end{bmatrix} \cdot \begin{bmatrix} -\sin \theta \\ \hphantom{-} \cos \theta\end{bmatrix} \, d\theta\\[6pt] = {} & \int_0^{2\pi} \mathbf{F}(\mathbf{r}(\theta)) \cdot \mathbf{r}'(\theta) \, d\theta\\[6pt] = {} & \oint_{S^1} \mathbf{F}(\mathbf{r}) \cdot d\mathbf{r} = \oint_{S^1} F_1 \, dx + F_2 \, dy, \end{align} the line integral of \mathbf{F} over S^1. By Green's Theorem, this equals the double integral \iint_D \frac{\partial F_2}{\partial x} - \frac{\partial F_1}{\partial y} \, dA, where D is the closed unit disc. Its integrand is identically 0, so df/d\varphi is likewise identically zero. This implies that f(φ) is constant. The constant may be determined by evaluating f at \varphi = 0: f(0) = \int_0^{2\pi} 1\,d\theta = 2\pi. Therefore, the original integral also equals 2\pi. Other problems to solve There are innumerable other integrals that can be solved using the technique of differentiation under the integral sign. For example, in each of the following cases, the original integral may be replaced by a similar integral having a new parameter \alpha: \begin{align} \int_0^\infty \frac{\sin x}{x}\,dx &\to \int_0^\infty e^{-\alpha x} \frac{\sin x}{x} dx,\\[6pt] \int_0^{\pi/2} \frac{x}{\tan x}\,dx &\to\int_0^{\pi/2} \frac{\tan^{-1}(\alpha \tan x)}{\tan x} dx,\\[6pt] \int_0^\infty \frac{\ln (1+x^2)}{1+x^2}\,dx &\to\int_0^\infty \frac{\ln (1+\alpha^2 x^2)}{1+x^2} dx \\[6pt] \int_0^1 \frac{x-1}{\ln x}\,dx &\to \int_0^1 \frac{x^\alpha-1}{\ln x} dx. \end{align} The first integral, the Dirichlet integral, is absolutely convergent for positive α but only conditionally convergent when \alpha = 0. Therefore, differentiation under the integral sign is easy to justify when \alpha > 0, but proving that the resulting formula remains valid when \alpha = 0 requires some careful work. Infinite series The measure-theoretic version of differentiation under the integral sign also applies to summation (finite or infinite) by interpreting summation as counting measure. An example of an application is the fact that power series are differentiable in their radius of convergence. Euler-Lagrange equations The Leibniz integral rule is used in the derivation of the Euler-Lagrange equation in variational calculus. == In popular culture ==

Differentiation under the integral sign is mentioned in the late physicist Richard Feynman's best-selling memoir ''Surely You're Joking, Mr. Feynman! in the chapter "A Different Box of Tools". He describes learning it, while in high school, from an old text, Advanced Calculus'' (1926), by Frederick S. Woods (who was a professor of mathematics in the Massachusetts Institute of Technology). The technique was not often taught when Feynman later received his formal education in calculus, but using this technique, Feynman was able to solve otherwise difficult integration problems upon his arrival at graduate school at Princeton University: One thing I never did learn was contour integration. I had learned to do integrals by various methods shown in a book that my high school physics teacher Mr. Bader had given me. One day he told me to stay after class. "Feynman," he said, "you talk too much and you make too much noise. I know why. You're bored. So I'm going to give you a book. You go up there in the back, in the corner, and study this book, and when you know everything that's in this book, you can talk again." So every physics class, I paid no attention to what was going on with Pascal's Law, or whatever they were doing. I was up in the back with this book: "Advanced Calculus", by Woods. Bader knew I had studied "Calculus for the Practical Man" a little bit, so he gave me the real works—it was for a junior or senior course in college. It had Fourier series, Bessel functions, determinants, elliptic functions—all kinds of wonderful stuff that I didn't know anything about. That book also showed how to differentiate parameters under the integral sign—it's a certain operation. It turns out that's not taught very much in the universities; they don't emphasize it. But I caught on how to use that method, and I used that one damn tool again and again. So because I was self-taught using that book, I had peculiar methods of doing integrals. The result was, when guys at MIT or Princeton had trouble doing a certain integral, it was because they couldn't do it with the standard methods they had learned in school. If it was contour integration, they would have found it; if it was a simple series expansion, they would have found it. Then I come along and try differentiating under the integral sign, and often it worked. So I got a great reputation for doing integrals, only because my box of tools was different from everybody else's, and they had tried all their tools on it before giving the problem to me. In season 8, episode 2 of The Big Bang Theory Sheldon asks Howard "Do you know how to integrate x-squared times e to the minus x without looking it up?" and Howard responds with "I'd use Feynman's trick, differentiate under the integral sign." == See also ==