2.2. The Derivative: A Ratio in the Limiting Sense

The concept of a derivative is deeply connected to the idea of a ratio. Specifically, for a scalar function \(f(x)\) of a single variable \(x\), the derivative is the limit of the ratio of the change in the function's value (\(f(x)\), the dependent variable) to the change in its independent variable (\(x\), the independent variable). More precisely, the derivative is defined as: \[ f'(x) = \frac{d}{dx} f(x) = \lim_{\Delta x \to 0} \frac{f(x + \Delta x) - f(x)}{\Delta x}. \] The derivative represents the instantaneous rate of change of \(f(x)\) with respect to \(x\), making it a ratio in the limiting sense. In practical terms, it quantifies the sensitivity of \(f(x)\) to small changes in \(x\), describing how the function's value changes locally. 

  • In many applications, ratios and derivatives are used to quantify rates of change:
    • In physics, the ratio of distance traveled to time elapsed gives velocity. Taking the derivative of distance with respect to time yields instantaneous velocity:\[ v(t) = \frac{dx}{dt}.\]
    • In medical physiology, the ratio of cardiac output (\(CO\)) to body surface area (\(BSA\)) gives cardiac index (\(CI\)): \[ CI = \frac{CO}{BSA}.\] To study changes in cardiac index, we use the derivative: \[ \frac{d(CI)}{dt} = \frac{1}{BSA} \frac{d(CO)}{dt}. \]  This highlights the sensitivity of cardiac index to variations in cardiac output over time. Click here for more details.
    • In pharmacokinetics, the concentration of a drug in the bloodstream, \(C(t)\), changes over time \(t\). The rate of change of the drug concentration is given by the derivative: \[ C'(t) = \frac{dC}{dt}. \] If \(C(t) = C_0 e^{-kt}\), where \(C_0\) is the initial drug concentration and \(k\) is the elimination rate constant, the derivative is: \[ C'(t) = -kC_0 e^{-kt}. \] This derivative represents the rate at which the drug is metabolized and eliminated from the body. For example, a larger value of \(k\) corresponds to faster drug elimination. 
  • The product rule of derivatives states that the derivative of the product of two functions is given by: \[ \frac{d}{dx} [f(x) \cdot g(x)] = f'(x) \cdot g(x) + f(x) \cdot g'(x). \]
    • Proof. The product rule for derivatives can be approximated using the difference quotient: \[ \frac{d}{dx} [f(x) \cdot g(x)] \approx \frac{f(x+\Delta x) g(x+\Delta x) - f(x) g(x)}{\Delta x}. \] This can be rewritten as: \[ \frac{d}{dx} [f(x) \cdot g(x)] \approx \underbrace{\frac{f(x+\Delta x) g(x+\Delta x) - f(x+\Delta x) g(x)}{\Delta x}}_{\textstyle f(x) g'(x)} + \underbrace{\frac{f(x+\Delta x) g(x) - f(x) g(x)}{\Delta x}}_{\textstyle f'(x) g(x)}. \]
    • Cardiac output (\(CO\)) measures the volume of blood the heart pumps per minute and is a critical parameter in assessing cardiovascular health. It is defined as: \[ CO = SV \cdot HR, \] where \(SV\) (Stroke Volume) is the amount of blood pumped per heartbeat; \(HR\) (Heart Rate) is the number of heartbeats per minute.  To understand how changes in stroke volume or heart rate affect cardiac output, we take the derivative of \(CO\): \[ \frac{\partial CO}{\partial t} = \frac{\partial (SV \cdot HR)}{\partial t}. \] Using the product rule: \[ \frac{\partial CO}{\partial t} = \frac{\partial SV}{\partial t} \cdot HR + SV \cdot \frac{\partial HR}{\partial t}. \] While the exact derivative \(\frac{d(CO)}{dt}\) is not explicitly calculated in clinical practice, trends in cardiac output changes are observed in response to interventions such as fluid resuscitation, inotropes, or vasopressors.
  • The chain rule of derivatives allows us to compute the derivative of a composite function. For a composite function \(y = f(g(x))\), \(\frac{dy}{dx}\) is written as: \[ \frac{d}{dx} f(g(x)) = f'(g(x)) \cdot g'(x). \]
    • Proof.   The chain rule for derivatives can also be approximated using the difference quotient: \[ \frac{d}{dx} f(g(x)) \approx \frac{f(g(x+\Delta x)) - f(g(x))}{\Delta x}. \] By introducing intermediate terms, this can be written as: \[ \frac{d}{dx} f(g(x)) \approx \underbrace{\frac{f(g(x+\Delta x)) - f(g(x))}{g(x+\Delta x) - g(x)}}_{\textstyle f'(g(x))} \cdot \underbrace{\frac{g(x+\Delta x) - g(x)}{\Delta x}}_{\textstyle g'(x)}. \]  In the case where \(g(x)\) is locally constant, so \(g'(x) = 0\), the chain rule simplifies as  \(\frac{d}{dx} f(g(x)) = f'(g(x)) \cdot 0 = 0. \)
  • The linear approximation of a function \(f(x)\) near a point \(x = a\) uses the derivative to approximate the function as a straight line. The formula for the linear approximation is: \[ f(x) \approx f(a) + f'(a)(x - a), \] This formula gives the equation of the tangent line to \(f(x)\) at \(x = a\), which serves as the best linear approximation to \(f(x)\) near \(a\). 

  • Derivatives in Optimization. Derivatives are widely used in optimization problems to find the minimum or maximum value of a function. A critical point of a function occurs when the derivative is zero: \[ f'(x) = 0. \] To determine whether a critical point is a minimum or maximum, the second derivative \(f''(x)\) is evaluated: 
    •  If \(f''(x) > 0\) (the function is convex), the critical point is a local minimum. 
    •  If \(f''(x) < 0\) (the function is concave), the critical point is a local maximum.

       
  • Newton’s Method for Finding Roots. Newton’s method is an iterative technique for solving equations of the form \(f(x) = 0\). The iterative formula is: \[x_{k+1} = x_k - \frac{f(x_k)}{f'(x_k)},\] where \(x_k\) is the current estimate, \(f(x_k)\) is the function value, and \(f'(x_k)\) is the derivative at \(x_k\). The idea of the update rule comes from the linear approximation: \[ f(x_{k+1}) \approx f(x_k) + f'(x_k)(x_{k+1} - x_k), \] with the hope that \(f(x_{k+1}) = 0\). Newton's method is widely used due to its fast convergence for well-behaved functions, particularly when the initial guess is close to the root. This link provides a visual understanding of Newton's method.

  • Newton’s Method for Finding Minimum Points. Newton’s method can also be used to find minimum points of a function \(f(x)\), particularly in optimization problems. For this, the method solves:\[f'(x) = 0,\]using the following iterative formula:\[x_{k+1} = x_k - \frac{f'(x_k)}{f''(x_k)},\]where \(f''(x_k)\) is the second derivative of the function. This approach ensures fast convergence to the critical point, provided that the initial guess \(x_0\) is close to the true minimum and the second derivative \(f''(x)\) is nonzero.


댓글

댓글 쓰기

이 블로그의 인기 게시물

2.1 Vectors

이미지
Under Construction Vectors are mathematical entities characterized by both magnitude and direction. They are essential for describing physical quantities such as blood flow velocity, forces acting on joints, and features in image analysis for deep learning. A vector in three-dimensional space is written as: \[ \mathbf{v} = v_x \hat{i} + v_y \hat{j} + v_z \hat{k}, \] where \(\hat{i} = (1,0,0)\), \(\hat{j} = (0,1,0)\), and \(\hat{k} = (0,0,1)\) are the unit vectors along the \(x\)-, \(y\)-, and \(z\)-axes, respectively. The components \(v_x\), \(v_y\), and \(v_z\) represent the magnitude of the vector in the \(x\)-, \(y\)-, and \(z\)-directions.  Vectors can describe the speed and direction of blood flow in vessels, facilitating the analysis of hemodynamics. They are also used to model forces acting on prosthetic joints or tissues, aiding in the study of biomechanics and prosthetic design. A vector in \(n\)-dimensional space is written as: \[ \mathbf{x} = (x_1, x_2, x_3, \l...
자세한 내용 보기

2.4. Taylor Expansion and Approximation

이미지
Taylor expansion is a fundamental tool for approximating functions using their derivatives.  1D Taylor Expansion. Let \( f(x) \) be a smooth and differentiable scalar function of one variable \( x \) near a point \( x_0 \). The Taylor expansion of \(f(x)\) around \( x_0 \), up to the second order, is given by: \[ f(x) = f(x_0) + f'(x_0)(x - x_0) + \frac{1}{2}f''(x_0)(x - x_0)^2 + \frac{1}{3!}f'''(x_0)(x - x_0)^3+O(|x - x_0|^4). \] The term \( O(|x - x_0|^4) \) (pronounced "Big-O of \(|x - x_0|^4\)") describes the error in the approximation. Specifically: \[ \frac{O(|x - x_0|^4)}{|x - x_0|^4} \text{ is bounded. }  \] This notation simplifies the representation of higher-order terms, which become egligible compared to the lower-order terms when \( x \) is close to \( x_0 \).   In machine learning, Taylor expansion is used to approximate non-linear activation functions, such as the sigmoid function: \[ \sigma(x) = \frac{1}{1 + e^{-x}}. \] For small \( x ...
자세한 내용 보기

2.5. Vector Fields and Line integral

  Vector Fields A  vector field  assigns a vector to every point in space. Examples include hemodynamics, where vector fields are used to understand blood flow patterns and detect abnormalities such as stenosis or aneurysms, and respiratory dynamics, where vector fields model airflow in the lungs to study ventilation efficiency.  Let \(\mathbf{r} = (x, y, z)\). A vector field is defined as: $$F(\mathbf{r}) = F_x(\mathbf{r}) \hat{i} + F_y(\mathbf{r}) \hat{j} + F_z(\mathbf{r}) \hat{k},$$ where:  \( F_x(\mathbf{r}) \): The \(x\)-component of the vector field.  \( F_y(\mathbf{r}) \): The \(y\)-component of the vector field.  \( F_z(\mathbf{r}) \): The \(z\)-component of the vector field.  \( \hat{i}, \hat{j}, \hat{k} \): Unit vectors in the \(x\)-, \(y\)-, and \(z\)-directions, respectively.  Example 1: Blood Velocity Field   In a cylindrical blood vessel, the velocity of blood flow can be described as a vector field. For laminar flow, ...
자세한 내용 보기