Volume 10 Issue 2
A Representation of the Relative Entropy with Respect to a Diffusion Process in Terms of Its Infinitesimal Generator
Oliver Faugeras and James MacLaurin
INRIA Sophia Antipolis Mediterannee, 2004 Route Des Lucioles, Sophia Antipolis, France
*
Author to whom correspondence should be addressed.
Abstract
In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback–Leibler Divergence) R(μ||P), where μ and P are measures on C([0, T]; ℝd). The underlying measure P is a weak solution to a martingale problem with continuous coefficients. Our representation is in the form of an integral with respect to its infinitesimal generator. This representation is of use in statistical inference (particularly involving medical imaging). Since R(μ||P) governs the exponential rate of convergence of the empirical measure (according to Sanov’s theorem), this representation is also of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions.
Keywords:relative entropy; Kullback–Leibler; diffusion; martingale formulation