|
|
Journal of the Belarusian State University. Mathematics and Informatics, 2018, Volume 1, Pages 59–67
(Mi bgumi130)
|
|
|
|
Theory of probability and Mathematical statistics
Introduction of the Kullback – Leibler information function by means of partitions of the probability space
E. E. Sokol Belarusian State University, 4 Niezaliežnasci Avenue, Minsk 220030, Belarus
Abstract:
In the paper we study the equivalence problem of two definitions of the Kullback – Leibler information function. It is commonly defined by integration of the logarithm of the density of one probability measure with respect to another. On the other hand, recently a concept of $t$-entropy of a dynamical system (that is a generalization of the information function) is actively explored, and this concept is defined by means of measurable partitions of the phase space. In the paper we investigate in which situations the two definitions are equivalent and in which ones they are not. In particular, the equivalence holds if both measures are finite.
Keywords:
Kullback – Leibler information function; $t$-entropy.
Received: 27.10.2017
Citation:
E. E. Sokol, “Introduction of the Kullback – Leibler information function by means of partitions of the probability space”, Journal of the Belarusian State University. Mathematics and Informatics, 1 (2018), 59–67
Linking options:
https://www.mathnet.ru/eng/bgumi130 https://www.mathnet.ru/eng/bgumi/v1/p59
|
|