RUS  ENG JOURNALS   PEOPLE   ORGANISATIONS   CONFERENCES   SEMINARS   VIDEO LIBRARY   PACKAGE AMSBIB
 General information Latest issue Archive Impact factor Search papers Search references RSS Latest issue Current issues Archive issues What is RSS

 Probl. Peredachi Inf.: Year: Volume: Issue: Page: Find

 Probl. Peredachi Inf., 2016, Volume 52, Issue 4, Pages 3–13 (Mi ppi2218)

Information Theory

On some extremal problems for mutual information and entropy

V. V. Prelov

Kharkevich Institute for Information Transmission Problems, Russian Academy of Sciences, Moscow, Russia

Abstract: The problem of determining the maximum mutual information $I(X;Y)$ and minimum entropy $H(X,Y)$ of a pair of discrete random variables $X$ and $Y$ is considered under the condition that the probability distribution of $X$ is fixed and the error probability $\mathrm{Pr}\{Y\ne X\}$ takes a given value $\varepsilon$, $0\le\varepsilon\le1$. Precise values for these quantities are found, which in several cases allows us to obtain explicit formulas for both the maximum information and minimum entropy in terms of the probability distribution of $X$ and the parameter $\varepsilon$.

 Funding Agency Grant Number Russian Foundation for Basic Research 15-01-08051 Supported in part by the Russian Foundation for Basic Research, project no. 15-01-08051.

Full text: PDF file (195 kB)
References: PDF file   HTML file

English version:
Problems of Information Transmission, 2016, 52:4, 319–328

Bibliographic databases:

UDC: 621.391.1+519.72
Revised: 14.10.2016

Citation: V. V. Prelov, “On some extremal problems for mutual information and entropy”, Probl. Peredachi Inf., 52:4 (2016), 3–13; Problems Inform. Transmission, 52:4 (2016), 319–328

Citation in format AMSBIB
\Bibitem{Pre16} \by V.~V.~Prelov \paper On some extremal problems for mutual information and entropy \jour Probl. Peredachi Inf. \yr 2016 \vol 52 \issue 4 \pages 3--13 \mathnet{http://mi.mathnet.ru/ppi2218} \elib{http://elibrary.ru/item.asp?id=29468491} \transl \jour Problems Inform. Transmission \yr 2016 \vol 52 \issue 4 \pages 319--328 \crossref{https://doi.org/10.1134/S0032946016040013} \isi{http://gateway.isiknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&DestLinkType=FullRecord&DestApp=ALL_WOS&KeyUT=000392083800001} \scopus{http://www.scopus.com/record/display.url?origin=inward&eid=2-s2.0-85008425464}