On some extremal problems for mutual information and entropy
- Autores: Prelov V.V.1
-
Afiliações:
- Kharkevich Institute for Information Transmission Problems
- Edição: Volume 52, Nº 4 (2016)
- Páginas: 319-328
- Seção: Information Theory
- URL: https://journals.rcsi.science/0032-9460/article/view/166327
- DOI: https://doi.org/10.1134/S0032946016040013
- ID: 166327
Citar
Resumo
The problem of determining the maximum mutual information I(X; Y) and minimum entropy H(X, Y) of a pair of discrete random variables X and Y is considered under the condition that the probability distribution of X is fixed and the error probability Pr{Y ≠ X} takes a given value ε, 0 ≤ ε ≤ 1. Precise values for these quantities are found, which in several cases allows us to obtain explicit formulas for both the maximum information and minimum entropy in terms of the probability distribution of X and the parameter ε.
Sobre autores
V. Prelov
Kharkevich Institute for Information Transmission Problems
Autor responsável pela correspondência
Email: prelov@iitp.ru
Rússia, Moscow
Arquivos suplementares
