IEEE - Institute of Electrical and Electronics Engineers, Inc. - Minimum KL-Divergence on Complements of $L_{1}$ Balls

Author(s): Daniel Berend ; Peter Harremoes ; Aryeh Kontorovich
Sponsor(s): IEEE Information Theory Society
Publisher: IEEE - Institute of Electrical and Electronics Engineers, Inc.
Publication Date: 1 June 2014
Volume: 60
Page(s): 3,172 - 3,177
ISSN (Paper): 0018-9448
ISSN (Online): 1557-9654
DOI: 10.1109/TIT.2014.2301446
Regular:

Pinsker's widely used inequality upper-bounds the total variation distance ∥P - Q∥1 in terms of the Kullback-Leibler divergence D(P∥Q). Although, in general, a bound... View More

Advertisement