Given a probability distribution p = (p1., pn) and an integer m < n, what is the probability distribution q = (q1., qm) that is 'the closest' to p, that is, that best approximates p? It is clear that the answer depends on the function one chooses to evaluate the goodness of the approximation. In this paper we provide a general criterion to approximate p with a shorter vector q by using ideas from majorization theory. We evaluate the goodness of our approximation by means of a variety of information theoretic distance measures.

Approximating probability distributions with short vectors, via information theoretic distance measures

Cicalese, Ferdinando;
2016-01-01

Abstract

Given a probability distribution p = (p1., pn) and an integer m < n, what is the probability distribution q = (q1., qm) that is 'the closest' to p, that is, that best approximates p? It is clear that the answer depends on the function one chooses to evaluate the goodness of the approximation. In this paper we provide a general criterion to approximate p with a shorter vector q by using ideas from majorization theory. We evaluate the goodness of our approximation by means of a variety of information theoretic distance measures.
2016
Information theory; Probability Information-theoretic distance; Majorization theory; Short vectors
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11562/954700
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 9
social impact