Optimal quantization for the one–dimensional uniform distribution with Rényi- α -entropy constraints

Wolfgang Kreitmeier

Kybernetika (2010)

  • Volume: 46, Issue: 1, page 96-113
  • ISSN: 0023-5954

Abstract

top
We establish the optimal quantization problem for probabilities under constrained Rényi- α -entropy of the quantizers. We determine the optimal quantizers and the optimal quantization error of one-dimensional uniform distributions including the known special cases α = 0 (restricted codebook size) and α = 1 (restricted Shannon entropy).

How to cite

top

Kreitmeier, Wolfgang. "Optimal quantization for the one–dimensional uniform distribution with Rényi-$\alpha $-entropy constraints." Kybernetika 46.1 (2010): 96-113. <http://eudml.org/doc/37705>.

@article{Kreitmeier2010,
abstract = {We establish the optimal quantization problem for probabilities under constrained Rényi-$\alpha $-entropy of the quantizers. We determine the optimal quantizers and the optimal quantization error of one-dimensional uniform distributions including the known special cases $\alpha = 0$ (restricted codebook size) and $\alpha = 1$ (restricted Shannon entropy).},
author = {Kreitmeier, Wolfgang},
journal = {Kybernetika},
keywords = {optimal quantization; uniform distribution; Rényi-$\alpha $-entropy; optimal quantization; uniform distribution; Rényi--entropy},
language = {eng},
number = {1},
pages = {96-113},
publisher = {Institute of Information Theory and Automation AS CR},
title = {Optimal quantization for the one–dimensional uniform distribution with Rényi-$\alpha $-entropy constraints},
url = {http://eudml.org/doc/37705},
volume = {46},
year = {2010},
}

TY - JOUR
AU - Kreitmeier, Wolfgang
TI - Optimal quantization for the one–dimensional uniform distribution with Rényi-$\alpha $-entropy constraints
JO - Kybernetika
PY - 2010
PB - Institute of Information Theory and Automation AS CR
VL - 46
IS - 1
SP - 96
EP - 113
AB - We establish the optimal quantization problem for probabilities under constrained Rényi-$\alpha $-entropy of the quantizers. We determine the optimal quantizers and the optimal quantization error of one-dimensional uniform distributions including the known special cases $\alpha = 0$ (restricted codebook size) and $\alpha = 1$ (restricted Shannon entropy).
LA - eng
KW - optimal quantization; uniform distribution; Rényi-$\alpha $-entropy; optimal quantization; uniform distribution; Rényi--entropy
UR - http://eudml.org/doc/37705
ER -

References

top
  1. On Measures of Information and Their Characterizations, (Mathematics in Science and Engineering Vol. 115.) Academic Press, London 1975. MR0689178
  2. Nonlinear Programming, Theory and Algorithms, Wiley, New York 1993. MR2218478
  3. Thermodynamics of Chaotic Systems, Cambridge University Press, Cambridge 1993. MR1237638
  4. Additive and Nonadditive Measures of Entropy, Wiley, New Delhi 1990. Zbl0752.94005MR1106848
  5. Asymptotics of optimal quantizers for some scalar distributions, J. Comput. Appl. Math. 146 (2002), 253–275. MR1925959
  6. Vector Quantization and Signal Compression, Kluwer, Boston 1992. 
  7. The quantization of the Cantor distribution, Math. Nachr. 183 (1997), 113–133. MR1434978
  8. Foundations of Quantization for Probability Distributions, (Lecture Notes in Computer Science 1730.) Springer, Berlin 2000. MR1764176
  9. Quantization, IEEE Trans. Inform. Theory 44 (1998), 2325–2383. MR1658787
  10. Entropy and effective support size, Entropy 8 (2006), 169–174. Zbl1135.94316MR2276249
  11. Optimal entropy-constrained scalar quantization of a uniform source, IEEE Trans. Inform. Theory 46 (2000), 2704–2711. MR1806836
  12. On the structure of optimal entropy-constrained scalar quantizers, IEEE Trans. Inform. Theory 48 (2002), 416–427. MR1891255
  13. Inequalities, Second edition. Cambridge University Press, Cambridge 1959. 
  14. Inequalities between entropy and index of coincidence derived from information diagrams, IEEE Trans. Inform. Theory 47 (2001), 2944–2960. MR1872852
  15. Stability of quantization dimension and quantization for homogeneous Cantor measure, Math. Nachr. 280 (2007), 866–881. MR2326060
  16. Optimal quantization for dyadic homogeneous Cantor distributions, Math. Nachr. 281 (2008), 1307–1327. MR2442708
  17. Asymptotically sufficient partitions and quantizations, IEEE Trans. Inform. Theory 52 (2006), 5599–5606. MR2300722
  18. Clustering and quantization by MSP-partitions, Statist. Decisions 19 (2001), 331–371. MR1884124

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.