Joint Range of Rényi entropies

Peter Harremoës

Kybernetika (2009)

  • Volume: 45, Issue: 6, page 901-911
  • ISSN: 0023-5954

Abstract

top
The exact range of the joined values of several Rényi entropies is determined. The method is based on topology with special emphasis on the orientation of the objects studied. Like in the case when only two orders of the Rényi entropies are studied, one can parametrize the boundary of the range. An explicit formula for a tight upper or lower bound for one order of entropy in terms of another order of entropy cannot be given.

How to cite

top

Harremoës, Peter. "Joint Range of Rényi entropies." Kybernetika 45.6 (2009): 901-911. <http://eudml.org/doc/37681>.

@article{Harremoës2009,
abstract = {The exact range of the joined values of several Rényi entropies is determined. The method is based on topology with special emphasis on the orientation of the objects studied. Like in the case when only two orders of the Rényi entropies are studied, one can parametrize the boundary of the range. An explicit formula for a tight upper or lower bound for one order of entropy in terms of another order of entropy cannot be given.},
author = {Harremoës, Peter},
journal = {Kybernetika},
keywords = {generalized Vandermonde determinant; orientation; Rényi entropies; Shannon entropy; Shannon entropy; generalized Vandermonde determinant; orientation; Rényi entropies},
language = {eng},
number = {6},
pages = {901-911},
publisher = {Institute of Information Theory and Automation AS CR},
title = {Joint Range of Rényi entropies},
url = {http://eudml.org/doc/37681},
volume = {45},
year = {2009},
}

TY - JOUR
AU - Harremoës, Peter
TI - Joint Range of Rényi entropies
JO - Kybernetika
PY - 2009
PB - Institute of Information Theory and Automation AS CR
VL - 45
IS - 6
SP - 901
EP - 911
AB - The exact range of the joined values of several Rényi entropies is determined. The method is based on topology with special emphasis on the orientation of the objects studied. Like in the case when only two orders of the Rényi entropies are studied, one can parametrize the boundary of the range. An explicit formula for a tight upper or lower bound for one order of entropy in terms of another order of entropy cannot be given.
LA - eng
KW - generalized Vandermonde determinant; orientation; Rényi entropies; Shannon entropy; Shannon entropy; generalized Vandermonde determinant; orientation; Rényi entropies
UR - http://eudml.org/doc/37681
ER -

References

top
  1. An inequality on guessing and its application to sequential decoding, IEEE Trans. Inform. Theory 42 (1996), 1, 99–105. Zbl0845.94020MR1375330
  2. Information Measures, Springer, Berlin 2001. Zbl0973.94001MR1883988
  3. f -entropies, probability of error, and feature selection, Inform. and Control 39 (1978), 227–242. Zbl0394.94011MR0523439
  4. Generalized cutoff rates and Rényi information measures, IEEE Trans. Inform. Theory 41 (1995), 1, 26–34. MR1366742
  5. Relations between entropy and error probability, IEEE Trans. Inform. Theory 40 (1994), 259–266. 
  6. On the relationship between the information measures and the Bayes probability of error, IEEE Trans. Inform. Theory 35 (1987), 5, 681–690. MR0918190
  7. Optimal entropy-constrained scalar quantization of a uniform source, IEEE Trans. Inform. Theory 46 (2000), 7, 2704–2711. MR1806836
  8. Inequalities between entropy and index of coincidence derived from information diagrams, IEEE Trans. Inform. Theory 47 (2001), 7, 2944–2960. MR1872852
  9. Efficiency of entropy testing, In: Internat. Symposium on Information Theory, pp. 2639–2643. IEEE 2008. 
  10. On the Bahadur-efficient testing of uniformity by means of the entropy, IEEE Trans. Inform. Theory 54 (2008), 1, 321–331. MR2446756
  11. The Problem of Character Recognition from the Point of View of Mathematical Statistics, Spartan, New York 1967, pp. 3–30. 
  12. The exponential Vandermonde matrix, Linear Algebra Appl. 317 (2000), 1–3, 225 – 226. MR1782213
  13. Principles of Mathematical Analysis, (Internat. Series in Pure and Applied Mathematics.) Third edition. McGraw-Hill, New York 1976. Zbl0346.26002MR0385023
  14. Algebraic Topology, Springer, Berlin 1982. Zbl0810.55001MR0666554
  15. Uncertainty and the probability of error, IEEE Trans. Inform. Theory 14 (1968), 14, 516–518. 
  16. Rényi extrapolation of Shannon entropy, Open Systems and Information Dynamics 10 (2003), 297–310. Zbl1030.94022MR1998623

NotesEmbed ?

top

You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.

    
                

                
Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.