On generalized entropies, Bayesian decisions and statistical diversity

 Access to full text

 Full (PDF)

1. Cover T., Thomas J., Elements of Information Theory, Wiley, New York 1991 Zbl1140.94001MR1122806
2. Cressie N., Read T. R. C., Multinomial goodness-of-fit tests, J. Roy. Statist. Soc. Ser. B 46 (1984), 440–464 (1984) Zbl0571.62017MR0790631
3. Csiszár I., Informationstheoretische Ungleichung und ihre Anwendung auf den Beweis der Ergodizität von Markoffschen Ketten, Publ. Math. Inst. Hungar. Acad. Sci. Ser. A 8 (1963), 85–108 (1963) Zbl0124.08703MR0164374
4. Csiszár I., Information-type measures of difference of probability distributions and indirect observations, Studia Sci. Math. Hungar. 2 (1967), 299–318 (1967) MR0219345
5. Csiszár I., A class of measures of informativity of observation channels, Period. Math. Hungar. 2 (1972), 191–213 (1972) Zbl0247.94018MR0335152
6. Dalton H., The Inequality of Incomes, Ruthledge & Keagan Paul, London 1925 
7. Devijver P., Kittler J., Pattern Recognition: A Statistical Approach, Prentice Hall, Englewood Cliffs, NJ 1982 Zbl0542.68071MR0692767
8. Devroy L., Györfi, L., Lugosi G., A Probabilistic Theory of Pattern Recognition, Springer, Berlin 1996 MR1383093
9. Emlen J. M., Ecology: An Evolutionary Approach, Adison-Wesley, Reading 1973 
10. Gini C., Variabilitá e Mutabilitá, Studi Economico-Giuridici della R. Univ. di Cagliari. 3 (1912), Part 2, p. 80 (1912) 
11. Harremöes P., Topsøe F., Inequalities between etropy and index of concidence, IEEE Trans. Inform. Theory 47 (2001), 2944–2960 
12. Havrda J., Charvát F., Concept of structural $a$-entropy, Kybernetika 3 (1967), 30–35 (1967) Zbl0178.22401MR0209067
13. Höffding W., Masstabinvariante Korrelationstheorie, Teubner, Leipzig 1940 
14. Höffding W., Stochastische Abhängigkeit und funktionaler Zusammenhang, Skand. Aktuar. Tidskr. 25 (1942), 200–207 (1942) Zbl0027.41401
15. Kovalevskij V. A., The problem of character recognition from the point of view of mathematical statistics, Character Readers and Pattern Recognition, 3–30. Spartan Books, New York 1967 
16. Liese F., Vajda I., Convex Statistical Distances, Teubner, Leipzig 1987 Zbl0656.62004MR0926905
17. Liese F., Vajda I., On divergences and informations in statistics and information theory, IEEE Trans. Inform. Theory 52 (2006), 4394–4412 MR2300826
18. Marshall A. W., Olkin I., Inequalities: Theory of Majorization and its Applications, Academic Press, New York 1979 Zbl1219.26003MR0552278
19. Morales D., Pardo, L., Vajda I., Uncertainty of discrete stochastic systems, IEEE Trans. Systems, Man Cybernet. Part A 26 (1996), 681–697 (1996) 
20. Pearson K., On the theory of contingency and its relation to association and normal correlation, Drapers Company Research Memoirs, Biometric Ser. 1, London 1904 
21. Perez A., Information-theoretic risk estimates in statistical decision, Kybernetika 3 (1967), 1–21 (1967) Zbl0153.48403MR0208775
22. Rényi A., On measures of dependence, Acta Math. Acad. Sci. Hungar. 10 (1959), 441–451 (1959) Zbl0091.14403MR0115203
23. Rényi A., On measures of entropy and information, In: Proc. Fourth Berkeley Symposium on Probab. Statist., Volume 1, Univ. Calif. Press, Berkeley 1961, pp. 547–561 (1961) MR0132570
24. Sen A., On Economic Inequality, Oxford Univ. Press, London 1973 
25. Simpson E. H., Measurement of diversity, Nature 163 (1949), 688 (1949) Zbl0032.03902
26. Tschuprow A., Grundbegriffe und Grundprobleme der Korrelationstheorie, Berlin 1925 
27. Vajda I., Bounds on the minimal error probability and checking a finite or countable number of hypotheses, Information Transmission Problems 4 (1968), 9–17 (1968) MR0267685
28. Vajda I., Theory of Statistical Inference and Information, Kluwer, Boston 1989 Zbl0711.62002
29. Vajda I., Vašek K., Majorization concave entropies and comparison of experiments, Problems Control Inform. Theory 14 (1985), 105–115 (1985) Zbl0601.62006MR0806056
30. Vajda I., Zvárová J., On relations between informations, entropies and Bayesian decisions, In: Prague Stochastics 2006 (M. Hušková and M. Janžura, eds.), Matfyzpress, Prague 2006, pp. 709–718 
31. Zvárová J., On measures of statistical dependence, Čas. pěst. matemat. 99 (1974), 15–29 (1974) Zbl0282.62048MR0365799
32. Zvárová J., On medical informatics structure, Internat. J. Medical Informatics 44 (1997), 75–81 (1997) 
33. Zvárová J., Information Measures of Stochastic Dependence and Diversity: Theory and Medical Informatics Applications, Doctor of Sciences Dissertation, Academy of Sciences of the Czech Republic, Institute of Informatics, Prague 1998 
34. Zvárová J., Mazura I., Stochastic Genetics (in Czech), Charles University, Karolinum, Prague 2001 
35. Zvárová J., Vajda I., On genetic information, diversity and distance, Methods of Inform. in Medicine 2 (2006), 173–179 
36. Zvárová J., Vajda I., On isotony and anisotony between Gini and Shannon measures of diversity, Preprint, Prague 2006 

1. Wolfgang Stummer, Wei Lao, Limits of Bayesian decision related quantities of binomial asset price models
2. Domingo Morales, Igor Vajda, Generalized information criteria for Bayes decisions