The mutual information estimation in the sampling with replacement

M. A. Gil; R. Perez; I. Martinez

RAIRO - Operations Research - Recherche Opérationnelle (1986)

  • Volume: 20, Issue: 3, page 257-268
  • ISSN: 0399-0559

How to cite


Gil, M. A., Perez, R., and Martinez, I.. "The mutual information estimation in the sampling with replacement." RAIRO - Operations Research - Recherche Opérationnelle 20.3 (1986): 257-268. <>.

author = {Gil, M. A., Perez, R., Martinez, I.},
journal = {RAIRO - Operations Research - Recherche Opérationnelle},
keywords = {conditional entropy; sampling with replacement; Monte Carlo simulation; information measures; unbiased estimator; mutual information of order 2; Shannon's mutual information},
language = {eng},
number = {3},
pages = {257-268},
publisher = {EDP-Sciences},
title = {The mutual information estimation in the sampling with replacement},
url = {},
volume = {20},
year = {1986},

AU - Gil, M. A.
AU - Perez, R.
AU - Martinez, I.
TI - The mutual information estimation in the sampling with replacement
JO - RAIRO - Operations Research - Recherche Opérationnelle
PY - 1986
PB - EDP-Sciences
VL - 20
IS - 3
SP - 257
EP - 268
LA - eng
KW - conditional entropy; sampling with replacement; Monte Carlo simulation; information measures; unbiased estimator; mutual information of order 2; Shannon's mutual information
UR -
ER -


  1. 1. J. ACZEL and Z. DAROCZY, On Measures of Information and Their Characterizations, Academic Press (New York), 1975. Zbl0345.94022MR689178
  2. 2. J. ACZEL and Pl. KANNAPAN, A Mixed Theory of Information. III. Inset Entropies of Degree ß, Inf. and Contr., 39, 1978, 315-322. Zbl0393.94011MR523445
  3. 3. N. L. AGGARWAL, Y. CESARI and C. F. PICARD, Propriétés de branchement liées aux questionnaires de Campbell et à l'information de Renyi, C.R. Acad. Sc. Paris, Série A, t.275, 437-440, 1972. Zbl0243.94013MR305903
  4. 4. F. AZORIN, Curso de Muestreo y Applicaciones, Ed. Aguilar (Madrid), 1972. 
  5. 5. F. AZORIN, Diversity and Uncertainty, Proc. F.I.S.A.L.-83 (Palma de Mallorca), 1983, 37-44. 
  6. 6. T. N. BHARGAVA and V. R. R. UPPULURI, On an axiomatic derivation of Gini diversity with applications, Metron, Vol. XXXIII, N.l-2, 1985. Zbl0366.62005MR475961
  7. 7. T. N. BHARGAVA and V. R. R. UPPULURI, Sampling Distribution of Gini's index of diversity, Appl. Math. Comput., 3, 1-24, 1977. Zbl0403.62018MR436416
  8. 8. F. BOURGUIGNON, Decomposable income inequality measures, Econometrica, 47, 901-920, 1979. Zbl0424.90013MR537636
  9. 9. W. G. COCHRAN, Sampling Techniques, John Wiley (New York), 1967. Zbl0051.10707
  10. 10. F. A. COWELL, On the structure of additive inequality measures, Review of Economic Studies, 47, 521-531, 1980. Zbl0437.90035
  11. 11. Z. DAROCZY, Generalized Information Functions, Inf. and Contr., 16, 36-51, 1970. Zbl0205.46901MR272528
  12. 12. W. EICHHORN and W. GEHRIG, Measurement of Inequality in Economics, Modern Applied Mathematics Optimization and Operations Research, Ed. B. Korte, North Holland (Amsterdam), 1982. Zbl0491.90024
  13. 13. H. EMPTOZ, Informations utiles et pseudoquestionnaires, These, Université Claude-Bernard (Lyon), 1976. 
  14. 14. M. A. GIL, Estudio de una medida para la incertidumbre correspondiente a las utilidades, Trab. de Est. e Inv. Oper., Vol. 32, 3, 45-66, 1981. 
  15. 15. M. A GIL, Criterion of Maximizing the Expected Quietness (invariant by homotheties in relation to the utilities), R.A.Ï.R.O.-Rech. Opér., 16, 319-331, 1982. Zbl0505.62002MR704149
  16. 16. M. A. GIL, Mixed Criterion of Expected Utility and Quietness (invariant by homotheties with respect to the utilities), Statistica, Anno XLII, n.l, 21-37, 1982. Zbl0504.62009MR668835
  17. 17. P. GILTeoria Matemática de la Información, Ed. ICE (Madrid), 1981. 
  18. 18. J. HAVRDA and F. CHARVAT, Quantification method of classification processes, Kybernetica, 3, 30-35, 1967. Zbl0178.22401MR209067
  19. 19. Sir M. KENDALL and A. STUART, The Advanced Theory of Statistics, Charles Griffin Co. Ltd. (London), 1977-83. Zbl0353.62013
  20. 20. A. M. MATHAI and P. N. RATHIE, Basic Concepts in Information Theory and Statistics, Wiley Eastern Limited (New Delhi), 1975. Zbl0346.94014MR396034
  21. 21. O. ONICESCU, Energie Informationnelle, C. R. Acad. Sci. Paris, Série A, t. 263, 1966, 841-842. Zbl0143.41206MR229478
  22. 22. R. PEREZ, Estimación de la incertidumbre, la incertidumbre ùtil y la inquietud en poblaciones finitas. Una aplicación a las medidas de desigualdad, Sesión Científica de la Real Acad. Ciencias de Madrid, 10 Abril, 1985. 
  23. 23. R. PEREZ, M. A. GIL and P. GIL, Estimating the Uncertainly associated with a Variable in a Finite Population, Kybernetes, 15 (3), 1986. Zbl0655.62006MR864794
  24. 24. C. F. PICARD, Graphes et Questionnaires, Tome 2, Gauthier-Villars Ed. (Paris), 1972. Zbl0266.94018
  25. 25. E. C. PIELOU, An Introduction to Mathematical Diversity, Wiley-Interscience (New York), 1969. Zbl0259.92001
  26. 26. P. N. RATHIE and Pl. KANNAPPAN, An inaccuracy function of the type ß, Ann. Inst. Statist. Math., 25, 205-214, 1973. Zbl0338.94016MR335158
  27. 27. C. E. SHANNON, A Mathematical Theory of Communication, Bell. System. Tech., J. 27, 379-423, 1948. Zbl1154.94303MR26286
  28. 28. A. F. SHORROCKS, The class of additively decomposable inequality measures, Econometrica, 48, 613-625, 1980. Zbl0435.90040MR573315
  29. 29. E. H. SIMPSON, Measurement of Diversity, Nature, 163, 688, 1949. Zbl0032.03902
  30. 30. H. THEIL, Economics and Information Theory, North Holland (Amsterdam), 1967. 
  31. 31. D. ZAGIER, On the decomposability of the Gini coefficient and other indices of inequality. Discussion Paper No. 108, Projectgruppe Theoretische Modelle, Universität Bonn, 1983. 

Citations in EuDML Documents

  1. H. Messatfa, Unification de certains critères d'association par linéarisation et normalisation
  2. María Angeles Gil, Comparing the suitability of two factors for stratification in estimating diversity
  3. Covadonga Caso, María Angeles Gil, Estimating income inequality in the stratified sampling from complete data. II. The asymptotic behaviour and the choice of sample size
  4. María Angeles Gil, Rigoberto Perez, Pedro Gil, The mutual information. Estimation in the sampling without replacement

NotesEmbed ?


You must be logged in to post comments.

To embed these notes on your page include the following JavaScript code on your page where you want the notes to appear.

Only the controls for the widget will be shown in your chosen language. Notes will be shown in their authored language.

Tells the widget how many notes to show per page. You can cycle through additional notes using the next and previous controls.


Note: Best practice suggests putting the JavaScript code just before the closing </body> tag.