Volume 2, Issue 2, March 2013, Page: 15-20
Information Theoretic Models for Dependence Analysis And missing Data Estimation
D. S. Hooda, Department of Mathematics, Jaypee University of Engineering andTechnology, A.B. Road, Raghogarh, Distt.Guna-473226 (M.P.) India; Department of Statistics, University of Jammu, Jammu-(India)
Permil Kumar, Department of Mathematics, Jaypee University of Engineering andTechnology, A.B. Road, Raghogarh, Distt.Guna-473226 (M.P.) India; Department of Statistics, University of Jammu, Jammu-(India)
Received: Feb. 3, 2013;       Published: Mar. 10, 2013
DOI: 10.11648/j.ajtas.20130202.12      View  2566      Downloads  76
Abstract
In the present communication information theoretic dependence measure has been defined using maximum entropy principle, which measures amount of dependence among the attributes in a contingency table. A relation between information theoretic measure of dependence and Chi-square statistic has been discussed. A generalization of this information theoretic dependence measure has been also studied. In the end Yate’s method and maximum entropy estimation of missing data in design of experiment have been described and illustrated by considering practical problems with empirical data.
Keywords
Maximum Entropy Principle, Contingency Table, Chi-Square Statistics, Lagrange’s Multipliers And Depen-dence Measure
To cite this article
D. S. Hooda, Permil Kumar, Information Theoretic Models for Dependence Analysis And missing Data Estimation, American Journal of Theoretical and Applied Statistics. Vol. 2, No. 2, 2013, pp. 15-20. doi: 10.11648/j.ajtas.20130202.12
Reference
[1]
Burg J.P.(1970). "The relationship between Maximum Entropy Spectra and Maximum Likelihood in Modern Spectra Analysis", ed D.G. Childers, pp130-131.
[2]
Harvda, J. and Charvat, F. (1967). Quantification method of classification processes concepts of structural - entropy, Kybernetika, 3: 30-35.
[3]
Kapur, J.N. and Kesavan, H.K. (1992)." Entropy optimization principles with applications." Academic press, San Diego.K. Elissa, "Title of paper if known," unpublished.
[4]
Soofi, E.S. and Gokhale, D.V. (1997). "Information theoretic methods for categorical data. Advances in Econometrics." , JAI Press, Greenwich.
[5]
Watanabe,S.(1969)."Knowing and Guessing".John Wiley,New York,1969.
[6]
Watanabe, S. (1981). "Pattern recognition as a quest for minimum entropy.", Pattern Recognition. 13:381-387.
[7]
Yates, F. (1933). "The analysis of replicated experiments when the field experiments are incomplete.", Emp. Journ. Exp. Agri. 1, 129-142.
Browse journals by subject