Volume 6, Issue 5, September 2017, Page: 221-227
Estimating the Context Effect in a Multilevel Latent Model with Small Sample Sizes: A Monte Carlo Simulation Study
Miao Gao, College of Education, Nanjing Normal University, Nanjing, China
Received: Aug. 3, 2017;       Accepted: Aug. 11, 2017;       Published: Sep. 4, 2017
DOI: 10.11648/j.ajtas.20170605.11      View  2249      Downloads  93
In multilevel modeling, the relationships between the criterion and predictors are investigated at different levels. Often, the cluster-level predictors are measured by aggregating the individual-level measures. However, the aggregated cluster-level predictors do not always reliably measure the cluster-level regression coefficient, and therefore the context coefficient. This study investigates an alternative approach: estimating cluster-level predictor on the latent cluster mean by using multilevel latent. A comparison is made of the accuracy of the context coefficient and standard error under a wide range of conditions. Results reveal that bias for context effect is small in multilevel latent model. Maximum likelihood (ML) estimator yields more accurate standard error estimation than robust maximum likelihood (MLR) when cluster number is small (less than 50). Very small cluster sample sizes (less than 10) should be avoided because they lack power and empirical sampling variance.
Multilevel Latent Model, Context Effect, Parameter Estimate Accuracy, Standard Error, Power
To cite this article
Miao Gao, Estimating the Context Effect in a Multilevel Latent Model with Small Sample Sizes: A Monte Carlo Simulation Study, American Journal of Theoretical and Applied Statistics. Vol. 6, No. 5, 2017, pp. 221-227. doi: 10.11648/j.ajtas.20170605.11
Copyright © 2017 Authors retain the copyright of this article.
This article is an open access article distributed under the Creative Commons Attribution License ( which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Marsh, H. W., Ludtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthen, B., & Nagengast, B. (2009). Doubly-latent school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44(6), 764-802.
Raykov, T. (2007). Longitudinal analysis with regressions among random effects: A latent variable modeling approach. Structural Equation Modeling, 14(1), 146-169.
Shin, Y., & Raudenbush, S. W. (2010). A latent cluster-mean approach to the contextual effects model with missing data. Journal of Educational and Behavioral Statistics, 35, 26-53.
Ludtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthen, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-Level effects in contextual studies. Psychological Methods, 13(3), 203-229.
Ludtke, O., Marsh, H. W., Robitzsch, A., & Trautwein, U. (2011). A 2*2 taxonomy of multilevel latent contextual models: Accuracy - bias trade-offs in full and partial error correction models. Psychological Methods, 16(4), 444-467.
Asparouhov, T., & Muthen, B. (2006). Constructing covariates in multilevel regression. Mplus website. Retrieved from
Preacher, K. J., Zyphur, M. J., & Zhang, Z. (2010). A general multilevel SEM framework for assessing multilevel mediation. Psychological Methods, 15(3), 209-233.
Lopes, P. N., Mestre, J. M., Guil, R., Kremenitzer, J. P., & Salovey, P. (2012). The Role of Knowledge and Skills for Managing Emotions in Adaptation to School Social Behavior and Misconduct in the Classroom. American Educational Research Journal, 49(4), 710-742.
Hox, J. J., Maas, C. J. M., & Brinkhuis, M. J. S. (2010). The effect of estimation method and sample size in multilevel structural equation modeling. Statistica Neerlandica, 64(2), 157-170.
Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample size for multilevel modeling. Methodology, 1(3), 86-92.
Scherbaum, C. A., & Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organizational Research Methods, 12, 347-367.
Snidjers, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advance multilevel modeling. London: Sage.
Maas, C. J. M., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58(2), 127-137.
O’Brien, R. G. (1981). A sample test for variance effects in experimental designs. Psychological Bulletin, 89(3), 570-574.
Zitzmann, S., Lüdtke, O., & Robitzsch, A. (2015). A bayesian approach to more stable estimates of group-level effects in contextual studies. Multivariate Behavioral Research, 50(6), 688-705.
Zitzmann, S., Lüdtke, O., Robitzsch, A., & Marsh, H. W. (2016). A bayesian approach for estimating multilevel latent contextual models. Structural Equation Modeling: A Multidisciplinary Journal, 23(5), 1-20.
Browse journals by subject