Item Details

Replicability of (Socio)Linguistics studies

Issue: Vol 1 No. 1 (2014)

Journal: Journal of Research Design and Statistics in Linguistics and Communication Science

Subject Areas: Linguistics

DOI: 10.1558/jrds/6783228282


In this paper I address four methodological issues of relevance to the design of (Socio)Linguistics studies. Issues addressed in this paper are: the importance of a proper power analysis during the design stages, or the probability of correctly rejecting the null hypothesis when it is false in the population, the analysis of the structure of the data to select the proper statistical analysis to be used in these studies, polychotomization, or categorization, of continuous variables and its effect on the power of the study, and the determination of sample size to achieve an adequate level of power. After a careful analysis of the review of literature on copula + adjective and the lack of reports on power and sample size calculations to support the generalizations derived from each study, I discuss the design and replicability implications of studies where these design issues have not been addressed.

Author: Jorge Aguilar-Sánchez

View Original Web Page

References :

Aguilar-Sánchez, J. and Kelly, K. (forthcoming). Sample Size Planning in Sociolinguistic Research: A methodological contribution to the study of variation.
Aguilar-Sánchez, J. (2007). The use of Spanish Ser and Estar + adjectives: A sociolinguistic pilot study on the oral Spanish of Costa Rica. Paper presented at the 5th Hawaii Annual International Conference on the Arts and the Humanities, Hawaii.
Aguilar-Sánchez, J. (2009). Syntactic Variation: The case of copula choice in the Spanish of Limón, Costa Rica. (Doctor), Indiana University, Bloomington, IN.
Aguilar-Sánchez, J. (2012). Formal Instruction and Language Contact in Language Variation: the Case of Ser and Estar + Adjective in the Spanishes of Limón, Costa Rica. In K. Geeslin and M. Díaz-Campos (eds), Selected Proceedings of the 14th Hispanic Linguistic Symposium (pp. 9-25). Sumerville, MA: Cascadilla Proceedings Project.
Aguinis, H. (1995) Statistical power problems with moderated multiple regression in management research. Journal of Management 21 (6): 1141–1158.
Algina, J. and Olejnik, S. (2000) Determining sample size for accurate estimation of the squared multiple correlation coefficient. Multivariate Behavioral Research 35 (1): 119–137.
Beck, C. T. (1994) Achieving statistical power through research design sensitivity. Journal of Advanced Nursing 20 (5): 912–916.
Bentivoglio, P. and Sedano, M. (1993) Investigación sociolingüística: Sus métodos aplicados a una experiencia venezolana. Boletín de Lingüística 8: 3–35.
Cohen, J. (1969) Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press.
Cohen, J. (1988) Statistical Power Analysis for the Behavioral Sciences (2nd edn). Hillsdale, NJ: L. Erlbaum Associates.
Cohen, J. (1992a) A power primer. Psychological Bulletin 112 (1): 155–159.
Cohen, J. (1992b) Statistical power analysis. Current Directions in Psychological Science, 1 (3): 98–101.
Díaz-Campos, M. and Geeslin, K. L. (2011) Copula use in the Spanish of Venezuela: Social and linguistic sources of variation in Spanish. Spanish in Context 8 (1): 73–94.
Fishman, J. A. (1972) The Sociology of Language; An Interdisciplinary Social Science Approach to Language in Society. Rowley, MA: Newbury House Publishers.
Gutiérrez, M. (1994) Ser y estar en el habla de Michoacán, México. Universidad Nacional Autónoma de México, México.
Hedges, L. V. (1987) How hard is hard science, how soft is soft science. American Psychologist, 42 (5): 443–455.
Holden, J. E., Kelley, K. and Agarwal, R. (2008) Analyzing change: A primer on multilevel models with applications to nephrology. American Journal of Nephrology, 28 (5): 792–801.
Hox, J. J. (2002) Multilevel Analysis: Techniques and Applications. Mahwah, NJ: Lawrence Erlbaum Publishers.
Johnson, D. E. (2009). Getting off the GoldVarb Standard: Introducing Rbrul for Mixed-Effects Variable Rule Analysis. Language and Linguistics Compass 3 (1): 350–383.
Johnson, D. E. (forthcoming) Progress in regression: Why sociolinguistic data calls for mixed-effects models.
Kelley, K. Maxwell, S. E. and Rausch, J. R. (2003) Obtaining power or obtaining precision. Evaluation & the Health Professions, 26 (3): 258–287.
Kraemer, H. C. and Thiemann, S. (1987) How many Subjects? : Statistical Power Analysis in Research. Newbury Park, CA: Sage Publications.
Labov, W. (1967) The Social Stratification of English in New York City, Dissertation Abstracts: Section A. Humanities and Social Science (Vol. 28, pp. 655A–655A). Ann Arbor, MI.
Labov, W. (1972). Sociolinguistic Patterns. Philadelphia, PA: University of Pennsylvania Press.
Lavandera, B. R. (1975) Linguistic Structure and Sociolinguistic Conditioning in the Use of Verbal Endings in ‘si’-clauses (Buenos Aires Spanish). Philadelphia, PA: University of Pennsylvania.
Leon, A. C. (2004) Sample-size requirements for comparisons of two groups on repeated observations of a binary outcome. Eval Health Prof 27 (1): 34–44.
Lindsay, R. M. and Ehrenberg, A. S. (1993) The design of replicated studies. The American Statistician 47 (3): 217–228.
Lipsey, M. W. (1990). Design Sensitivity: Statistical Power for Experimental Research. Newbury Park, CA: Sage Publications.
Maxwell, S. E. and Delaney, H. D. (1993) Bivariate median splits and spurious statistical significance. Psychological Bulletin 113 (1): 181–190.
Murphy, K. R. and Myors, B. (1998) Statistical Power Analysis: A Simple and General Model for Traditional and Modern Hypothesis Tests. Mahwah, NJ: L. Erlbaum Associates.
Onwuegbuzie, A. J. and Leech, N. L. (2004) Post hoc power: A concept whose time has come. Understanding Statistics 3 (4): 201–230.
Ottenbacher, K. J. (1996) The power of replications and replications of power. The American Statistician 50 (3): 271–275.
Rossi, J. S. (1990) Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting & Clinical Psychology 58 (5): 646–656.
Schmitz, S., Cherny, S. S. and Fulker, D. W. (1998) Increase in power through multivariate analyses. Behavior Genetics 28 (5): 357–363.
Sedlmeier, P. and Gigerenzer, G. (1989) Do studies of statistical power have an effect on the power of studies? Psychological Bulletin 105 (2): 309–316.
Silva-Corvalán, C. (1994) Language Contact and Change : Spanish in Los Angeles. Oxford: Clarendon.
Silva-Corvalán, C. (2001) Sociolingüística y pragmática del español. Washington, DC: Georgetown University Press.
Tagliamonte, S. A. (2006) Analyzing Sociolinguistic Variation. Cambridge: Cambridge University Press.
Tversky, A. and Kahneman, D. (1971) Belief in the law of small numbers. Psychological Bulletin 76 (2): 105–110.
Wilkinson, L. and The American Psychological Association Task Force (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist 54 (8): 594–604.
Ziman, J. (1967) Public Knowledge. Cambridge: Cambridge University Press.
Zodpey, S. P. (2004). Sample size and power analysis in medical research. Indian Journal of Dermatology, Venereology & Leprology 70 (2): 123–128.