Unifying SoTL methodology: Internal and external validity
DOI:
https://doi.org/10.20343/teachlearninqu.6.2.9Keywords:
SoTL, methodology, internal validity, external validity, generalizabilityAbstract
A broad consensus exists that the use of appropriate methods are important in the Scholarship of Teaching and Learning. However, methodological controversies arise around what constitutes acceptable evidence, if one needs a control group, how generalizable results must be, and other similar issues. Much SoTL work, I argue, asks questions about how much a particular treatment (innovation) caused an effect (student learning), and how the results found in one particular context can be extended outside that context (generalizability). These concepts, known as internal validity and external validity, respectively, provide a common point of departure for much scholarship on teaching and learning. This paper addresses these concepts and demonstrates how they can unite much of what divides us within the methodological realm of SoTL.
Metrics
References
Bass, R. & Linkon, S. L. (2008). On the evidence of theory: Close reading as a disciplinary model for writing about teaching and learning. Arts and Humanities in Higher Education, 7(3), 245-261. https://doi.org/10.1177/1474022208094410
Bennett, C., & Dewar, J. (2013). SoTL and interdisciplinary encounters in the study of students’ understanding of mathematical proof. In K. McKinney (Ed.), The Scholarship of Teaching and Learning in and Across the Disciplines (54-73). Bloomington: Indiana University Press.
Bernstein, J. L. & Meizlish, D. S. (2003). Becoming Congress: A longitudinal study of the civic engagement implications of a classroom simulation. Simulation & Gaming, 34(2), 198-219. http://journals.sagepub.com/doi/10.1177/1046878103034002003
Booth, A., & Hyland, P., (Eds). (2000). The Practice of University History Teaching. Manchester: Manchester University Press.
Boyer, E. L. (1990). Scholarship Reconsidered: Priorities of the Professoriate. Stanford: Carnegie Foundation for the Advancement of Teaching.
Burns, H. L. (2016). Learning sustainability leadership: An action research study of a graduate leadership
course. International Journal for the Scholarship of Teaching and Learning, 10(2), Article 8. https://doi.org/10.20429/ijsot1.2016.100208
Chick, N. L. (2014). ‘Methodologically sound’ under the ‘big tent’: An ongoing conversation. International Journal for the Scholarship of Teaching and Learning, 8(2), Article 1. https://doi.org/10.20429/ijsotl.2014.080201
Chick, N. L. (2013). Difference, privilege, and power in the Scholarship of Teaching and Learning: The value of humanities SoTL. In K. McKinney (Ed.), The Scholarship of Teaching and Learning in and Across the Disciplines (15-33). Bloomington: Indiana University Press.
Chick, N. L. (2006). From community property to public property: Shulman challenges CASTL participants to fill in moats and lower drawbridges. ISSOTL International Commons, 1(1), 7. http://www.indiana.edu/~issotl/newsletter/International_Commons_I.pdf
Felten, P. (2013). Principles of good practice in SoTL. Teaching and Learning Inquiry, 1(1), 121-125. https://doi.org/10.20343/teachlearninqu.1.1.121
Gale, R. A. (2005). Aesthetic literacy and the ‘living of lyrical moments.” Journal of Cognitive Affective Learning, 2(1), 1-9.
Glassick, C. E., Huber, M. T., & Maeroff, G. I. (1997). Scholarship Assessed: Evaluation of the Professoriate. San Francisco: Jossey Bass and the Carnegie Foundation for the Advancement of Teaching.
Grauerholz, L. & Main, E. (2013). Fallacies of SoTL: Rethinking how we conduct our research. In K. McKinney (Ed.), The Scholarship of Teaching and Learning in and Across the Disciplines (152-168). Bloomington: Indiana University Press.
Gurung, R. A. R. (2014). Getting foxy: Different magisteria in the Scholarship of Teaching and Learning. Teaching and Learning Inquiry, 2(2), 109-114. https://doi.org/10.20343/teachlearninqu.2.2.109
Gurung, R. A. R., & Schwartz, B. M. (2009). Optimizing Teaching and Learning: Practicing Pedagogical Research. Malden: Wiley-Blackwell.
Huber, M. T. (2009). Teaching travels: Reflections on the social life of classroom inquiry and innovation. International Journal for the Scholarship of Teaching and Learning, 3(2), Article 2. https://doi.org/10.20429/ijsotl.2009.030202
Huber, M. T., & Hutchings, P. (2005). The Advancement of Learning: Building the Teaching Commons. San Francisco: Jossey-Bass.
Huber, M. T., & Morreale, S. P. (Eds). (2002). Disciplinary Styles in the Scholarship of Teaching and Learning: Exploring Common Ground. Washington, DC: American Association of Higher Education and The Carnegie Foundation for the Advancement of Teaching.
Hutchings, P. (2000). Opening Lines: Approaches to the Scholarship of Teaching and Learning. Palo Alto: Carnegie Foundation for the Advancement of Teaching.
Hutchings, P. & Shulman, L. S. (1999). The scholarship of teaching: New elaborations, new developments. Change, 31(5), 10-15. https://doi.org/10.1080/00091389909604218
Lewis, C., Perry, R., & Murata, A. (2006). How should research contribute to instructional improvement?
Educational Researcher, 35(3), 3-14. https://doi.org/10.3102/0013189X035003003
Maurer, T. W. (2011). On publishing SoTL articles. International Journal for the Scholarship of Teaching and Learning, 5(1), 1-2. https://doi.org/10.20429/ijsotl.2011.050132
Nelson, C. E. (2000). Effective strategies for teaching evolution and other controversial subjects. In J. W. Skehan & C. E. Nelson (Eds.), The Creation Controversy and the Science Classroom (19-50). Arlington: National Science Teachers Association.
Powell, J. L., & Drucker, A. D. (1997). The role of peer conformity in the decision to ride with an intoxicated driver. Journal of Alcohol and Drug Education, 43(1), 1-7.
Salvatori, M. R., & Donahue, P. (2005). The Elements (and Pleasures) of Difficulty. New York: Pearson.
Shulman, L. S. (2013, October). Situated studies of teaching and learning: The new mainstream. Keynote address at the meeting of the International Society for the Scholarship of Teaching and Learning, Raleigh, NC.
Tetlock, P. E. (2006). Expert Political Judgment: How Good Is It? How Can We Know? Princeton: Princeton University Press.
Wineburg, S. (2001). Historical Thinking and Other Unnatural Acts: Charting the Future of Teaching the Past. Philadelphia: Temple University Press.
