A Content Analysis of the Emergent Scholarship on Digital and Open Badges in Higher Education Learning and Assessment
Abstract
Higher Education has seen its fair share of innovations, many of which were made possible by digital technologies. Digital and open badges (DOBs) are emergent technologies that many believe could further reform, even disrupt, key tenets in higher education, including learning, assessment and credentialing. This study examined the emerging scholarship and best practices on DOB adoption in higher education through the lens of peer-reviewed publications. A content analysis explored two questions related to publication patterns and research goals (question 1) and assessment practices supported by DOBs and stakeholder perceptions of DOBs (question 2). Findings revealed non-empirical papers were more likely to focus on the reform-related potential of DOBs while empirical applications focused on traditional concerns such as student motivation and engagement, and conventional approaches to assessment. Stakeholder perception of the value and role of DOBs were also mixed. Limitations, implications, and further study are discussed.
DOI:DOI:10.2458/azu_itet_v7i2_haughton
Keywords
Full Text:
HTMLReferences
Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy of educational objectives. New York: Longman.
Babbie, E. (2010). The Practice of Social Research. Belmont, CA: Wadsworth.
Barron, A., B., Hebets, E. A., Cleland, T.A., Fitzpatrick, C. L., Hauber, M. E., & Stevens, J. R. (2015). Embracing multiple definitions of learning. Trends in Neurosciences, 38(7), 405-407.
Berge, Z., & Muilenberg, L. (2016). In the eyes of the beholder: Value of digital badges. In Muilenburg, L., & Berge, B. (Eds.), Digital badges in education: Trends, issues, and cases (pp. 102-108). New York, NY: Routledge.
Bjork, B-C., & Hedlund, T. (2015). Emerging new methods of peer review in scholarly journals. Learned Publishing, 28, 85-91.
Blackburn, R., Porto, S., & Thompson, J. (2016). Competency-based education and the relationship to digital badges. In Muilenburg, L., & Berge, B., (2016). Digital badges in education: Trends, issues, and case (pp. 30-38). New York, NY: Routledge.
Bloom, B.S. (Ed.). Engelhart, M.D., Furst, E.J., Hill, W.H., Krathwohl, D.R. (1956).Taxonomy of Educational Objectives, Handbook I: The Cognitive Domain. New York: David McKay Co Inc.
Bloom, B.S., & Krathwohl, D.R. (1956) Taxonomy of Educational Objectives: The Classification of Educational Goals, by a committee of college and university examiners. Handbook I: Cognitive Domain. NY, NY: Longmans, Green.
Bowen, K., & Thomas, A. (2014). Badges: A common currency for learning. Change, January/February, 22-25.
Burns, M. (2013). Success, failure, or no significant difference: Charting a course for successful educational technology integration. International Journal of Emergent Technologies in Learning, 8(1), 38-45. doi.org/10.3991/ijet.v8i1.2376
Buckingham, J. (2014). Open digital badges for the uninitiated. The Electronic Journal for English as a Second Language, 18(1). Retrieved from http://www.tesl-ej.org/wordpress/issues/volume18/ej69/ej69int/
Carey, K. (2012). A future full of badges. Chronicle of Higher Education.
Casilli, C., & Hickey, D. (2016). Transcending conventional credentialing and assessment paradigms with information-rich badges. The Information Society, 12(2), 117-129. DOI 10.1080/1972243.2016.1130500
Christensen, C., Horn, M., & Johnson, C. (2008). Disrupting class: How disruptive innovation will change the way the world learns. New York: McGraw-Hill.
Clark, R. E. (1991). When researchers swim upstream: Reflections on an unpopular argument about learning from media. Educational Technology, 31(2), 34-40.
Commission of the European Communities. (2000). A memorandum on lifelong learning. Retrieved from http://arhiv.acs.si/dokumenti/Memorandum_on_Lifelong_Learning.pdf
Creswell, J. W. (2012). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (4th edition). Boston, MA: Pearson Education, Inc.
Cuban, L. (1996). High-tech schools and low-tech teachers: A commentary. Journal of Computing in Teacher Education, 14(2), 6-7.
Cuban, L. (2001). Oversold and underused: Computers in the classroom. Cambridge, MA: Harvard University Press.
Cuban, L., & Jandric´, P. (2015). The dubious promise of educational technologies: Historical patterns and future challenges. E-Leaning and Digital Media, 12(3-4), 425-439. DOI: 10.1177/2042753015579978
Derrick, G. E., & Pavone, C. (2013). Democratising research evaluation: Achieving greater public engagement with bibliometrics-informed peer review. Science and Public Policy, 40, 563-575.
Derryberry, A., Everhart, D., & Knight, E. (2016). Badges and competencies: New currency for professional credentials. In Muilenburg, L., & Berge, B. (Eds.), Digital badges in education: Trends, issues, and case (pp. 12-20). New York, NY: Routledge.
Fanfarelli, J., & McDaniel, R. (2015). Individual differences in digital badging: Do learner characteristics matter? Journal of Educational Technology, 43(4), 403-428. DOI: 10.1177/0047239515588165
Fleming, N. (February 5, 2013). R.I. Students gaining ‘badges’ and credits outside of school. Education Week. Retrieved from https://www.edweek.org/ew/articles/2013/02/06/20credits.h32.html.
Finkelstein, J., Knight, E., & Manning, S. (2013). The Potential and Value of Using Digital Badges for Adult Learners Final Report. American Institutes for Research, 16.
Frederiksen, L. (2013). Digital Badges, Public Services Quarterly, 9, 321-325. DOI: 10.1080/15228959.2013.842414
Gamrat, G., Toomey Zimmerman, H., Dudek, J., & Peck, K. (2014). Personalized workplace learning: An exploratory study on digital badging within a teacher professional development program. British Journal of Educational Technology, 45(6), 1136-1148, DOI: 10.1111/bjet.12200
Gibson, D., Ostashewski, N., Flintoff, K., Grant, S., & Knight, E. (2015). Digital badges in education. Education Information Technology, 20, 403-410. DOI 10.1007/s10639-013-9291-7
Grant, S. (2014). Badges: Show what you know. Young Adult Library Services, 28-32.
Grant, S. (2016). History and context of Open Digital Badges. In Muilenburg, L., & Berge, B. (Eds.), Digital badges in education: Trends, issues, and case (pp. 3-11). New York, NY: Routledge.
Grant, S., & Shawgo, K. (2013). Digital badges: An annotated research bibliography. Retrieved from https://www.hastac.org/digital-badges-bibliography
Hickey, D. T., Itow, R. C., Rehak, A., Schenke, K., & Tran, C. (2013). Speaking personally – with Erin Knight. American Journal of Distance Education, 27(2), 134-138.
Hickey, D. T., Otto, N., Itow, R. C., Rehak, A., Schenke, K., Tran, C., & Chow, C. (2014). Badge Design Principles Documentation Project. Retrieved from http://dpdproject.info/files/2014/05/DPD-interim-report-v4-january.pdf
Hickey, D. T., Willis, J. E. , & Quick, J. D. (2015) Where badges work better. Retrieved from https://library.educause.edu/resources/2015/6/where-badges-work-better
Jacobs, J. (2012, January 20). Digital badges threaten college’s monopoly on credentials: Badges for lifelong learners’ knowledge and skills are considered a ‘game-changing strategy. US News and World Report. Retrieved from http://www.usnews.com/education/best-colleges/articles/2012/01/20/digital-badges-threaten-colleges-monopoly-on-credentials
Jovanovic, J., & Devedzic, V. (2015). Open badges: Novel means to motivate, scaffold, and recognize learning. Tech Know Learn, 20, 115-122. DOI 10:1007/s10758-014-9232-6
Klein-Collins, R. (2012). Competency-based degree programs in the U.S.: Postsecondary credentials for measurable student learning and performance. Retrieved from http://fi les.eric.ed.gov/ fulltext/ED547416.pdf
Klein-Collins, R., & Wertheimer, J. B. (2013). (2012). Growing Importance of Prior Learning Assessment in the Degree-Completion Toolkit. New Directions for Adult and Continuing Education, 140, 51-60. DOI: 10.1002/ace.20060
Leon, M. R., & Price, T. Al. (2016). On the cutting edge: Movements and institutional examples of technological disruption. New Directions for Higher Education, 173, 97-107. DOI: 10.1002/he.20183
Liyanagunawardena, T., Scalzavara, S., & Williams, S. (2017). Open Badges: A Systematic Review of Peer-Reviewed Published Literature (2011-2015). European Journal of Open, Distance and E-Learning, 20(10), 2015. DOI: 10.1515/eurodl-2017-0013
Lumina Foundation (2014). The Degree Qualifications Profile: A learning-centered framework for what college students should know and be able to do to earn the associate, bachelor’s or master’s degree. Retrieved from http://degreeprofile.org/press_four/wp-content/uploads/2014/09/DQP-web-download.pdf
MacArthur Foundation. (2015). Digital badges: How to make credentials matter. Retrieved from https://www.edsurge.com/news/2015-02-02-how-to-make-micro-credentials-matter
McMillan, James (2012). Educational Research: Fundamentals for the Consumer (6th edition). New York, NY: Pearson Education, Inc.
Morris, L. (2016). Disruption in economies, industries, and political affairs: Can postsecondary education be far behind? Innovative Higher Education, 42(1), 1-2.
Mozilla Foundation (2016). About Open Badges. Retrieved from https://openbadges.org/about/#top
Nitko, A., & Brookhart, S. (2011). Educational assessment of students, (6th ed.). Boston, MA: Pearson.
O’Byrne, W. I., Schenke, K., Willis III, J., E., & Hickey, D. T. (2015). Digital badges recognizing, assessment, and motivating learners in and out of school contexts. Journal of Adolescent and Adult Literacy, 58(6), 451-454.
Ohio Department of Education (n.d.). Ohio Department of Education Website. Retrieved from http://education.ohio.gov
Otto, N., & Hickey, D. T. (2014). Design Principles for Digital Badge Systems. Cham.
Palomba, C. A., & Banta, T. W. (2001). Assessing student competence in accredited disciplines: Pioneering approaches to assessment in higher education. Stylus Publishing, LLC.
Peck, K., Bowen, K., Rimland, E., & Oberdick, J. (2016). Badging as micro-credentials in formal education and information education. In Muilenburg, L., & Berge, B. (Eds.), Digital badges in education: Trends, issues, and cases (pp. 82-92). New York, NY: Routledge.
Rothwell, W. J, & Graber, J. M. (2010). Competency-based training basics (ASTS Training Basics Series). American Society for Training and Development. Danvers, MA: Copyright Clearance Center.
Schaffner, A. C. (1994). The future of scientific journals: Lessons from the past. Information Technology and Libraries, 13, 239-247.
Singh, M., & Duvekot, R. (eds.) (2013). Linking recognition practices and national qualifications frameworks. Hamburg, Germany: UNESCO Institute for Lifelong Learning.
Solomon, D. J. (2007). The role of peer review for scholarly journals in the Information Age. The journal of electronic publishing, 10(1), Winter 2007. Retrieved from http://quod.lib.umich.edu/j/jep/3336451.0010.107?view=text;rgn=main.
Stone, E. (2015). Digital badges: A career booster. Strategic Finance, June 2025, 19-21.
Suskie, L. (2009). Assessing student learning: A common sense guide. (2nd ed.). San Francisco, CA: John Wiley & Sons.
UNESCO (2009). Harnessing the power and potential of adult learning and education for a viable future. Belém Framework for Action Preliminary Draft. Retrieved from http://www.unesco.org/fileadmin/MULTIMEDIA/INSTITUTES/UIL/confintea/pdf/working_documents/confinteavi_framework_en.pdf
United States Department of Education (2006). A test of leadership: Charting the future of U.S. Higher Education. Retrieved from http://www2.ed.gov/about/bdscomm/list/hiedfuture/reports/final-report.pdf
United States Department of Education, National Center for Educational Statistics (2002). Defining and assessing learning: Exploring competency-based initiatives. (NCES 2002-159). Retrieved from http://nces.ed.gov/pubs2002/2002159.pdf
United States Department of Education. (n.d.). Competency-based learning or personalizes learning. Retrieved from http://www.ed.gov/oii-news/competency-based-learning-or-personalized-learning
Voorhees, R. A. (2001). Competency-based learning models: A necessary future. In R. A. Voorhees (Ed.), New Directions for Institutional Research: No 110. Measuring what matters: Competency-based learning models in higher education (pp. 5-13). San Francisco: Jossey-Bass.
Webb, E.J., Campbell, D. T., Schwartz, R.D., Sechrest, L., & Grove, J.B. (1981). Nonreactive measures in the social sciences. Chicago, IL: Rand McNally.
Whitworth, A. (2012). Invisible success: Problems with the grand technological innovation in higher education. Computers & Education, 59, 145-155. DOI:10.1016/j.compedu.2011.09.023
Zlatkin-Troitschanskaia, O., Shavelson, R. J., & Kuhn, C. (2015). The international state of research on measurement of competency in higher education. Studies in Higher Education, 40(3), 393-411. DOI: 10.1080/030375079.2015.1004241
