11
Summary
As we come to the close of this module, we want to acknowledge the important efforts you are making toward the design and development of your online course, as well as your development of essential skills as an online instructor. The assessments you create will help you uncover and correct common student misconceptions, develop critical teacher-student interaction, alerts you to potential learning barriers, and provide feedback to your students on their progress towards achieving the learning objectives. If you have any questions about any of the content in this module, you are welcome to discuss them with your instructional design consultant.
References & Resources
This is NOT a required activity for this module. The information below is provided only as a resource for further exploration of the topics covered in this module. As desired, read or view any of the following to further your understanding or see concepts from different perspectives. Topics are divided into two parts:
- Resources external to the module that can further what you learned from the lessons, plus
- References collected from the entire module.
Key Characteristics of Online Courses
Allen, I. E., & Seaman, J. (2013). Changing course: Ten years of tracking online education in the United States. Babson Survey Research Group.Retrieved from http://www.onlinelearningsurvey.com/reports/changingcourse.pdf
Culatta, R. (Producer). (2009, October 13). Designing online learning. [Video file] Retrieved from http://www.youtube.com/watch?v=Zv-_GCFdLdo
Hattie, J. (2009). Visible learning: A Synthesis of Over 800 Meta-Analyses Related to Achievement. New York: Routledge
Hattie, J. (2012). Visible Learning for Teachers: Maximizing Impact on Learning. New York: Routledge.
Kumar, D.D. (1991). A meta-analysis of the relationship between science instruction and student engagement. Educational Review, 43(1), 49-61.
Moore, M.G. & Kearsley, G. (1996). Distance Education: A Systems View. Belmont, CA: Wadsworth Publishing Company.
Poulin, R (2017). On the OIG/WGU Finding, Part 1: When Interaction Is Not Interaction. Retrieved from https://wcetfrontiers.org/2017/09/22/wgu-interaction/
Scholz, C. (Producer). (2011, February 19). Interactions in e-Learning: From theory to practice. [Video file] Retrieved from http://youtu.be/1fAn-Un3Lys
Designing Effective Online Assessments
Boise State University Testing Center. (2017). Proctored tests. Retrieved from http://testing.boisestate.edu
Boise State University Office of the Dean of Students. (2016). Academic Dishonesty Policy and Procedure. Retrieved from http://deanofstudents.boisestate.edu/academic-dishonesty/
Cluskey, G., Ehlen, C., & Raiborn, M. (2011). Thwarting online exam cheating without proctor supervision. Journal of Academic and Business Ethics, 4, 1-7 [PDF] Retrieved from http://www.aabri.com/manuscripts/11775.pdf
Dikli, S., (2003). Assessment at a distance: Traditional vs. alternative assessments. The Turkish Online Journal of Educational Technology, 2(3). 13-19. Retrieved from http://www.tojet.net/articles/v2i3/232.pdf
Distance Education Report. (2010). Faculty Focus special report: Promoting academic integrity in online education. [PDF] Free download, retrieved from http://www.facultyfocus.com/free-reports/promoting-academic-integrity-in-online-education/
Duffy, R., & Dik, B. (2012). Quality control criteria for assessments. Retrieved from http://makeyourjobacalling.com/2012/09/27/quality-control-criteria-for-assessments/
EDUCAUSE (2010). 7 things you should know about assessing online team-based learning. [PDF] Retrieved from https://library.educause.edu/~/media/files/library/2010/8/eli7063-pdf.pdf
Hattie, J., & Yates, G. (2014). Visible learning and the science of how we learn. New York: Routledge. Permalink at http://boisestate.worldcat.org/oclc/886653743
Rowe, N. (2004). Cheating in online student assessment: Beyond plagiarism. Online Journal of Distance Administration, 7(2). Retrieved from http://www.westga.edu/~distance/ojdla/summer72/rowe72.html
Sitzmann, T., Ely, K., Bell, B., & Bauer, K. (2010). The effects of technical difficulties on learning and attrition during online training. Journal of Experimental Psychology, 16(3). 281-202.
Stiggins, R. (2013). Productive classroom assessment in college classes. Portland, OR: Assessment Training Institute
WCET. (2009). Best practice strategies to promote academic integrity in online education. [PDF] Retrieved from http://wcet.wiche.edu/wcet/docs/cigs/studentauthentication/BestPractices.pdf
WCET. (2008). Are your online students really the ones registered for the course? Student authentication requirements for distance education providers. [PDF] Retrieved from http://wcet.wiche.edu/wcet/docs/publications/Briefing_Paper_Feb_2008.pdf
Assessment (General)
9 principles of good practice for assessing student learning – From the American Association for Higher Education (AAHE)
Assessing online learning: Strategies, challenges, and opportunities – A collection of essays
Assessing student online learning (9:59) – A video lecture by Dr. Curtis Bonk, who emphasizes the importance of assessment in an online environment and presents a wide range of assessment types in an online course.
Boettcher, J. (2011). Evidence of learning online: Assessment beyond the paper. Retrieved from http://campustechnology.com/Articles/2011/02/23/Assessment-Beyond-The-Paper.aspx?Page=1
Carnegie Mellon University’s Eberly Center for Teaching Excellence. ( n.d.). Align assessments with objectives. Retrieved from http://www.cmu.edu/teaching/assessment/howto/basics/objectives.html
Frey, B. B., & Schmitt, V. L. (2007). Coming to terms with classroom assessment.Journal of Advanced Academics, 18, 402–423. Retrieved from http://nbctwave.org/wp-content/uploads/2012/11/Coming_to_Terms_With_Classroom_Assessment.pdf
Johnson, M. (2009, September 28). Professor Dancealot. [Video file] Retrieved from http://www.youtube.com/watch?v=1k8aeDUC9XQ&list=PLAINAxJFZJMvFni3LOjvXqHzRlErK988s&index=1
Marzano, R. J. ( 2006). The case for classroom assessment. In Classroom Assessment & Grading That Work. Alexandria, VA: ASCD. Retrieved from http://www.ascd.org/publications/books/106006/chapters/The-Case-for-Classroom-Assessment.aspx
Sewell, J., Frith, K., & Colvin, M. (2010). Online assessment strategies: A primer. Journal of Online Learning and Teaching, 6(1), 297-304. Retrieved from http://jolt.merlot.org/vol6no1/sewell_0310.pdf
Stiggins, R. (2005). Student-involved assessment for learning. Upper Saddle River, NJ: Pearson Education
University of Wollongong. (2012). A comparison of assessment methods. Retrieved from http://www.uow.edu.au/about/teaching/goodpractice/UOW041467.html
Assessment Issues (Academic Integrity, etc.)
Blackboard SafeAssign Instructor Guide. (2010). About SafeAssign. [PDF] Retrieved from http://www.vanderbilt.edu/oak/docs/Bb_91_SafeAssign_Instructor_Guide.pdf
Boise State University eCampus Center. (2013). Proctored tests. Retrieved from http://ecampus.boisestate.edu/faculty/guidelines/proctored-tests/
Boise State University Office of Student Rights and Responsibilities. (2013). Student conduct program-code of conduct article 2. Retrieved from http://osrr.boisestate.edu/scp-codeofconduct-article2/#18A
Carroll, J., & Appleton, J. (2001). Plagiarism: A good practice guide. [PDF] Retrieved from http://archive.plagiarismadvice.org/documents/brookes.pdf
Challen, R., Penfold, B., & Purnell, E. (2008). Using ePortfolios to promote assessment process and prevent plagiarism. [PDF] Retrieved from http://www.plagiarismadvice.org/research-papers/item/using-eportfolios-to-promote-assessment-processes-and-prevent-plagiarism
Cluskey, G., Ehlen, C., & Raiborn, M. (2011). Thwarting online exam cheating without proctor supervision. Journal of Academic and Business Ethics, 4, 1-7
Dikli, S., (2003). Assessment at a distance: Traditional vs. alternative assessments. The Turkish Online Journal of Educational Technology, 2(3). 13-19. Retrieved from http://www.tojet.net/articles/v2i3/232.pdf
Distance Education Report. (2010). Faculty Focus special report: Promoting academic integrity in online education. [PDF] Retrieved from http://www.facultyfocus.com/free-reports/promoting-academic-integrity-in-online-education/
Duffy, R., & Dik, B. (2012). Quality control criteria for assessments. Retrieved from http://makeyourjobacalling.com/2012/09/27/quality-control-criteria-for-assessments/
EDUCAUSE (2010). 7 things you should know about assessing online team-based learning. [PDF] Retrieved from http://net.educause.edu/ir/library/pdf/ELI7063.pdf
Organero, M., & Kloos, C. (2007). Using forums and assessments as motivational tools in eLearning courses: A case study. [PDF] Retrieved from http://fie-conference.org/fie2007/papers/1035.pdf
Rowe, N. (2004). Cheating in online student assessment: Beyond plagiarism. Online Journal of Distance Administration, 7(2). Retrieved from http://www.westga.edu/~distance/ojdla/summer72/rowe72.html
Schulze, A., & O’Keefe, A. (2005). Effectively using self assessments in online learning. [PDF] Retrieved from http://www.uwex.edu/disted/conference/Resource_library/proceedings/02_68.pdf
Sitzmann, T., Ely, K., Bell, B., & Bauer, K. (2010). The effects of technical difficulties on learning and attrition during online training. Journal of Experimental Psychology, 16(3). 281-202.
WCET. (2009). Best practice strategies to promote academic integrity in online education. [PDF] Retrieved from http://wcet.wiche.edu/wcet/docs/cigs/studentauthentication/BestPractices.pdf
WCET. (2008). Are your online students really the ones registered for the course? Student authentication requirements for distance education providers. [PDF] Retrieved from http://wcet.wiche.edu/wcet/docs/publications/Briefing_Paper_Feb_2008.pdf
Course Design
Fink, D. (2003). Situational Factors [picture]. In Creating Significant learning Experiences, (p. 62). San Francisco: Jossey-Bass.
Maryland Online (2011). Quality Matters rubric standards 2011-2013 edition with assigned point values. [PDF] Retrieved from http://www.qmprogram.org/files/QM_Standards_2011-2013.pdf
Palloff, R. M., & Pratt, K. (1999). Building learning communities in cyberspace: Effective strategies for the online classroom. San Francisco: Jossey-Bass Publishers
Grading Schemes
Dooms, M. (2012, August 15). Standards-based grading in a percentage-based world. [Blog post] Retrieved from http://teacherleaders.wordpress.com/2012/08/15/standards-based-grading-in-a-percentage-based-world/
Stapel, E. (2012). How do I compute my grade? Retrieved from http://www.purplemath.com/modules/howgrade.htm
Venn, J. (2000). Alternate grading. Retrieved from http://johnvenn.com/assessment/assessment_alternate_grading.html
Weimer, M. (2011, October 19). Grading practices: Liabilities of the points system. [Blog post] Retrieved from http://www.facultyfocus.com/articles/teaching-professor-blog/grading-practices-liabilities-of-the-points-system/
Rubrics
Fey, B. (n.d). Rubric for asynchronous discussion participation. [PDF]. Retrieved from http://www.cidde.pitt.edu/cw/Bbfiles/pdfs/Rubric_Asynchronous_Discussion.pdf
Mueller, J. (2012a) Rubrics. Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/rubrics.htm
Mueller, J. (2012b) Step 4: Create the rubric. Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/howstep4.htm
Rcampus. (2012). Rubric gallery. Retrieved from http://www.rcampus.com/rubricshellc.cfm?mode=gallery&sms=publicrub&glid=5&
Rubistar. (2008). Rubistar: Create rubrics for your project based learning activities. Retrieved from http://rubistar.4teachers.org/
Schrock, K., (2013). Kathy Schrock’s guide to everything. Retrieved from http://www.schrockguide.net/assessment-and-rubrics.html
University of Wisconsin-Stout’s School of Education. (2012). Rubrics for assessments. Retrieved from http://www.uwstout.edu/soe/profdev/rubrics.cfm
Toolbox References
Blogs / Journals
EDUCAUSE (2005). 7 things you should know about blogs. [PDF] Retrieved from http://net.educause.edu/ir/library/pdf/ELI7006.pdf
Common Craft. (2013). Blogs in plain English. [Video file] Retrieved from http://www.commoncraft.com/video/blogs
OpenContent Wiki (n.d.). How to use a blog to facilitate learning. Retrieved from http://www.opencontent.org/wiki/index.php?title=How_to_use_a_blog_to_facilitate_learning
Reiss, D. (2003). Educational weblogs and resources. Retrieved from http://www.wordsworth2.net/writing/weblogresource.htm
University of Liverpool. (n.d). University student blog. Retrieved from http://www.university-liverpool-online.com/online-learning/student-blog
Wayman, A. (Producer). (2007, January 29). What are blogs? [Video file] http://www.youtube.com/watch?v=uWaSLE1CELc
Edelstein, S. & Edwards, J. (2002, April). If you build it, they will come: Building learning communities through threaded discussions. eLearn Magazine. Retrieved from http://elearnmag.acm.org/featured.cfm?aid=566829&emailsent=1&CFID=41424174&CFTOKEN=83420119
Northover, M. (2002). Online discussion boards: Friend or foe? [PDF] Retrieved from http://www.ascilite.org.au/conferences/auckland02/proceedings/papers/193.pdf
Rovai, A. (2007). Facilitating online discussion effectively. Internet and Higher Education, 10, 77-88. doi:10.1016/j.iheduc.2006.10.001
Smith, T. (2002). Discussions: Importance, design, facilitation, and evaluation. Retrieved from http://www.ion.uillinois.edu/resources/pointersclickers/2002_11/index.asp
Soter, A.O. , Wilkinson, I. A. G., Murphy, K., Rudge, L., & Reninger, K. (2006). Analyzing the discourse of discussion: Coding manual. Unpublished manuscript, Columbus, OH.
ePortfolios
Mueller, J. (2012a). Authentic assessment toolbox: Portfolios. Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/portfolios.htm
San Francisco State University Academic Technology (2013a). ePortfolios and teaching: Preparation. Retrieved from http://eportfolio.sfsu.edu/faculty_prep.php
San Francisco State University Academic Technology (2013b). SF State ePortfolio gallery. Retrieved from http://eportfolio.sfsu.edu/gallery.php
San Francisco State University Academic Technology (2013c). What is an ePortfolio? Retrieved from http://eportfolio.sfsu.edu/stud_overans.php#1
Group Projects
EDUCAUSE. (2010). 7 things you should know about assessing online team-based learning. [PDF] Retrieved from http://net.educause.edu/ir/library/pdf/ELI7063.pdf
Morrison, D. (2012, March 27). Strategies for Effective Group Work in the Online Class. [Blog post] Retrieved from http://onlinelearninginsights.wordpress.com/2012/03/27/strategies-for-effective-group-work-in-the-online-class/
Morrison, D. (2012, March 30). Making Peer Evaluations Work in Online Learning. [Blog post] Retrieved from http://onlinelearninginsights.wordpress.com/2012/03/30/making-peer-evaluations-work-in-online-learning/
Murray, D. (n.d.). Student peer evaluation. [File] Retrieved from http://mgt.buffalo.edu/departments/mss/djmurray/mgs351/PeerEval.doc
Performance (Authentic) Assessment
Kateroo3D. (2011, August 3). Authentic assessment. [Video file] Retrieved from https://www.youtube.com/watch?v=c_gibuFZXZw
Mueller, J. (2012b). How do you create authentic assessments? Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/howdoyoudoit.htm
Mueller, J. (2012c). What is an authentic assessment? Retrieved from http://jfmueller.faculty.noctrl.edu/toolbox/whatisit.htm
Selected Response Tests
Florida Center for Instructional Technology (n.d.) Writing selected response assessment items. Retrieved from http://fcit.usf.edu/assessment/selected/responseb.html
Shank, P. (2009). Creating better multiple-choice tests for online courses. Retrieved from http://www.facultyfocus.com/articles/educational-assessment/creating-better-multiple-choice-tests-for-online-courses
University of Illinois at Urbana-Champaign. (2009). Improving your test questions. Retrieved from http://cte.illinois.edu/testing/exam/test_ques.htm
University of Texas. (2011). Activity: Good/poor multiple-choice questions. Retrieved from http://www.utexas.edu/academic/ctl/assessment/iar/students/plan/method/exams-mchoice-examples.php
Self-Assessments
chulze, A., & Keefe, A. (2005). Effectively using self assessments in online learning. [PDF] Retrieved from http://www.uwex.edu/disted/conference/Resource_library/proceedings/02_68.pdf
Supporting Self-, Peer-, and Collaborative-Assessment in E-Learning – An article by Gouli, Gogoulou, and Grigoriadou
Synchronous Discussions (Blackboard Collaborate / Google Hangouts)
Bodrero, R. (2012, July 23). Google+Hangouts in online education: A capable, low cost solution. Learning Solutions Magazine. Retrieved from http://www.learningsolutionsmag.com/articles/972/google-hangouts-in-online-education-a-capable-low-cost-solution
EDUCAUSE. (2007). 7 things you should know about Skype. [PDF] Retrieved from http://net.educause.edu/ir/library/pdf/ELI7032.pdf
Google. (2011a). Google Hangout. Retrieved from http://www.google.com/+/learnmore/hangouts/
Google. (2011b). Google Sites. Retrieved from http://www.google.com/sites/help/intl/en/overview.html
Hertz, M. B. (2013, February 1). How educators and schools can make the most of Google Hangouts. [Blog post] Retrieved from http://www.edutopia.org/blog/educators-schools-google-hangouts-mary-beth-hertz
Neary, D. (2012). Blackboard Collaborate. Retrieved from http://teamswedishchef.wikispaces.com/Blackboard+Collaborate
San Francisco State University Academic Technology. (n.d). Assessing performance using Blackboard Collaborate. Retrieved from http://at.sfsu.edu/strategies/assessing-performance-using-blackboard-collaborate
Team Sprocket Assessment Tool Box. (2012). Peer to peer collaboration tool: Google + Hangout. Retrieved from https://sites.google.com/site/teamsprocketassessmenttoolbox/home/introduction/quiz-test-maker-tool-classmarker/reflection-tool-live-journal/peer-to-peer-collaboration-tool-google-hangouts
Wikis
Common Craft. (2013). Wikis in plain English. [Video File] Retrieved from http://www.commoncraft.com/video/wikis
EDUCAUSE. (2005). 7 things you should know about wikis. [PDF] Retrieved from http://net.educause.edu/ir/library/pdf/ELI7004.pdf
Wikimedia Foundation. (2012). Wikiversity: Main page. Retrieved from http://en.wikiversity.org/wiki/Main_Page
Why wikis? Student perceptions of using wikis in online coursework, by Deters, Cuthrell, and Stapleton, provides good background and food for thought in the literature review, and then shares results of a study. Make sure to see the table of questions that can help curb limitations of using wikis.
Writing Assignments
Boise State University Writing Center. (2013). Writing Center handouts\exercises. Retrieved from http://writingcenter.boisestate.edu/resources/
Essid, J. (2006). Writing across the curriculum. Retrieved from http://writing2.richmond.edu/wac/binder/
Harvard University. (2013). Harvard Writing Project. Retrieved from http://writingproject.fas.harvard.edu/pages/writing-guides
Keith, M., Black, J., Cox, S., & Heney, J. (2010). [PDF] Strategies and tips for effective writing assignments in online classes.