Wednesday, November 27, 2024

Low-Stakes Assignments for Grading


Did you ever have a dream where you were back in school, you enter a class, and you realize you have a final exam on a topic that you have no idea what it is?  The pressure of exams is so great that it unconsciously affects us decades later.  In fact, high-stakes assignments and testing have been linking to increasing suicidal ideations (Wang, 2016), and higher suicide rates (Kapur, 2021; Singer, 2017). They have been connected to undermining educational goals, perpetrating inequalities, crating unequitable learning environments, and encouraging cheating both from students and educational actors, such as teachers, administrators, and even state officials (Nicols & Berliner, 2007). So then, why do we use high-stakes testing and assignments?  Tradition?

 

Low-stakes assignments when taken individually do not significantly impact a students’ grades. Their purpose is primarily to provide students with a performance indicator.  Students can then reflect on the areas in need of improvement and how to improve. The low-stakes assignment also provides assistive scaffolding by providing regular formative feedback that is frequent and timely (Kuh, Kinzie, Schuh, & Whitt, 2010). They work best when providing formative feedback, starting and continuing throughout the course.

 

Benefits of Low-Stakes Assignments

A few of the benefits of low-stakes assignments include:

  • They provide feedback for instructors about how successful students are learning. This can be particularly effective in environments where it is hard to pick up on subtle clues of students struggling, such as in online or hybrid classes.
  • Allowing instructors to direct students to resources if they need further assistance or support
  • Early feedback opens up communication between students and their instructors, possibly increasing their likeliness to seek help when needed
  • Allowing students to be active participants in the evaluation of their own learning
  • Encouraging students and increasing the likelihood of their engagement and attendance

Many of these will rise your retention rates and help students succeed.

 

Examples of Low-Stakes Assignments

But what would a low-stakes assignment look like? Some examples of low-stakes assignments include:

  •  Self-tests. (ungraded or low-points). These can even be automated with online testing so that it does not take any time in the classroom.  These can also be anonymized to give students comfort. Self-tests are particularly effective when combined with having…
  • Multiple attempts (on questions or whole exam). This feature reduces test-anxiety and allows students to learn from their errors.  When feedback is given for each question, you will notice the best results. The knowledge of that they can take the exam another time also reduces the pressure to cheat (Wehlburg, 2021).
  • Discussion/Collaboration: Students sharing their writing or thoughts with others and get feedback will assist their learning and meeting learning outcomes
  • Multiple submissions of a paper. Feedback from a first submission with time to reflect and rewrite their paper allows students to hone their writing skills.  
  • Reflective journaling. Writing self-reflective content both increases one’s meta-cognitive skills used for learning as well as better develops writing skills.  An added perk is that AI tools have a hard time replicating this type of writing as well.
  •  A Threaded Assignment i.e., breaking down the assignment into several parts.  Individually, the grades or low, but collaboratively the project aggregates to a large assignment, such as a term paper. This technique often proves the scaffolds that help disenfranchised, or otherwise struggling, students succeed. A sample of deconstructing a large assignment into components would be making a thesis paper into the following smaller assignments:

    • Thesis/Abstract
    • Outline
    • Annotated bibliography
    •  1st draft
    • Final draft

These are just a few examples; however, they offer an excellent opportunity for both you and your students to get needed feedback to help improve your course’s student success rate. These also help develop a grading system that can clearly show the steps necessary for mastering the meeting the learning outcomes of the course. 


References

Bayraktar, B (2021) Tip: Many Low Stakes Assignments. Tips for Teaching Professors, Apr 6.

Drabick D. A. G., Weisberg R., Paul L., Bubier J. L. (2007). Keeping it short and sweet: Brief, ungraded writing assignments facilitate learning. Teaching of Psychology, 34, 172–176.

Greenhalgh, S. (2016) The Hidden Cost of Asia’s High Test Scores. The Diplomat. Dec 9

Hale, M. (2018) Thwarting Plagiarism in the Humanities Classroom: Storyboards, Scaffolding, and a Death Fair. Journal of the Scholarship of Teaching and Learning, v18 n4 p86-110 Dec.

Kapur, M (2021) Student suicides put a spotlight on high-pressure exams during India’s pandemic. Quartz. Sept 17.

Kuh, G. D., Kinzie, J., Schuh, J.S., and Whitt, E.J. (2010). Student success in college: Creating conditions that matter. San Francisco, CA: Jossey-Bass.

Nicols, S. and D. Berliner (2007) Collateral Damage: how High-States Testing Corrupts America’s Schools. Harvard Education Press, Cambridge, MA.

Mintz, S (2023) 10 Ways to Prevent Cheating. Inside Higher Ed. February 16.

Singer, S (2017) Middle School Suicides Double as Common Core Testing Intensifies. Huffington Post. Aug 2.

Wang, Liang. (2016). The effect of high-stakes testing on suicidal ideation of teenagers with reference-dependent preferences. Journal of Population Economics. 29.

Warnock, Scott. (2013). Frequent, low-stakes grading: Assessment for communication, confidence. Faculty Focus. Madison, WI: Magna Publications. 

Wehlburg, K (2021) Assessment design that supports authentic learning (and discourages cheating) Times Higher Education. Nov 24.

Tuesday, May 21, 2024

Using Intelligent Agents and Gamification for Professional Development

 

Most every college online learning department in the US sparsely staffed given the tasks they is expected of them. While faculty are experts in their field of study, instructional design is separate field and it cannot be assumed that all faculty have this training.  This knowledge is critical for the professional development of the faculty and directly affects the accessibility of online course content as well as adopting best practices in teaching and learning, such as regularly reviewing online courses quality.  This become an added burden for understaffed department. Nevertheless, these are necessary are for meeting Middle States Accreditation (Standard III, section 4). 

To make this task tractable, a school using a LMS such as Brightspace, can create a non-termed ‘course’ where faculty can both learn what it is like to be a student in the system and participate in a self-paced training to improve the understanding of necessary topics.  By creating a communal professional development space, faculty can autonomous select topics to improve and break down silo’s with strategic online forums. The shared space can also act as repository of tools and OER content that faculty can easily access.

 In the case of SUNY Schenectady, a 5 module self-paced course allowed faculty to select between modules the content they wanted to first focus on.  In order to progress, certain requirements were necessary to advance further in the course.  This allowed modules to provide scaffolded activities.  The modules also provided a quantifiable space that required about the same about of effort to complete while each module illustrated Universal Design for Learning principles in an attempt to teach by example.

The true challenge to professional development is getting faculty to participate in the training.  To do this we had three incentives:

  1. Learning outcomes for each module included building assets that the faculty could use in their courses.  Often these assets employed strategies that would increase student engagement and reduce faculty effort. 
  2. Gamified modules offered badges for completing sections.   By design it encouraged or lead learners to produce more or complete the course
  3. Certificates – were set up through an automated system (Awards).  Faculty would received personalized and dated certificates for not only completing the courses, but for completing each module.   This would allow for learners to use their work in each module to generate measured evidence (a certificate).  These illustrate a quantifiable amount of work  and the learners can share the certificates with their supervisors as evidence of the professional development in the annual review. For those without Adobe PDF Pro, a generic certificate can also work,



Automated Enrollment

Using Intelligent Agents in Brightspace, the system can identify all those with a specific roll, such as Faculty, and enroll them into a class.  With a little forethought, the school can enroll all employees in a “Staff” role that can be upgraded to “Faculty” if they teach.  This will allow all members of school to have access to the training area to promote topics with ubiquitous applications, such as “Accessibility”.  With the two roles, an Intelligent Agent can easily enroll all those working at the campus.   Naturally, this can be expanded with new modules and even become a single place for the school’s professional development


Wednesday, March 20, 2024

Principle of Engagement - Guideline 3 - Criterion 3

 

Universal Design for Learning

Principle of Engagement - Guideline 3 - Criterion 3

When developing a course using the third principle of Universal Design for Learning, there are three specific guidelines to assist us.  The third, Self-Regulation addresses maintaining focus and determination.

Criterion 3 of this guideline advocates that we develop self-assessment and reflection

Learners need to monitor their emotions and reactions accurately in order to develop their ability at self-regulation. The propensity and capacity for metacognition will vary greatly among learners.  As an instructor you should not be surprised to have students who may require considerable amounts of explicit instruction and modeling before they can self-assess effectively.  For some, merely recognizing that they are making progress can be highly motivating.  However, others may need more.  The inability to recognize one’s own progress can be a key demotivating factor.  Having multiple models and scaffolds of a variety of self-assessment techniques is important so learners can select the ones that will work best for themselves. This will increase learners’ awareness of their progress and how they may learn from their mistakes. The latter is critical, as recognizing errors as educational opportunities is critical for accelerating growth and success.  

Some strategies to meet this criterion include:

    • Providing tools to chart or display data that marks improvement to assist learners to modify strategies that will aid in this success
    • Providing ample activities that offer timely feedback that better frames the learners' progress
    • Developing assignments that supply feedback and allow learners to reflect on the feedback and adapt new strategies based on their reflection.
    • Supplying a developed gradebook, or center, where learners can view their progress relative to the course and have access to detailed feedback.  (When using any learning management system, such as Blackboard or Moodle, this is relatively easy because the feedback areas are already linked to the grade center)

By following these suggestions, your course will assist students in communicating and expressing their knowledge, as well as being in line with the Principle of Engagement in the Theory of Universal Design for Learning.

Wednesday, February 14, 2024

Principle of Engagement - Guideline 3 - Criterion 2

 

Universal Design for Learning

Principle of Engagement - Guideline 3 - Criterion 2

When developing a course using the third principle of Universal Design for Learning, there are three specific guidelines to assist us.  The third, Self-Regulation addresses maintaining focus and determination.

Criterion 2 of this guideline advocates that we facilitate personal coping skills and strategies.

Most learners will require more than just a model of self-regulatory skills. Scaffolding and sustained apprenticeships, possibly with mentors, contribute to the development of these strategies. Employing reminders, checklists, and process models can assist learners in adopting an adaptive strategy for managing their response to external events, such as social settings that may produce anxiety. This also applies to responses to internal events, such as for decreasing depression from facing the workload.
 
These strategies should offer flexible options to account for the individual variation in learners and accommodate the differences that variation brings. With these strategies, learners will be able to manage healthy responses to the stress of learning and possible setbacks, and eventually overcome these setbacks.

When addressing this, consider developing or providing scaffolds and feedback for:

    • Managing frustration in not meeting goals or succeeding in tasks
    • Seeking external support (does your campus have external services or could you embed them into your learning environment?)
    • Developing coping controls to stress and setbacks
    • Implementing exemplars to demonstrate effective coping skills
    • Dispelling antiquated tropes about aptitude instead of viewing learning as improving (For example adopting the mindset of “How do I get better at Statistics?” instead of “I am not good at math”)

By following these suggestions, your course will assist students in communicating and expressing their knowledge, as well as being in line with the Principle of Engagement in the Theory of Universal Design for Learning.

Monday, January 8, 2024

Accessibility Checkers

Creating accessible content is easier now than ever before.  While there are several rules to learn and standards are regularly changing, such as WCAG standards, creating accessible content does not require a specialist. There are plenty of tools to assist you.  Most applications have accessibility checkers build right in.   These make producing accessible content easy.

We commonly make spell checking or grammar checking part of the process in creating a document.  Now it is time to include accessibility checking. 
 

You may notice that with so many accessibility checkers, sometimes they may differ in their analysis. Why should we pay attention to them?  Remember that accessibility standards are changing – they are evolving and regularly improving.  Algorithms can vary between programs and are trying to keep up.  The best course of action is to rely on any and all tools at your disposal.  This way you can work at having the most accessible content as possible.

Schools that take accessibility seriously should have at least three accessibility checkers at your disposal.

Available Accessibility Checkers

MS Word (or MS Office Apps)


Depending on the version, the accessibility checker can be in different locations.  It is most commonly on the “review ribbon”, but earlier versions have it under File.  Be sure to use it whenever you create a word document.

Accessibility Checker in MS Word

 
 

Ally

Those gauges next to content indicate the accessibility rating.  
Ally Guage


Be sure to click on it and see why it is not dark green (or 100% accessible).  Ally will often direct you on how to improve your content.

Accessibility checker in the LSM HTML Editor

For example:
 Brightspace provide an accessibly checker in their HTML editor in the tools ribbon. The icon looks like an eye with a checkmark next to it. Naturally, if you hover the mouse over the tool buttons, you will see their names pop up. If you select the icon, it will scan the page, identify any issues, and offer advice.

Accessibility Checker in Brightspace

It is important get acquainted with the accessibility checkers and incorporate it in your content creation routine.  It does not take much time to ensure that the content you create is accessible. In fact, the more you use the checkers, you will notice that you will be unconsciously adopting accessible practices when you produce content. This is a skill that will help you and others.


Wednesday, December 20, 2023

Principle of Engagement - Guideline 3 - Criterion 1

 

Universal Design for Learning

Principle of Engagement - Guideline 3 - Criterion 1

When developing a course using the third principle of Universal Design for Learning, there are three specific guidelines to assist us.  The third, Self-Regulation addresses maintaining focus and determination.

Criterion 1 of this guideline advocates that we promote expectations and attitudes that optimize motivation.

Everyone has intimate knowledge of what they find personally motivating and this is an important aspect to self-regulation.  Learners need to be able to set personal goals that they can reasonably obtain, as well as foster positive beliefs that they will be able to meet their goals.  Successfully accommodating this will require allowing for ways that learners can curtail frustration and eschew anxiety that many face while striving to meet their goals.  This will require multiple options for learners to help stay motivated.

To do this, you may consider:

    • Providing guides, rubrics, prompts, and checklists to encourage increasing the length of on task orientation and elevating the frequency of self-reflection and self-reinforcements
       
    • Create activities that support self-reflection and identifying, and assessing, personal goals

    • Explicitly and implicitly promote the use of coaches, mentors, and tutors that help inculcate skills in goals setting that successfully account for both strengths and weaknesses.
       
    • Encourage external success coaching and tutors for additional help, and promote the development of these services if your institution does not have them.

By following these suggestions, your course will assist students in communicating and expressing their knowledge, as well as being in line with the Principle of Engagement in the Theory of Universal Design for Learning.

Wednesday, November 22, 2023

Page Titles and Language Sets in Brightspace

The Problem

You have been working on ensuring your course has a perfect Ally Accessibility score and to your surprise you see a page that has an issue.  It reads:

  • 96%: This HTML file does not have a language set.

If you explore the issues, you may notice that the page is also missing a title.  Both are critical for accessibility.  To your dismay, Ally states, “Guidance is not available yet”.

Screen Shot of Edit HTML option
Figure 1

Guidance is Here

Luckily, we do not have to rely on Ally to solve this problem and you do not need to be an experienced HTML programmer either.  Any faculty can resolve this issue in the Brightspace editor.  You simply need to follow these steps:

  1. Select Edit HTML to the page in question to open the editor. (See Figure 1)
  2.  On the toolbar select the drop down from the Other Insert Options icon – it has a + sign on the button (See Figure 2)
  3.  Select the Attributes option.
  4. Select the “Page Attributes” Tab (See figure 3)
  5. Give the page a meaningful title (if it doesn’t already have one)
  6. Set the language set – “en’ for English (This is so much easier than adding <html lang="en"> to in the html code.)
  7. Select Create.
  8. Select the blue “Save and Close.”

That was it.  

Figure 2: Steps 2 and 3 in selecting other options

Figure 2

You didn’t have to open the source code and drop in the appropriate code ( <html lang="en"> for the English language set).  Instead, you can quickly fix any problematic pages with these issues and ensure your content passes WCAG accessibility standards. 

Figure 3 - Steps 4-7 how to add the title and language set

Figure 3

Now that you know this, you can have perfect pages.

Wednesday, November 15, 2023

Principle of Engagement - Guideline 3 - Self-Regulation

 

Universal Design for Learning

Principle of Engagement - Guideline 3 - Self-Regulation

The third principle of UDL, "provide multiple means of engagement”, helps promote an inclusive learning environment on many levels.  When developing a course and focusing on this principle, there are three guidelines to follow.  They are:

  1.  Recruiting Interest
  2. Sustaining Effort and Persistence
  3. Self-Regulation

We are now going to take a deeper look.

Self-Regulation is the ability to regulate emotions and motivations necessary to succeed at a task, such as learning. Naturally, developing and mastering this ability is important for all learners. While a learning environment can increase engagement by recruiting interest and sustaining effort and persistence, the ability to self-regulate, or to control one’s emotions and motivations so as to effectively cope and engage with the environment, is critical for learners’ success, both in and outside of the learning environment.


Many learners have developed these skills in primary school, however, there are still adult learners who struggle developing these skills. This is partially true due to most classrooms not explicitly addressing these skills and marginalized students finding this skill set inaccessible or imperceptible within an implicit curriculum. Regardless of the cause, designing a course to promote this skill, through prompts and modeling, helps level the field for everyone.


This approach provides alternatives to support learners with different aptitudes and prior experience to effectively manage their own engagement and affect. When adopting this approach, consider the following criteria:

  1. Promote expectations and attitudes that optimize motivation
  2. Facilitate personal coping skills and strategies. These strategies should offer flexible options to account for the individual variation
  3.  Develop self-assessment and reflection. Learners need to monitor their emotions and reactions accurately in order to develop their ability at self-regulation


By promoting an inclusive strategy with multiple ways of promoting self—regulation, your courses will be more develop skills that will promote student success in the course and in life.

Wednesday, October 11, 2023

Principle of Engagement - Guideline 2 - Criterion 4

 

Universal Design for Learning

Principle of Engagement - Guideline 2 - Criterion 4

When developing a course using the third principle of Universal Design for Learning, there are three specific guidelines to assist us. The second, Sustaining Effort and Persistence addresses maintaining focus and determination.

Criterion 4 of this guideline advocates that we increase mastery-orientated feedback.

Feedback is critical for successful learning and is the fourth principle of Chickering and Gamson’s seven principles for good practice in undergraduate education.  When the feedback is relevant, accessible, constructive, and timely, the feedback is both more productive and critical for sustaining motivation and effort crucial for learning.

Mastery-oriented feedback guides learners towards master rather than a narrow and fixed view of performance and compliance.  It focuses on top tier learning in Blooms taxonomy while emphasizing the learners’ effort and practice as important factors for successful long-term habits and learning practices. This empowers learners with a sense of agency and treats learning as improving a skill, instead of a fixed target.  The latter notion often adopts the notion that some students, particularly those with disabilities, may be constrained from meeting these fixed goals, and thus impedes motivation to persist.

When trying to meet this criterion, consider:

    • View learning as improving, and focus on effort, improvement, and achieving a standard. 
    • Supplying feedback that promotes perseverance, the development of self-awareness, and encourages the use of strategies that will assist learning when they face challenges.
    • Providing timely feedback
    • Offering frequent and specific feedback
    • Adopting strategies or models that will ensure that the feedback will be more substantive and informative, instead of comparative or competitive.
    • Within your feedback, include how learners can incorporate the feedback to help identify patterns that promote errors so that they can self-correct in the future. 
    • The feedback should also include positive strategies for further success. 

By following these suggestions, your course will assist students in communicating and expressing their knowledge, as well as being in line with the Principle of Engagement in the Theory of Universal Design for Learning.

References

Chickering, A & Z Gamson (1987) Seven Principles for Good Practice in Undergraduate Education. American Association for Higher Education, p 2-6.

Wednesday, September 13, 2023

Principle of Engagement - Guideline 2 - Criterion 3

 

Universal Design for Learning

Principle of Engagement - Guideline 2 - Criterion 3

When developing a course using the third principle of Universal Design for Learning, there are three specific guidelines to assist us. The second, Sustaining Effort and Persistence addresses maintaining focus and determination.

Criterion 3 of this guideline advocates that we promote Collaboration and Foster a Community

Communication and collaboration are key skills for students that will both benefit them in school environments and their professional careers.  These skills may be only tertiary among the goals of the course, but those are indeed goals for all learners. Like other skills, there will be a variety in their competence in the class. Nonetheless, mentoring through peers can increase one-on-one support that will benefit both the mentee and the mentor.  Crafting collaborative exercises offers an excellent opportunity for leaner growth, and the development of both collaborative and communication skills.

Be sure to structure activities to significantly increase the support for sustained engagement. Provide flexible groupings to better multiple and differentiated roles. It will also provide opportunities to learn how to work effectively with others – a vital skill in or out of the classroom. Learners can select the level most suited for themselves when options are available in how they can build and utilize these skills.

When crafting activities, consider:

  • Supplying prompts that assist learners in understanding when and how to ask for help from either peers or the instructor.
  • Creating cooperative learning groups with clearly defined:
    • goals,
    • roles, and
    • responsibilities
  • Encouraging peer interaction and support opportunities, such as peer tutors
  • Helping develop a community of learning that engage participants with common interests
  • Setting expectations for group work through various channels, such as grading rubrics and explicit objectives

By following these suggestions, your course will assist students in communicating and expressing their knowledge, as well as being in line with the Principle of Engagement in the Theory of Universal Design for Learning.

Wednesday, August 16, 2023

Principle of Engagement - Guideline 2 - Criterion 2

 

Universal Design for Learning

Principle of Engagement - Guideline 2 - Criterion 2

When developing a course using the third principle of Universal Design for Learning, there are three specific guidelines to assist us. The second, Sustaining Effort and Persistence addresses maintaining focus and determination.

Criterion 2 of this guideline advocates that we optimize the challenge by varying demands and resources

The kinds of challenges that motivate learners to do their best vary, just like their skills and abilities.  Because of the variances between learners, we should expect that not all will be motivated or challenged in the same way. When varying the challenges, it is important to offer a flexible range of appropriate resources necessary for learners to succeed in the challenge.  This will allow all learners to find challenges that are motivating. When doing this, it is vital to balance the resources available to meet each challenge. 

You should consider:

  1. Providing a choice of alternative tools available to learners
  2. Varying the range of acceptable performance per challenge
  3. Offering differing degrees of complexity within core activities
  4. Emphasize development, individual improvement and effort as standards (as these are self-motivating) instead of external evaluation or competition (which can be discouraging for some who struggle).

 By following these suggestions, your course will assist students in communicating and expressing their knowledge, as well as being in line with the Principle of Engagement in the Theory of Universal Design for Learning.

Low-Stakes Assignments for Grading

Did you ever have a dream where you were back in school, you enter a class, and you realize you have a final exam on a topic that you have ...