Assessment Strategies

Generative AI tools excel at explaining common concepts at lower order thinking while lacking specificity to help produce analyses requiring higher order thinking skills. To develop higher order thinking skills in students, follow Bloom’s Taxonomy framework, which comprises six levels of thinking: Remembering, Understanding, Applying, Analyzing, Evaluating, and Creating. Generally, Analyzing, Evaluating, and Creating are considered higher order thinking.

When designing assessments, focus on encouraging students to use higher ordering skills such as finding innovative solutions (rather than relying on standard answers) and explaining their thought processes (instead of simply providing results).

Example: Higher order thinking skill assessment question (Analyzing and Evaluating): Which of the following plays the most significant role in this scenario: coercion, authority, force, or influence? How would it look different if another base of power was used in this scenario? (Analyzing and Evaluating)

Generative AI tools can sometimes provide misleading and/or false information. Use tools to help students learn how to evaluate the accuracy and validity of generative AI tool responses.  Work with your academic liaison or informationist to provide training on information literacy skills.

Encourage students to work together to solve problems, share ideas, and complete projects.

Encourage students to apply concepts and theories to personal experiences or real-world scenarios and develop their own solutions.

Provide students with opportunities to showcase their talents and abilities in different ways, leading to a more well-rounded and comprehensive assessment strategy. Consider oral, video, multimedia, web pages/portfolios, and interactive assignments.

Encourage students to elaborate or reflect on the key concepts and ideas from readings and knowledge points or discussion threads from the lecture and class.

By emphasizing the process, educators can encourage students to think critically and engage more deeply with the material. This can help reduce the potential for cheating, as it requires students to demonstrate their understanding of the material in their own words and through their own thought processes.

Students can make use of tools such as Google Docs or Microsoft OneDrive to do their writing.

The version history will show whether text was created in the document or copied and pasted. If this strategy is used, educators should foster transparency by making students informed of their expectations.

Throughout the process, provide students with formative feedback and guidance. Alternatively, have student peers write collaboratively, as the social context of collaboration makes it difficult for generative AI tools. Explore how a generative AI tool responds to the assignment prompt: Compare and contrast the results the tool generates with the desired answers and make adjustments or improvements as needed. Develop assessment on current events that are not included in the AI training dataset.

Students can reflect on their writing process, peer performance on group work, or what they have learned from the content.

Design assessments specifically for generative AI tools and guide using generative AI tools to complete specific tasks.

Example: Use DALL∙E 2 to generate digital art that depicts the relation among coercion, authority, force, and influence and then explain why this art was created and how it can be improved.

Provide assessment questions together with AI-generated solutions and ask students to evaluate the solutions and supply alternatives.

• Use ChatGPT as a way for students to evaluate the validity or accuracy of a text written by a generative AI tool. See How to Use Generative AI Tools to Design Engaging Course Activities.
• Have students engage in a conversation with a generative AI tool such as ChatGPT as part of their preparation for an assignment. Ask students to annotate the transcript of their conversation and note how they were helped by the tool. Have them reflect on what they learned in the process.

Encourage students to use generative AI tools to provide feedback on their initial assignments and improve their assignments based on the feedback.

If students are having difficulty finding a topic for a specific theme, have them use ChatGPT to help brainstorm ideas. Suggest that they ask the same question with minor tweaks or ask the tool to elaborate on an idea.

AI-powered tools can provide automated feedback on assignments, allowing educators to give quick feedback. Specific tools include the following:

• Gradescope: This tool uses AI to grade certain types of questions, such as multiple-choice, fill-in-the-blank, short answer, or even coding documents, and it provides students with detailed feedback.
• Grammarly: This tool uses AI to provide feedback on written assignments, including grammar and spelling errors, as well as suggestions for improving writing style and structure.

Generative AI tools can be used to provide feedback based on specific criteria or learning objectives. Specific tools include the following:

• Feedback Studio rubric: This tool uses AI to help educators create rubrics for grading assignments. It can also analyze student work against the rubric and provide feedback based on the criteria.
• WriQ: This tool provides feedback on written assignments based on specific criteria, such as grammar and spelling errors, word choice, and sentence structure. It can also provide feedback on student progress over time.

Generative AI tools can analyze the content of an assignment to provide feedback on the quality of writing, depth of research, and coherence of arguments presented. Specific tools include the following:

• ChatGPT
  • This tool could analyze students’ essays to identify whether students included relevant sources to support their argument or whether their writing is clear and concise.
    Note: You must consider FERPA guidelines before submitting student work and ensure no identifiable information is included.
  • If provided with enough information about assignment expectations, the tool could assess the strengths or weaknesses of a student’s argument or analysis.
  • For class discussions, the educator could copy and paste the students’ posts into ChatGPT and ask it to summarize the key points of the discussion.