This page is a reference guide only. Use it to identify who should grade each output, review the steps for evaluating a submission, and access the answer key. All scoring and feedback must be submitted through Canvas by EOD Wednesday following the Sunday deadline for ILs. If you have any questions about how to score an output, reach out to your technical lead (Kaitlyn Van Gorkom) on Slack!
Grading Guide Fields
Begin by reviewing your curriculum’s grading guide to identify who should grade each output, review the steps for evaluating a submission, and access the answer key.
Open this toggle to see an explanation of the fields included in the Grading Guide!
Title- The name of the assignment in Canvas.
Week- When the assignment was included in Canvas.
Canvas Assign To- Outputs will be assigned and differentiated by role and familiarity with curriculum. You are only responsible for reviewing the outputs of the roles present in your cohort. They may be assigned by:- Experience w/ Curriculum
- New Curriculum ILs: All new IAs, new instructors, and any returners who have never taught the curriculum as an instructor or IA in the past.
- Same Curriculum ILs: Any returning ILs that have taught the curriculum as an instructor or IA
- Role
- New IA
- New Instructor
- Returning Instructor
- Returning IA
Submission Type- The type of output you can expect to review.- Text Entry (HireFlix): Review the video using the HireFlix link in Airtable and read the IL’s reflection in Canvas.
- Text Entry: Review the written output directly in Canvas.
- Website URL: Review the IL’s code or work by following the link they submitted in Canvas.
- Media Recordings: Review the IL’s video directly in Canvas.
- File Uploads: Review the file uploaded by the IL in Canvas.
- Discussion: Review the IL’s contribution to the discussion using SpeedGrader in Canvas.
Grader- The reviewer is the person responsible for reviewing the output. In most instances, this will be you, Senior Instructors, but at some times may be assigned to the KWK team.
Answer Key- An exemplar or answer key to guide your evaluation of the IL’s output.
How to Review- A step-by-step suggestion of how to review the output.
Training Content Development
Instructors Only
Title
Week
Canvas Assign To
Submission Type
Grader
Answer Key
How To Review
Week 1 (March 23 - March 29)
Everyone
Discussion
Senior Instructor
For New Curriculum ILs:
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
Week 1 (March 23 - March 29)
New Curriculum
Website URL
KWK Team
1. Review the answer key.
2. Compare with the IL’s work.
3. Score their output in Canvas using the attached rubric.
4. Write 1-2 sentences of feedback for the IL.
2. Compare with the IL’s work.
3. Score their output in Canvas using the attached rubric.
4. Write 1-2 sentences of feedback for the IL.
Week 1 (March 23 - March 29)
Same Curriculum
Media Recordings
Senior Instructor
1. Review the answer key.
2. Watch the IL’s video.
3. Score their output in Canvas using the attached rubric.
4. Write 1-2 sentences of feedback for the IL.
2. Watch the IL’s video.
3. Score their output in Canvas using the attached rubric.
4. Write 1-2 sentences of feedback for the IL.
Week 1 (March 23 - March 29)
Everyone
Text Entry (HireFlix)
Senior Instructor
1. Review the answer key.
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL (consider recording video feedback for the IL to see)!
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL (consider recording video feedback for the IL to see)!
Week 2 (March 30 - April 5)
New Curriculum
Website URL
KWK Team
1. Review the answer key.
2. Compare with the IL’s work.
3. Read the IL’s query explanation in the Canvas comments.
4. Score their output in Canvas using the attached rubric.
5. Write 1-2 sentences of feedback for the IL.
2. Compare with the IL’s work.
3. Read the IL’s query explanation in the Canvas comments.
4. Score their output in Canvas using the attached rubric.
5. Write 1-2 sentences of feedback for the IL.
Week 2 (March 30 - April 5)
Same Curriculum
Media Recordings
Senior Instructor
1. Review the answer key.
2. Compare with the IL’s work.
3. Watch the IL’s video.
4. Score their output in Canvas using the attached rubric.
5. Write 1-2 sentences of feedback for the IL.
2. Compare with the IL’s work.
3. Watch the IL’s video.
4. Score their output in Canvas using the attached rubric.
5. Write 1-2 sentences of feedback for the IL.
Week 2 (March 30 - April 5)
Everyone
Discussion
Senior Instructor
For New Curriculum ILs:
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
Week 2 (March 30 - April 5)
Everyone
Text Entry (HireFlix)
Senior Instructor
1. Review the answer key.
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL (consider recording video feedback for the IL to see)!
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL (consider recording video feedback for the IL to see)!
Week 3 (April 6 - April 12)
Everyone
Discussion
Senior Instructor
For New Curriculum ILs:
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
Week 3 (April 6 - April 12)
New Curriculum
Text Entry
KWK Team
1. Read the IL’s reflection in Canvas.
2. Check for specific examples.
3. Identify the successful prompt and explanation.
4. Evaluate the response to the AI-reliant scholar.
5. Confirm the reflection meets the 100-200 word count.
6. Score the submission in Canvas.
7. Write 1-2 sentences of feedback.
2. Check for specific examples.
3. Identify the successful prompt and explanation.
4. Evaluate the response to the AI-reliant scholar.
5. Confirm the reflection meets the 100-200 word count.
6. Score the submission in Canvas.
7. Write 1-2 sentences of feedback.
Week 3 (April 6 - April 12)
Everyone
Text Entry (HireFlix)
Text Entry
Senior Instructor
1. Review the answer key.
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL.
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL.
Week 3 (April 6 - April 12)
Everyone
Media Recordings
Senior Instructor
1. Review the Lesson 8 design principles.
2. Watch the IL’s video (5-7 minutes).
3. Verify explicit connections 2 design principles.
4. Assess the depth of analysis.
5. Check that the language/tone is scholar-friendly.
6. Score the submission in Canvas using the rubric.
7. Write 1–2 sentences of feedback.
2. Watch the IL’s video (5-7 minutes).
3. Verify explicit connections 2 design principles.
4. Assess the depth of analysis.
5. Check that the language/tone is scholar-friendly.
6. Score the submission in Canvas using the rubric.
7. Write 1–2 sentences of feedback.
Week 4 (April 13 - April 19)
Everyone
Discussion
KWK Team
For New Curriculum ILs:
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
1. Review the answer key.
2. Compare with the New Curriculum IL’s work.
3. Score their output in Canvas using the attached rubric.
For Same Curriculum ILs:
1. Review the Same Curriculum IL’s feedback.
2. Compare their feedback with your own observations.
3. Score their feedback in Canvas using the attached rubric.
Week 4 (April 13 - April 19)
Everyone
Text Entry (HireFlix)
Senior Instructor
1. Review the answer key.
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL.
2. Watch the IL’s HireFlix video (access the link from airtable).
3. Read their Canvas reflection.
4. Score their output in Canvas using the attached rubric.
5. Provide feedback for the IL.
Week 4 (April 13 - April 19)
New Curriculum
Website URL
Senior Instructor
1. Review the answer key & open the IL’s link.
2. Confirm name standardization.
3. Check that enrollment dates are standardized.
4. Verify fee paid status values are consistent categories.
5. Check for an attempted
6. Confirm that calculated fields produce expected results.
7. Score the submission in Canvas using the rubric.
8. Write 1-2 sentences of feedback.
2. Confirm name standardization.
3. Check that enrollment dates are standardized.
4. Verify fee paid status values are consistent categories.
5. Check for an attempted
ActivityLevel calculated field.6. Confirm that calculated fields produce expected results.
7. Score the submission in Canvas using the rubric.
8. Write 1-2 sentences of feedback.
Week 4 (April 13 - April 19)
Same Curriculum
Media Recordings
KWK Team
1. Watch an IL teaching this lesson if you need a refresher.
2. Watch the IL's code-along video (5-7 minutes).
3. Confirm calculated fields are correct.
4. Check that the IL explains WHY they do what they do.
5. Count at least 3 CFUs targeting common misconceptions.
6. Evaluate tone, pacing, and teaching presence.
7. Score the submission in Canvas using the rubric.
8. Write 1-2 sentences of feedback.
2. Watch the IL's code-along video (5-7 minutes).
3. Confirm calculated fields are correct.
4. Check that the IL explains WHY they do what they do.
5. Count at least 3 CFUs targeting common misconceptions.
6. Evaluate tone, pacing, and teaching presence.
7. Score the submission in Canvas using the rubric.
8. Write 1-2 sentences of feedback.
Week 4 (April 13 - April 19)
New Curriculum
Media Recordings
Senior Instructor
1. Review the answer key to see an example.
2. Watch the IL's video (6-8 minutes).
3. Confirm the dashboard includes 3-4 visualizations.
4. Check that the IL explains the WHY behind choices.
5. Verify the filter action is tested.
6. Score the submission in Canvas using the rubric.
7. Write 1-2 sentences of feedback.
2. Watch the IL's video (6-8 minutes).
3. Confirm the dashboard includes 3-4 visualizations.
4. Check that the IL explains the WHY behind choices.
5. Verify the filter action is tested.
6. Score the submission in Canvas using the rubric.
7. Write 1-2 sentences of feedback.
Week 4 (April 13 - April 19)
Same Curriculum
Website URL
KWK Team
1. Confirm the IL used a new dataset (not Google Play data).
2. Identify at least 3 advanced techniques.
3. Test interactive elements to confirm they work correctly.
4. Evaluate whether the visualizations tell a clear data story.
5. Check for clear titles, descriptions, and text boxes.
6. Assess overall polish and design.
7. Score the submission in Canvas using the rubric.
8. Write 1-2 sentences of feedback.
2. Identify at least 3 advanced techniques.
3. Test interactive elements to confirm they work correctly.
4. Evaluate whether the visualizations tell a clear data story.
5. Check for clear titles, descriptions, and text boxes.
6. Assess overall polish and design.
7. Score the submission in Canvas using the rubric.
8. Write 1-2 sentences of feedback.
Week 5 (April 20 - April 26)
Everyone
Website URL
Senior Instructor
1. Review the rubric and exemplars.
2. Open the IL’s Tableau Public link and explore their vizzes.
3. Assess whether the vizzes communicate a clear insight.
4. Verify the project reflects skills taught in the curriculum.
5. Read the IL’s comments and look for a personal connection.
6. Score the submission in Canvas using the rubric.
7. Write 1-2 sentences of feedback.
2. Open the IL’s Tableau Public link and explore their vizzes.
3. Assess whether the vizzes communicate a clear insight.
4. Verify the project reflects skills taught in the curriculum.
5. Read the IL’s comments and look for a personal connection.
6. Score the submission in Canvas using the rubric.
7. Write 1-2 sentences of feedback.
Week 5 (April 20 - April 26)
Everyone
Quiz
Senior Instructor
1. Review the exemplar answers.
2. Score each response 0-2 in Canvas.
2. Score each response 0-2 in Canvas.
Made with Bullet