Thursday, August 9, 2012

Achievement-oriented grading for a game design class

I just posted a draft course description for the game design course I described in my previous post. After consulting with my co-instructor, we agreed to incorporate achievement-based grading. This is my first time designing this "gamified" style of summative assessment, but I'm pretty happy with the results. We articulated twelve achievements:
Seeker
Find an educational museum game aside from those shared by the instructors and write an analysis of it
Dabbler
Play a game outside of the canon and write an analysis of it.
Reflective Practitioner
Create an artifact (such as an essay or video) in the last two weeks of the semester to reflect upon the semester's experience, explicitly drawing upon game design literature
Nigh Completionist
Play and write analyses on 75%–99% of the games in the canon (or their approved alternatives).
Completionist
Play and write analyses of all the games in the canon (or their approved alternatives).
Detail-Oriented
Visit the Indiana State Museum as a guest and write about the experience.
Explorer
Visit another museum as a guest and write about the experience.
Quality Assurance
Participate in 75%–90% of the prototype evaluation sessions.
Quality Assurance Expert
Participate in over 90% of the prototype evaluation sessions.
Reviewer
Make significant comments on five other students' posted game analyses or essays
Expert Reviewer
Make significant comments on ten other students' posted game analyses or essays
Socializer
Attend a game-related community event and write about it
The current draft states that earning ten or more achievements merits an A, nine is an A-, eight is a B, and so on.

There are three parts of the course that we did not frame as achievements: a short student research presentation, five iterations of prototyping, and a rulebook requirement for student-designed games. These three elements are necessary for the course to work, so instead of framing them as achievements, we incorporated letter-grade demerits for failing to accomplish them.

In our discussion of the achievement-based grading, we noted that it's very similar to contract grading: a student can essentially choose their level of commitment to the course based on the grade they want to earn. All of the student-created artifacts (including writings, designs, and presentations) are subject to both peer and expert formative evaluation—a reflection of the studio-based learning I use in my Computer Science courses.

As always, feel free to share your thoughts in the comments.

EDIT: See this post for a reflection on the efficacy of this approach.

Wednesday, August 8, 2012

Serious Games and Museums in the 2012-2013 Academic Year

Ron Morris and I are starting an exciting collaboration with the Indiana State Museum. In the Fall, we are teaching an honors colloquium on the theme of serious games and museums. Each student in this colloquium will create a physical (i.e. non-digital) game that incorporates an aspect of the Indiana State Museum—its collection and its mission. At the end of the semester, Ron and I will select the game most amenable to digital adaptation, and in the Spring, we will be leading an interdisciplinary team in the creation of the digital version. The Spring production will take place in a six-credit-hour development studio, with students recruited from both the honors colloquium and my regular Fall game programming course, and potentially other sources. This structure is an attempt to take the best of what we did in 2010-2011 for Morgan's Raid and integrate it with what I learned from my fellowship at the Virginia Ball Center for Creative Inquiry.

We are currently working on the plan for the Fall colloquium. When we led a similar colloquium to kick off Morgan's Raid, I think we may have moved the students too quickly into production. At the VBC, we spent the first week on a game design workshop, and this helped the team to develop some common understanding and vocabulary. One week at the VBC is equivalent to half a semester in a regular three-credit course. I don't think we can invest quite that much time this Fall, but I'm sure there's a happy medium. My current sketch for the semester is split in so that about a third of the time is spent on background and fundamentals, and two thirds spent on studio-based design processes, emphasizing short cycles.

With Morgan's Raid, we tried to produce one high-quality physical prototype with initial digital prototypes in one semester, but this led us to invest too much in too few ideas from early in the semester. I hope that this semester's approach allows us to more carefully explore the design space. Additionally, it allows each student to create a concrete artifact to represent their efforts, and each of these has value regardless of whether it is chosen for digitization. This approach does introduce an unlikely but significant risk that all the students' projects may rely too much on the affordances of physical reality to be digitized; however, I'm confident from my past experiences leading student teams that the Spring Team will be able to make appropriate modifications in this eventuality.

If you have any tips or suggestions for the project or course structures, please feel free to leave them in the comments!