Friday, May 31, 2024

Messy final drafts and metacomments

Like many teachers, I've been thinking about how writing studies faculty can help ourselves and our colleagues by drawing on our expertise to keep up with some of the challenges AI poses in writing instructional environments.

One teaching strategy I have been using is discussion-board dialogue about final student projects , as I described in "AI apps and student writing worries?: An old, reliable OWT practice can help"and "Generative AI and integrity concerns: More discussion board support."

That was a mixed bag. I used this teaching strategy in two very different courses. In one class it worked great. In another class, not so much.

In the latter class, I think the lukewarm success was partly because the course assignments didn't lend themselves to conversation. This course, The Literature of Business, has assignments that, while students can make them their own, does create somewhat similar results.

So I lived and learned. In recognition of those problems, I added another layer. I started also using metacomments: simply put, I ask students to write about their own writing as part of the assignment. This is an old composition practice, and in fact Julianne Ross-Kleinmann and Wess Trabelsi recently described a version of it in a smart T.H.E Journal piece "Teaching and Learning, Cheating, and Assessment in the Age of AI":

Another way to change teachers' method of assessing papers is to ask students to defend their work. This means having a conversation with them about their paper, either in person or when they upload it to the learning management system. Why did they make this argument or include that fact? What is the crux of their position? If they can't answer these kinds of questions, maybe they shouldn't receive a good grade on the paper — even if it is an excellent piece of work on its own. (emphasis mine)

Metacomments push students to talk about their practice and to defend their choices. In asking for these comments at the paragraph level, I am seeking granular analysis about their rhetorical choices.

My primary goal is constructive pedagogy, but if we're worried about authenticity and plagiarism, these comments head off a lot of clear, wholesale "borrowing": even if generative AI (or their roommate!) wrote a paper for them, they would still in many cases have to think through what each paragraph means in the context of the assignment.

If they tried to get AI, they still have to cut-and-paste individual paragraphs and generate the purpose--note, not the summary--of that paragraph in the context of the entire assignment. They're going to have to do some work in most cases.

My students have produced strong metacomment work. At times the comments are good. Sometimes they are fantastic. And occasionally they are better than the writing project itself.

However, I had to shake myself out of normalcy and embrace a new mindset when reading student writing. While in writing studies we often talk about embracing process, we traditionally still want something clean handed to us. Indeed, I think most teacher-readers are enamored of the "clean draft": neat, tidy, finished. I get why, but if we use metacomments the way I'm suggesting, we're asking for a "messy final draft," one in which students accompany each paragraph with comments about what they want to achieve; such writing will be intrusive. 

I don't require students to be fancy in formatting their metacomments. Footnotes or endnotes are ideal, but I'm fine with inserted bracketed or boldfaced comments after each paragraph: Messy, but functional for this purpose!

Ultimately, I'm moving away from the cleanly "typed" paper toward a product that vividly shows the often messy excellence of student thinking.

Labels: , , , ,