Will Richardson and I discuss Automated Essay Scoring

With a bonus dialogue between Will and Vantage Learning, an AES vendor, at the end

  1. @NMHS_Principal That post deserves pushback. Are really only going to assess what can be machine scored??? #edchat
  2. @willrich45 @nmhs_principal the hope: give good writing prompts, have humans grade a sample, computers predict the rest blogs.edweek.org/edweek/edtechr…
  3. @bjfr Why do we "need more writing on high stake tests?" What are teachers for, exactly?
  4. @willrich45 Why writing on tests? Tests drive behavior (under current policy) and I'd rather have kids preparing for writing than for MC
  5. @willrich45 what are teachers for? Intensive 1-1 writing coaching. If computers could grade drafts, could you devote more time to coaching?
  6. @bjfr Tests only drive behavior if we let tests drive behavior, right? Too many seem unwilling to take the wheel.
  7. @bjfr Re: comp grading drafts. Can't kids peer asses? In classroom, online? Why does all writing need to be assessed? Computers don't coach.
  8. @willrich45 "Computers don't coach.” Spellcheck grammar turnitin? They free time for peers & tchrs 2 address other problems.
  9. @bjfr True, but can machines tell why mistakes were made?
  10. @willrich45 It is all about resource management. Comps score mechanics accurately, frees teachers to foster creativity bit.ly/H9mTtX
  11. @VantageLearn So, teachers and kids couldn't learn to write well before machine scoring? This isn't test prep?
  12. @VantageLearn The test essays will be machine scored, so now we're finding ways to get kids ready for that as well. Sorry...I'm not buying.
  13. @VantageLearn My question is, however, a tool for what? For improving voice and powerful writing? Or for standardizing writing? Valid Q?
  14. @willrich45 MA! for example. It isn't an assessment product, scores are not for grades. Instead it is a means to practice writing at scale.
  15. @willrich45 Students get instant turn around to start writing again, teachers stay in the loop every step of the way. bit.ly/t6W8yW
  16. @willrich45 The technology takes away the biggest inefficiency in the traditional student/teacher writing model: turn around time.
  17. @VantageLearn Fwiw, I taught hs expos 18 years. I get your mission. But turn around time only matters if the assess is meaningful...1/2
  18. @VantageLearn ...and, importantly, if it doesn't lead to formulaic writing. Machine feedback directs all students to same baselines. Right?
  19. @VantageLearn And it is an assessment product. May not be a "grade" but it still assesses. Btw, I think we're at the Twitter convo fail pt.
  20. @willrich45 yes, this is a conversation not suited for 140 characters at a time at this point.
  21. @willrich45 But our content/scoring team (the keepers of the keys) would like to cont. the convo, if you'd like. I'm fwd our string to them.
  22. @willrich45 they can write up a blog post, could even set up a conference call if you'd like.
  23. @VantageLearn I would love that. [email protected]

Did you find this story interesting? Be the first to or comment.

Liked!

Justin Reich

HGSE EdD student, co-director EdTechTeacher.org, husband, traveler, guy, author of A Baby's First Book of Zombies, http://kck.st/babyzombie,

Total views
116

Storify

@Storify