A Dinner Conversation with James Popham on Formative Assessment

Consultants' Corner Oakland Writing Project

dinner2A few months ago, I had the opportunity to share dinner and conversation with James Popham. As an avid fan of his work on learning progressions, I was excited to finally meet him. Three years prior, in the midst of a statewide collaboration to build a Common Core Standards-aligned model 6-12 ELA curriculum, I had hit upon Popham’s research.

To build a model curriculum meant we had the blessing and the challenge of vertically aligning across a K-12 grade span. Vertical alignment meant sequencing not only content knowledge, but also conceptual understanding and application of content. Dealing with content, in some ways, is the easier part of sequencing a learning progression. As teachers, a content approach is ingrained in our practice, district pacing guides, and state standards. The much harder task is to theorize a learner’s learning progression of conceptual understanding and application. As we developed the K-12 curriculum we had to consider:

● what tasks to scaffold across a progression in terms of complexity,
● what embedded instructional practices best support students into increasingly more complex content, understanding, and application, and
● what evidence we should focus our attention on when studying student work to determine growth.

So I now sat across the table from the James Popham with my mind spinning. What would I say to or ask a scholar who has been such an influential voice in education for decades? After the perfunctory jokes about bad Michigan weather, ordering our meals, and performing introductions of our small group of colleagues, the conversation shifted to formative assessment. Why the continued struggle to build system-wide effective formative assessment practices? Popham’s theory: educators are paying attention to the wrong things. Leaning in, we waited to hear what these wrong things are. He went on to share that in his experience and research, teachers focus more on instructional procedures than what happens to students as a result of those procedures. My initial reaction was to push back. Was he saying that instructional practices were not important enough to focus professional learning around? He politely engaged in a back and forth volley with me, but it was clear that the exchange didn’t change either of our minds.

Weeks later, I engaged further with Popham’s theory by reading his book Unlearned Lessons: Six Stumbling Blocks to Our Schools’ Success. If you’re wondering, the six stumbling blocks Popham presents as holding school systems back from maximizing student achievement are:
● Too many curricular targets
● Underutilization of classroom assessment
● Preoccupation with instructional process
● Absence of affective assessment
● Instructionally insensitive accountability tests
● Abysmal assessment literacy

In my second “hearing” of Popham’s argument, I found some common ground. His claim was not that no attention should be paid to instructional procedures but rather, that as teachers and administrators, we can easily fall prey to focusing solely on procedures and lose sight of what happens to students as a consequence of instruction. Now pair this preoccupation with instructional procedures to the underutilizing of classroom assessment and voila`–formative assessment becomes misinterpreted as studying summative student data long after its collection.

I had to admit–I could now see where Popham was coming from. The question remains though: how do we better balance attention between instructional practices and formatively assessing student learning? Over the next few weeks, I will share a story of a statewide collaborative of writing teachers and university researchers who have been working in this particular problem space. Their inquiry: what instructional practices produce effective student peer to peer feedback and what learning does peer feedback make visible? In the meantime, if learning progressions and their relationship to effective formative assessment interests you, the following resources may be useful.

Formative Assessment in Practice: A Process of Inquiry and Action, Margaret Heritage (2013)
Transformative Assessment, W. James Popham (2008)
Transformative Assessment in Action, W. James Popham (2011)

Links
Assessment Literacy in Today’s Classroom
Creating Learning Progressions

Learning Progression to Support Self-Assessment and Writing about Themes in Literature: Small Group

Using a Learning Progression to Help Students Work Towards Clear Goals (K-2)


Susan GolabSusan Wilson-Golab
joined Oakland Schools in 2010 following 22 years of in the field 6-12 experience across two different states and rural, suburban, and urban contexts. Her research and practice focus heavily on the evolving definition of literacy, developmental learning progressions, and formative assessment. At the district level, Susan has served as classroom teacher, Literacy Specialist, and ELA Curriculum Coordinator. These experiences and study helped Susan in her role as Project Leader for developing a model 6-12 ELA curriculum for the Michigan Association of Intermediate School Administrators (MAISA)— a curriculum resource now globally available. More recently, Susan launched Michigan Teachers as Researchers Collaborative (MiTRC). The mission: to build collaborative participatory research between university and secondary teachers from around the state interested in exploring and developing the teaching and assessing of writing. In 2000, she joined the National Writing Project through the satellite Oakland Writing Project site based out of University of Michigan. She now serves as Site Director for the Oakland Writing Project.

Let’s Talk About Student Engagement

Consultants' Corner Oakland Writing Project

Last week, teacher blogger Marcia Bonds explored the idea of engaging her students through developing a learner identity, an identity that she too needs to have and models daily with her students. As I read Marcia’s blog, I couldn’t help recalling how many times over the past two months I’ve heard the topic of “engagement” raised.

493533923Engagement–what does it mean? How do we foster engagement in our classrooms? Like Marcia, I see learner identity as a key part of engaging learners. The idea of mindset playing a role in how a learner engages is well researched. But I’m also encountering more conversations about engagement via digital tools. The use of social media tools in the classroom, such as Twitter, Facebook, blogs, Instagram, or Vine, continues to be debated as a possible way to re-engage students. I can’t help but wonder: could there be a relationship between learner identity and digital tools in the classroom?

147662769Not long ago, I came across Staci Hurst’s blog post that addresses engagement. Hurst highlights work stemming from the Schlechty Center on Engagement. Not immediately familiar with Schlechty’s name, I did some further digging that led me to his 2010 keynote in which he defines engagement. He claims four types of students exist: academically inclined students, “nice” kids, nice but won’t do much, and finally, those who are going to drop out of school. The real kicker comes when he contends that all but the academically inclined students are doing nothing more than complying in the classroom. He shares four types of observable engagement:

Strategic compliance: student does the work for extrinsic goals (grades, class rank, college acceptance, parental approval)

Ritual compliance: work holds no meaning or connection to the student, leading to the student focusing on minimum exit requirement (what do I need to do to get this over with?)
Retreatism: student disengages for multiple reasons–task holds no relevancy, emotionally withdrawn, task seems too unobtainable
Rebellion: student actively engages in acting out and recruiting others to do the same

So how does Schlechty define engagement? Persistence. An engaged student perseveres in difficult tasks with a personal emphasis to reach “optimum performance.”

Researchers477569935 who have closely studied engagement have developed a multi-dimensional measure of student engagement by tying together both cognitive and emotional components: the theory of flow. More simply put, flow is that magic moment where the learner is so focused in a task that they continue to persevere as complexity increases, finding enjoyment in the struggle.

I’m seeing a common denominator here–task design. Put more specifically, task design that elicits student investment. What I’m not yet clear on is if digital tools are critical to helping bolster students to persevere–to live in the magical flow moment.

Take Aways

So what do I walk away with from this mini-inquiry? I think the most critical take away is the need for opening up conversation between colleagues about how each of us interprets the word “engagement” and what tells us students are engaged. And we need to talk about the context of high engagement. What was the topic? How were students engaging in the lesson? What was the task or tasks?

Possible Conversation Starters

1. Select a video of an instructional session and discuss with colleagues how you would describe task design and evidence of student engagement.

● This 5th grade Social Studies lesson could be a useful artifact to study even for those teaching secondary grade levels.
● This short clip from Minneapolis Roosevelt HS could inspire a useful conversation about task design that engages students.

2. View Phil Schlechty’s keynote and open up conversation inviting colleagues to weigh in: What do they agree with? What do they not? What new questions do they now have about engagement?

3. Have colleagues read the Framework for Post-Secondary Success and describe what ideas it confirms and how pushes their thinking. How does the framework impact ideas about engagement and task design?

There’s no denying the power and role engagement plays in the learning process. It’s a worthy topic to explore both individually and with colleagues. I invite you to extend and deepen the conversation about student engagement. Please share your thoughts in the comment section.

Susan GolabSusan Wilson-Golab joined Oakland Schools in 2010 following 22 years of in the field 6-12 experience across two different states and rural, suburban, and urban contexts. Her research and practice focus heavily on the evolving definition of literacy, developmental learning progressions, and formative assessment. At the district level, Susan has served as classroom teacher, Literacy Specialist, and ELA Curriculum Coordinator. These experiences and study helped Susan in her role as Project Leader for developing a model 6-12 ELA curriculum for the Michigan Association of Intermediate School Administrators (MAISA)— a curriculum resource now globally available.  More recently, Susan launched Michigan Teachers as Researchers Collaborative (MiTRC). The mission: to build collaborative participatory research between university and secondary teachers from around the state interested in exploring and developing the teaching and assessing of writing. In 2000, she joined the National Writing Project through the satellite Oakland Writing Project site based out of University of Michigan. She now serves as Site Director for the Oakland Writing Project.