Listening and Learning Assessments: Is Knowing Half the Battle?

(Spoiler alert: it's not. But you should keep reading anyway.)

Our Listening and Learning Assessments are one of the most powerful services in APC Leadership Collaborative’s repertoire. After all, when a school district needs a strong plan for change, getting a clear picture of where things currently stand makes for a reasonable enough starting point.

Here’s what that starting point looks like for us:

We examine the school district’s own existent data in concert with interviews and focus groups we conduct with administrators, teachers, students, parents, and community members. In other words, we combine the quantitative with the qualitative to generate a comprehensive report. We draw on standards for school performance taken from the work of the Coalition of Schools Educating Boys of Color, Randall Lindsay’s Cultural Proficiency Model, and other research-based tools.

The deliverables vary by client, of course, but our assessment report tends to include the following:

  • data analysis on student experience and opportunity gaps;
  • discussion of themes from the qualitative interviews, including anonymous quotes that illustrate each theme; and
  • recommendations for the district’s approach to systemic change efforts.

Systemic Change Efforts: Knowing Is A Small but Important Part of the Battle

Knowing that there are problems is important. Elaborating on the specifics of those problems is very important. Creating change: that’s the crucial part. It’s also the hard part.

You may have heard of a concept in the field of psychology called the G.I. Joe Fallacy. It was developed by a couple of Yale professors, Dr. Laurie Santos and Dr. Tamar Gendler, and takes its name from the prototypically cheesy public service announcements that got tacked onto episodes of its somehow even more prototypically 1980s animated series, “G.I. Joe: A Real American Hero.”

In one such scenario, a child ill-advisedly tells a stranger on the phone that he’s home alone. A (presumably non-active-duty) G.I. serviceperson named Roadblock gets wind of the mistake while taking a stroll through the neighborhood and tells the child why he shouldn’t have done that.

“Now I know!” says the child.

“And knowing is half the battle!” says Roadblock.

“It’s not!” say Drs. Santos and Gendler.

To the contrary, they say, knowledge often finds itself at odds with cognitive function. Their go-to example is optical illusions. We’ve all seen the lines pictured below enough times to know that they’re the same length, yet our brain’s optical processes have an extraordinarily difficult time seeing them as anything but different lengths. Evolutionarily speaking, our eyes have spent a long time training themselves to see these lines as different lengths.

Action Plan Development: Providing Strategy for Systemic Change

Some behaviors, some assumptions, some ways of thinking, and some policies are so ingrained as to work against what we know to be true. Even when we know that a particular school system’s economically disadvantaged students graduate at a lower rate, or that its students of color are punished at disproportionately high rates and with disproportionately severe corrective actions, or that teachers and students feel uncomfortable having frank discussions about race—even when we know all that, changing our behavior is hard. You have to train yourself to prepare for change. You have to be persistent. You have to practice. 

It’s also why we never talk with a school district about completing a qualitative assessment without also talking about next steps:

Once we’ve completed a school system’s assessment and guided them toward releasing that assessment to the public, we talk about actionable steps toward change:

  • We provide an overview of pressing challenges, and we present those challenges as opportunities.
  • We create goals for future student achievement data that reflect current opportunity gaps.
  • We identify areas of alignments to the school system’s current strategic framework.
  • We make recommendations for addressing specific action steps for improvement in the areas of pedagogical practice, curriculum, classroom management, and student and parent relationships.