profile

The Evaluation Therapy Newsletter

Our monthly Evaluation Therapy Newsletter shares strategies, ideas, and lessons learned from our decades of evaluating learning in non-school spaces - museums, zoos, gardens, and after-school programs. Jessica is a learning researcher who is an educator at heart. She loves helping education teams really understand and build insights from data that they can use immediately – even those who are a bit wary of evaluation.

Graphic of four ways of counting visitors: attendance, people, breadth, and depth

1-2-3-4: Counting Visitors or Making Visitors Count?

Hi Reader, Based on conversations I've been having, it seems a lot of organizations updated strategic plans in the last few years. Now they’re trying to figure out how to track, measure, and otherwise document their progress toward those big-picture goals. More than once, I’ve reminded folks to start with meaningful, rather than immediately panic about measurable. This all made me think of a conference theme that has stuck in my memory for 19 years -- “Counting Visitors or Making Visitors...

Measuring Ch-ch-changes: When Pre/Post is not the answer

Hi Reader, You know that old saying about the weather in New England? Or Michigan? Or Pittsburgh? Or, well, every Northeast/Midwest city or region has a version of it. Don't like the weather? Wait 15 minutes. It'll change. It's been nothing but ch-ch-changes in the weather around here. 75 yesterday. 50 today. Maybe Mother Nature is on the collective Emotional Roller Coaster we are all riding these days. As an evaluator, the word change makes my ears perk up. Measuring change creates presents...
Teachers need everything and nothing at the same time.

Teacher PD: The Art of Offering Everything & Nothing

Hi Reader, The hits just keep on coming, don't they? While we watch officials give a big middle finger to the Department of Education and IMLS,* it makes me think about how our orgs can step up to the plate for our K-16 learners. There are lots of ways you do this outside of schools. From field trips to afterschool and summer programs. Science cafes to mentoring and internships. But our out-of-school experiences rarely achieve the same intensity and consistency as classroom teachers. We're...
Children's artwork on a refrigerator

Meaningful evaluation with tiny humans

Hi Reader, If you're at all like me, you've been waking up each morning wondering, "What fresh hell will greet me in today's news?" I've been tracking updates from the National Council of Nonprofits and the policy statements from large universities. It's good to learn how the folks with lots of legal pros on staff are thinking. At this moment, it seems to be, "Keep calm and (cautiously) carry on." In these difficult days, I need things that bring me joy. And routinely, I can count on kids to...

I Saw the Sign: The simplicity and complexity of ID Labels

Hi Reader, Happy 2025, everyone! Based on these first two weeks, I feel confident in saying that it's going to be... a year. Hope you are hanging in there, wherever you are. On a Zoom call last week, someone asked about the plushies on the bookshelf behind me. (Two gorillas and a red panda. The wolverine is off-camera; he's shy.) The short explanation you may already know: I'm a zoo and aquarium person, from way back. I started my evaluation career in the Exhibition & Graphic Arts Department...

I kinda hate SMART goals.

Hi Reader, In addition to candy canes and Mariah Carey on repeat, this is the time of year that brings up a lot of talk about goals. Did you meet your goals for this year? What are your goals for 2025? Even Goodreads is all over me about reviewing and setting my annual reading goals! All this talk about goals reminded me that I am a bit of a Grinch when it comes to so-called SMART goals. Since we are in December, I shall indulge in the traditional Festivus Airing of Grievances and dig into...

STEM career outcomes? It's the journey, not the destination.

Hi Reader, It's been quite a week, hasn't it? I've found myself thinking a lot about education in recent days. Particularly, I'm thinking about education that develops and hones our critical thinking skills. Skills to hold and consider multiple ideas at the same time. Weigh evidence and multiple variables, particularly when they contradict. Seek multiple sources to validate information. Question potential bias in evidence sources. An education that should start early (elementary-aged kids can...
Text of a four-point rubric for evaluating if a teen program met the criteria for engaging and interactive.

Rubrics: How do I love thee?

Hi Reader, In a recent meeting about a teacher PD program we're evaluating, I was introduced to a teacher meme that I shall call the Skibbidi Rizz Rubric. It is perfection. The approach to translating teacher speak into slang of The Kids Today to finally get across, "Want that A? Here's how," is hilarious. Based on our work with middle school teachers, it checks out. This month, let's dig into rubrics -- why they are flexible and powerful tools for evaluation. Including, as the Skibbidi Rizz...

The Incredible Power of Slowing the F Down

Hi Reader, I intended to send you this newsletter yesterday. But after attending the Science-Art Symposium at Denver Botanic Gardens this weekend, I scrapped our planned topic at the last minute. I was so inspired by the ideas shared by artists, scientists, educators, designers, CEOs, librarians, architects, and members of the community. I couldn't wait to reflect on some common themes. Well, one theme in particular. Slowing the f*** down. I wish I'd made tally marks every time a presenter...

The Search is Over: Finding treasure in the data you have

Hi Reader, In the steamy, dog days of summer, there has always been something soothing about sinking into an icily air conditioned movie theater. Especially for an over-the-top adventure flick. Whether we're following The Goonies, Indiana Jones, or Nicolas Cage doing unspeakable things to the Declaration of Independence, give me AC on high and a bucket of popcorn. I'm in. This month, let's channel our inner Goonies and talk about the buried treasures of data that could be hiding in...

Our monthly Evaluation Therapy Newsletter shares strategies, ideas, and lessons learned from our decades of evaluating learning in non-school spaces - museums, zoos, gardens, and after-school programs. Jessica is a learning researcher who is an educator at heart. She loves helping education teams really understand and build insights from data that they can use immediately – even those who are a bit wary of evaluation.