Part 1: Our Path Toward Equitable Evaluation: Building Skills, Understanding Challenges

In March 2020, Equal Measure launched learning circles on Facilitation, Data Visualization, and Equitable Evaluation, to deepen content expertise and technical skill across the organization. In the first of a series, Equal Measure’s Eve Weiss, Senior Director, shares the evolution of the Equitable Evaluation Learning Circle (EELC) and her experience in deepening adoption of equitable evaluation principles and practices.

The aim of the Equitable Evaluation Learning Circle (EELC) is to explore the history, context, and approach to evaluation that emphasizes equity, resonates across multiple cultures, and strives for participant ownership. Our work is influenced by the practice of the Equitable Evaluation Framework™, which is driven by critical questions about the historical and structural context that contribute to the systemic conditions we evaluate and the changes we hope to see. Nationally, the Equitable Evaluation Initiative (EEI), a five-year effort now ending year two, is inviting foundations (and soon consultants) to join as practice partners to lead in shifting the evaluation paradigm.

While EEI principles overlap with practices undertaken within other evaluation frameworks such as developmental, culturally responsive, participatory, and empowerment evaluation, at Equal Measure we emphasize a practice that prioritizes the use of an equity lens when conducting the work and community ownership of the process and the outcomes—including data, its interpretation, and its implications.

As Equal Measure has focused on diversity, equity, and inclusion (DEI) throughout our history, we recognize we still have much to learn. We view the EELC as an opportunity to sharpen our skills and intensify our focus on the critical value of equitable evaluation practices, thereby strengthening our organization and our client engagements. Ultimately, the true test is whether our findings resonate with the programs and initiatives we evaluate, advance learning, and accelerate efforts to support the communities of focus.

Pacing Our Equitable Evaluation Focus:
Starting From Reflection

The practice of the Equitable Evaluation Framework™ requires more than reading articles and adopting new tools and methods. The journey includes self-reflection, organizational reflection, and a commitment to carry out the work in service of the communities we hope to serve.

At Equal Measure, we started with the Equitable Evaluation Framework™ and then adapted it to our internal culture as we built our EELC curriculum. The curriculum is inspired by the Equitable Evaluation Framework™, but we appreciate that we are still learning these practices. We designed the EELC curriculum to roll out over three phases: Mindset, Practice, and the Field. We are midway through our curriculum and have recently moved into the Practice phase.

During the Mindset Phase, we emphasized lived experience and focused on exploring and shifting our own mental models as evaluators. This process started with learning about the historical context in which evaluation was developed and then adopted by foundations. We then reflected on our own individual contexts and cultures—how we grew up, our unique life experiences, and what values drive us today—to begin to identify our own biases and consider how they influence our work.

The conversation raised difficult questions for the group: how much of my ”self” should I bring to work? How much shows up regardless of my intention? What is the role of power, and how much do I wield? How can I view my work through a lens of equity—and guide others to do the same?

We believe that when we understand the history of our sector, and recognize our own biases, we can be in a better position to shift our mindsets and identify how to best shape our client engagements around the priorities of the communities served.

Applying to Practice

After four sessions focused on context and mindset, we have entered the Practice Phase, considering how to apply what we are learning to project work.

Our first activity is to create Guiding Questions, such as: Who are the communities, organizations, and/or institutions involved in this work? By whom and for whom is this evaluation? What is my own power and what can I influence, directly or indirectly? How can I be most equitable in my approach to the work? What is my plan for reflecting on data with the community and making it of use to them?

Developing these Guiding Questions and integrating them into our projects are the first steps among many we will take to strengthen equitable evaluation skills at Equal Measure. Members of the EELC will become champions for equitable evaluation at Equal Measure as we roll out the first iteration of the Guiding Questions across the organization through project work.

Next, within the Practice Phase, we will study an array of evaluation practices and develop recommendations for activities such as protocol development, data sampling, data sharing, and deliverable development.

As we move toward the Field-facing Phase, we will begin to combine our curriculum with those of the data visualization and facilitation learning circles, with the goal of infusing best practices in equity into those organizational activities.

The Challenge of Humble Learning

One challenge in conducting a learning circle about equitable evaluation is that this work should not solely be grounded in the literature and guidance from experts; rather, this work must include new voices who historically have been excluded from the dialog, and we must validate their expertise.

In addition, we can’t afford to wait to do this hard work until the moment we believe we’re experts—because we will never truly become experts.

Though we will surely make mistakes as we navigate equitable evaluation practices, we must humbly wade in and be ready to learn from each other. In doing so, we will evolve our own understanding about how our work can better serve communities and make progress toward the big, systemic changes our society so deeply needs.

Reader questions/engagement

Are you—or your organization—ready to do the hard work of self-reflection and the unlearning of historic evaluation traditions, the first steps in the journey toward more equitable practices?

In the next post in this series, Equal Measure’s Kimberly Braxton, Director, reflects on her experience as an EELC member and how Equal Measure’s organizational culture supports the goals of the learning circle.