Local Wisdom, Lasting Change: Empowering Communities Through Grounded Program Evaluation

Abstract

A local craftsman built a pavilion from local storm-felled trees, demonstrating resourcefulness and sustainability. This pavilion serves as a metaphor for grounding program evaluation in local resources and knowledge. Utilizing local stakeholders in program evaluation taps into contextual knowledge often missed by external evaluators. Empowering community members to conduct evaluations fosters ownership and engagement with the process. Effective evaluations, like the pavilion, acknowledge limitations and build on lessons learned. Strategies for enhancing program evaluation include engaging stakeholders, utilizing local resources, and focusing on sustainability. Building evaluation capacity within communities creates a lasting impact and ongoing improvement. The post advocates for valuing local wisdom and resilience in program evaluation, leading to more meaningful and sustainable outcomes.

Introduction

During a recent visit to Low Country, South Carolina, I stumbled upon an unexpected lesson in resourcefulness and sustainability. Amidst the moss-draped oaks and tidal marshes, I met a local polymath—an engineer by training but a craftsman by passion. On his property outside of DC stood a magnificent pavilion, its wooden beams rising gracefully toward the sky. What made this structure remarkable wasn't just its aesthetic appeal, but its origin story: the entire pavilion was constructed from storm-felled trees, local timber milled on-site, and assembled with ingenuity born from necessity.

As I admired the pavilion's elegant design and sturdy construction, I couldn't help but see parallels to my work in program evaluation. Too often, we rely on imported frameworks and external expertise when the most sustainable and impactful solutions might be growing right around us. This pavilion—born from local resources, skills, and knowledge—offers a powerful metaphor for how we might approach program evaluation in a more grounded, sustainable, and ultimately more effective way.

The Pavilion Story – A Lesson in Ingenuity and Sustainability

The polymath brother (as his family affectionately called him) wasn't just any engineer. With degrees in mechanical engineering and architecture, and years spent working on complex infrastructure projects, he approached problems with both technical precision and creative vision. When Hurricane Matthew swept through the area in 2016, leaving dozens of mature hardwood trees scattered across a local popular park, he saw not devastation but opportunity.

Instead of hiring contractors to remove the fallen trees and import materials for a new gathering space, he set up a portable sawmill and began transforming chaos into creation. Oak became support beams, cypress was milled for weather-resistant flooring, and various hardwoods were carefully selected for different structural elements based on their natural properties. The pavilion took shape over months, designed to withstand future storms while honoring the character of the landscape it came from. Local neighbors came together to collaborate on and help rebuild the pavilion.

What struck me most was how this approach—using what's available, respecting local conditions, and applying appropriate expertise—created something more harmonious with its environment than any prefabricated structure could have been. The pavilion wasn't just built on the land; it was built of the land, embodying a profound lesson in working with, rather than imposing upon, the existing environment.

Drawing Parallels to Program Evaluation

This pavilion-building approach mirrors what the most effective program evaluations strive to achieve. Instead of imposing standardized evaluation frameworks that often fail to capture local nuances, what if we invested in developing evaluation skills among program participants and community members?

When we empower local stakeholders to design and conduct evaluations, we tap into invaluable contextual knowledge. These individuals understand the subtle cultural factors, historical contexts, and community dynamics that external evaluators might miss. Just as the polymath brother knew which wood would resist local insects and which would withstand humidity, community members know which questions matter most and how to interpret responses correctly.

Building evaluation capacity from the ground up also fosters ownership. When participants see evaluation as their tool—not something imposed from outside—they're more likely to engage meaningfully with the process and act on the findings. The evaluation becomes not just an assessment but an integral part of the program's growth and development, much like the pavilion became not just a structure but an expression of resilience and adaptation.

Lessons from the Pavilion Builder – Accomplishments, Errors, and Reflections

The finished pavilion stands as a testament to what locally-sourced solutions can accomplish. It has weathered subsequent storms, hosted countless gatherings, and become a landmark that visitors admire. Its functionality exceeds what commercially available options might have provided, precisely because it was designed with intimate knowledge of local needs and conditions.

Yet the builder was quick to point out his missteps: "I didn't account for how the different woods would expand at different rates," he admitted, showing me where he'd made subsequent adjustments. "And this section took twice as long as necessary because I was learning the technique as I went."

These admissions weren't signs of failure but rather reflections of a healthy learning process—one that parallels effective evaluation practices. Good evaluations acknowledge limitations, document lessons learned, and build on previous experiences. They recognize that perfection isn't the goal; improvement is.

Perhaps most insightful was his reflection on the process: "The best part wasn't finishing it—it was figuring out how each unique piece of wood could contribute to the whole." This perspective mirrors the value of inclusive evaluation approaches that recognize how diverse perspectives combine to create a more complete understanding of program impacts.

Practical Strategies for Enhancing Program Evaluation Using Local Knowledge

How can we bring this pavilion-building metaphor to program evaluation? Several strategies stand out:

Engage Stakeholders Meaningfully: Involve program participants not just as data sources but as evaluation designers and analysts. Their questions often lead to the most relevant insights.

Utilize Local Resources: Map existing skills and knowledge within your community before seeking external expertise. Sometimes the perfect evaluation "timber" is already in your backyard.

Focus on Sustainability: Design evaluation practices that can be maintained beyond initial implementation. Simple, repeatable methodologies often yield more consistent insights than complex approaches that collapse without expert guidance.

Embrace Flexibility: Allow your evaluation framework to adapt to changing circumstances, just as the pavilion builder adjusted his techniques to work with the unique properties of each tree.

Building Something That Lasts

The pavilion stands as a physical manifestation of sustainable design—a structure that will serve its purpose for generations because it was built with deep understanding of local conditions and materials. Similarly, evaluations built on local knowledge and skills create lasting impact.

When we invest in building evaluation capacity within communities and organizations, we don't just get better data for one assessment—we create an evaluation mindset that continues to generate insights long after external consultants have moved on. Program participants empowered with evaluation skills become agents of ongoing improvement and adaptation.

Like the storm-felled trees transformed into a beautiful pavilion, challenges in programs can become opportunities for growth when viewed through an evaluative lens that values local wisdom and resilience.

Conclusion

The polymath brother's pavilion reminds us that our best resources often lie right beside us in the neighborhood—we need only the vision to recognize them and the skills to transform them. In program evaluation, this means looking first at the knowledge, experiences, and capabilities within the communities we serve before importing external frameworks or expertise.

By building evaluation capacity locally, tailoring approaches to context, and valuing diverse perspectives, we create evaluations that are not just more accurate but more meaningful and sustainable. Like a well-built pavilion, these evaluations stand the test of time, providing shelter for better decision-making and program improvement for years to come.

The next time you approach program evaluation, ask yourself: What trees have already fallen that I might build with? What local knowledge might I mill into something useful? The answers might just lead to evaluation practices as beautiful and enduring as a hand-crafted pavilion rising from the South Carolina lowlands.

Listening to Program Participants

Tweeted 8-12-2009: "Evaluators: Do not assume that you know anything about what the program does. Always ask for a description of the services or activities."


Why is it important to listen to program participants describe what they do in a program?

Programs are not made up of a single component or element - a program has a set of goals and objectives (explicit or implicit) that participants are expected to follow. Each participant in a program - the implementers and the current and future beneficiaries of the program - interacts with others within a program according to the roles and expectations mutually emerging in time and guided by the goals and objectives, standards of practice as understood by the culture of the participants in the program, and according to the expectations and values of collaborating stakeholders (funders, citizen boards, communities).

When we listen to participants' narratives about their activities within a program we can hear the ways that the program is operationalized at the level of that participant's field of action. The "field of action" is the unit of interactions within a program that has the highest likelihood of managing change - and change is what programs are designed to manage for participants. Change is the core function of any social or educational program. No matter how goals and objectives are written in print, managing change toward or from some current or future behavior or condition is the critical feature of any program. Think about the budget of any program. Embedded within that budget are the concrete raw materials for making change happen. The largest share of the budget resources most often is the personnel category (or consultants if the program depends on delivery by consulting collaborators). So in terms of program resources and program goals, the management of change is the central focus of programs.

The management of change is embedded in the narrative of those participants closest to the interaction between the provider and beneficiary, and no less so with the program leaders. Each program participant carries within them a "narrative of action" that when verbalized gives the evaluator the clues to the deepest nature of a program. Unleashing these narratives through questioning and listening to participants is the beginning of a process of mutual and collaborative self-reflection that is critical in making program evaluation useful and helpful.

So do not assume to know anything about a program, but always ask each program participant you encounter to describe the work they do. Note the words and narrative revealed by the participant: In what order are activities and services described? What conditions are noted? What kinds of interactions are described? What links to the community are identified? Who is doing the action - provider or beneficiary? How is hopefulness and hopelessness conveyed? What challenges are identified? What facilitators are identified? The narrative of the participants will become an evaluator's most useful tool to make program evaluation useful and helpful.

Father's Day 2009 Post

What do researchers say fathers contribute to children and child development? My take on this is - Dads, you better start talking to your babies and toddlers early and often! Here are a selection of findings for reflection.

• Fathers and social development. Fathers who tended to hold their babies facing out reported that they did this because “it’s easier for the baby to see the world.” In over 20 years of studying fathers, Dr. Ross Parke states that men have a tendency to allow their infants more freedom toexplore, which appears to support the development of independence in their children. Fathers who actively play with their children appear to reinforce the notion of emotional self-control in their children and help their children learn to recognize the emotional cues of others. (http://fcs.tamu.edu/families/parenting/fathering/fathering_pdf/development.pdf)

• A noted sociologist, Dr. David Popenoe, is one of the pioneers of the relatively young field of research into fathers and fatherhood. "Fathers are far more than just 'second adults' in the home," he says. "Involved fathers bring positive benefits to their children that no other person is as likely to bring."⁶ Fathers have a direct impact on the well-being of their children. It is important for professionals working with fathers—especially in the difficult, emotionally charged arena in which child protective services (CPS) caseworkers operate—to have a working understanding of the literature that addresses this impact. Such knowledge will help make the case for why the most effective CPS case plans will involve fathers. (http://www.childwelfare.gov/pubs/usermanuals/fatherhood/chaptertwo.cfm)

• However, there was one surprising finding: while mothers’ depression reduced the mother-child reading activities, and similarly, fathers’ depression reduced the father-child reading activities, it was the fathers’ depression (but not mothers) that significantly affected the child’s vocabulary development at 24-months. Why? The authors suggest that even though maternal depression reduced mother-child reading time, the mother stills spends a significant amount of time with the child, so that such reduction is not likely to have a major effect on the child’s development. (http://www.child-psych.org/2009/03/baby-blues-fathers-postpartum.html)

• Fathers influence child language development more than mothers: CHAPEL HILL - In families with two working parents, fathers had greater impact than mothers on their children's language development between ages 2 and 3, according to a study by the University of North Carolina at Chapel Hill's Frank Porter Graham (FPG) Child Development Institute and UNC's School of Education. Researchers videotaped pairs of parents and their 2-year-old children in their homes during playtime. The children whose fathers used more diverse vocabularies had greater language development when they were tested one year later. However, the mothers' vocabulary did not significantly affect a child's language skills. "Most previous studies on early language development focused on mothers," said Nadya Panscofar, a graduate research assistant and an author of the study. "These findings underscore that for two-parent, dual earner families, fathers should be included in all efforts to improve language development and school readiness." (http://www.unc.edu/news/archives/oct06/fpgfatherslanguage103006.htm)