Internal & External Evaluation Collaboration Questions

Dear Colleagues,

I was recently asked by a major client to provide them with the pre-test data set from an external evaluation of their program, just as I was concluding the post-test data collection. I was hired to provide an external evaluation (with contract). I am a small evaluation firm, a sole proprietor, and I did expect to provide them with all of the data after the conclusion of the study (after the evaluation reports are submitted and approved and final payment is received). I was hired to conduct the evaluation based on a federally funded grant that requires an evaluation, but not necessarily an external evaluation. The external evaluation was part of their accepted application to the federal agency. One other note, the director who hired me has recently resigned and the program coordinator with whom I have been working with now for over a year, was hired to replace the director.

The back story is that they planned to increase their research capacity, which I supported, and consequently, hired a very competent research analyst, who now has the time and competence to conduct their own internal evaluation. Without getting into the politics and personalities, which, I acknowledge plays an important part in this little drama, I am curious about the approach and opinions of other evaluators who may visit this blog.

We live in an urban environment in the Northeast where the poor outcomes of children in public education is a very serious matter, and the stakes are high for the program and the agency which runs the program. The agency has a very positive reputation in the community. With one year left on the evaluation, and with the limited structure of my research firm, I am tempted to "collaborate" (assuming I have a choice in this matter), and hand over the pre-test data set to the in-house evaluator for preliminary analyses. (There are many sub-evaluation questions we planned for in which in-house data and external data would be combined anyway.) But I also am obligated to protect the agency and program from potential criticism of the results of the study, in light of the challenge to objectivity that may emerge from an arrangement in which the in-house evaluator has prior access to pre-test data.

Assuming for a moment that the contract allowed or was passive on data access and integrity, what advice would you offer, if you were inclined to collaborate with your client. What advice would you offer if you were not so inclined? What safeguards or protections would you impose in a written agreement with your client so that some mutually beneficial compromise would emerge?

I am sending this post to the EVALTALK listserv, and later I will post some of the comments I receive.

Thank you in advance for your feedback.

David