While working on a new project, I did a preliminary analysis of pre- and post-reading test scores sent to me by examiners in 5 different sites. I ran frequencies and descriptives for each time period and noticed a large difference in only one site out of the 5. I decided to include this preliminary information in a progress report and asked the question - Did Xsite use a different test during this period? No, was the response. She checked on it and found that the one site with much lower scores had reported the data as standardized grade-level scores, not raw scores!
I typically don't report means and frequencies prior to the first draft of the report, but this example has me thinking. I have avoided a problem early on by deciding to sent the preliminary results. But I also wonder, what future problem have I created, if any? Time will tell as this evaluation case example unfolds.
No comments:
Post a Comment