Based upon the recommendation of our National Advisory Committee, the Buros Center for Testing has instituted a policy of making available to test publishers advance copies of test reviews for upcoming editions of The Mental Measurements Yearbook. The Buros Center sends reviews to test publishers who request them after all routine communications with the reviewer have been completed and after the reviewer has signed off on the acceptability of the test review. In our letters to test publishers, we specify that we are seeking only their input regarding the factual accuracy of the reviews and are not soliciting approval of the review’s content or the reviewer's opinion. We have found this practice, for the most part, works well. However, in the process of examining the reviews, test publishers occasionally identify factual errors. Typically, these errors are minor.
We employ several mechanisms to reduce the possibility of factual errors. Our graduate research assistants check each statement of fact made by test reviewers against the information contained in the test manual and other test materials. In addition, the editors examine each review after factual statements have been substantiated by the graduate assistants. Even with these steps in place, there have been a few instances where a reviewer has made a serious error of fact. The editors evaluate comments received from the test publisher and determine whether the review needs further editing to address material facts. If so, the revision typically requires some minor word changes or the removal of a sentence or two from the review. It is our goal to keep at a minimum any such changes to already completed reviews. In those rare instances when a change is considered substantial, our policy is to communicate with the reviewer about the proposed change and seek the reviewer's consent to implement the change.
The Buros Center for Testing values the commitment and independence of the professionals who serve as test reviewers. We embrace policies and procedures that respect the integrity of reviewers' opinions while at the same time respecting the time they devote to the review process. If you would like an opportunity to comment on this policy, please contact the Director at: kgeisinger@buros.org.
Kurt Geisinger, Director
Buros Center for Testing