You will be required to submit feedback from your review of each criterion. Feedback is valuable for a number of reasons, including the following ways.
Appeals: Providers who are not approved in the initial round of reviews are eligible to participate in an appeal. Appeal applications are comprised of revised or repositioned evidence supplied for any criterion for which the provider did not receive a full point from any one of the reviewers of the original application. Appellant providers then are highly dependent upon feedback from their initial reviews as it indicates the success and/or shortcomings of the originally-supplied evidence. If an aspect of their evidence is cited as not adequately demonstrating the criteria, they will be better-poised to make appropriate adjustments to their appeal evidence.
Read more about the appeals process, here.
Discussion protocol/common understanding: Each reviewer will be asked to share their feedback when participating in the review discussion protocol. Detailed feedback will allow other reviewers to possibly identify aspects of evidence they did not appreciate on their initial review, creating a shared understanding across the team of reviewers of the evidence supplied by the provider. Often in the protocol discussions, reviewers are asked to identify where exactly they found evidence or why exactly they didn't see the supplied evidence as demonstrative of a given criterion.
Provider improvement: A peripheral, yet real, benefit to a provider's participation in OSPI's approval process is the opportunity for change. OSPI's approval criteria are based on nationally recognized standards of high quality; feedback given to a provider who has fallen short of a standard can be used by the provider to improve the quality of their offerings and the quality of online learning, in general.
Post-review data analysis of the criteria: After each approval cycle, DLD staff examine the scoring trends of each criterion to identify those in need of possible revision. Reviewer feedback enables us to identify when a low-scoring pattern should be attributed to either: 1) the quality of the criteria language, 2) the quality of the provider's evidence, or 3) the quality of the provider, in general.
As such, feedback helps us to offer an explanation for any proposed criteria changes or to further substantiate any decision to decline approval.
Leaving useful feedback
Given the ways in which your feedback will be used by the provider, by your co-reviewers, and by the DLD, you should be mindful of the usefulness of your feedback.
Some things to consider:
- Read your comments as though you are the provider: Would you, if you were the provider, understand your kudos? Your concerns? When possible, make specific references to the supplied evidence and to the language of the criteria.
- Read your comments as though you were trying to relocate the evidence you are citing: If you scored an item with a full point, cite where you found evidence, making specific reference to its location so that other reviewers who did not note the evidence may find it.