When Two Coaches Apply the Same Sales Scorecard Differently
Two coaches can use the same scorecard and still mean different things by a criterion. Before treating their ratings as a fair comparison of representatives, examine how each reviewer applies the wording to the same evidence. The first useful question may concern the evaluation rule rather than the learner’s performance.
Use the same independently fictional exercise
Choose one short practice response and one criterion, keeping private calls and customer records out of the exercise. Have each reviewer identify the relevant observed behavior and explain the rating independently before comparing notes. This is not a test of whether the coaches agree about everything. It is a way to see whether the criterion can be applied as intended without silently relying on different definitions.
Locate the reason for the disagreement
Compare the evidence each person selected. One reviewer might reward asking a question, while another expects the representative to check the meaning of the answer. Decide whether the disagreement concerns the criterion’s wording, an example of acceptable behavior or the interpretation of what happened. Do not erase a difference simply by averaging the ratings. An agreed number would not, by itself, explain what the representative should practice next.
Clarify the rule before using it more widely
Write a more specific description or a bounded example where necessary, then check that both reviewers understand the revision. Keep the original exercise and judgments distinct from any later re-review. A clearer shared rule supports a more useful coaching discussion without proving that the score predicts real sales results. This is general team practice, not a claim that CloseRail includes reviewer calibration, a validated scoring system or a particular ranking or performance-measurement feature.
Copyable worksheet
Use one row for each field. Mark unknown information clearly and retain the original records.
| Field | Your note |
|---|---|
| One fictional response being reviewed | ____________________ |
| Exact criterion and intended behavior | ____________________ |
| Evidence each reviewer selected | ____________________ |
| Reason for any rating disagreement | ____________________ |
| Clarified rule and separate re-review | ____________________ |
Worked example
Illustrative example: two fictional coaches rate a practice reply under a checks-understanding criterion. One counts a question; the other looks for confirmation of the answer’s meaning. They clarify the criterion before using the ratings for comparison, rather than treating the disagreement as proof that the representative’s ability changed between reviews.