Behaviorally anchored rating scales

Behaviorally anchored rating scales (BARS) are scales used to rate performance. BARS are normally presented vertically with scale points ranging from five to nine. It is an appraisal method that aims to combine the benefits of narratives, critical incidents, and quantified ratings by anchoring a quantified scale with specific narrative examples of good, moderate, and poor performance.^[1]

Background

BARS were developed in response to dissatisfaction with the subjectivity involved in using traditional rating scales such as the graphic rating scale.^[2] A review of BARS concluded that the strength of this rating format may lie primarily in the performance dimensions which are gathered rather than the distinction between behavioral and numerical scale anchors.^[3]

Benefits of BARS

BARS are rating scales that add behavioral scale anchors to traditional rating scales (e.g., graphic rating scales). In comparison to other rating scales, BARS are intended to facilitate more accurate ratings of the target person's behavior or performance. However, whereas the BARS is often regarded as a superior performance appraisal method, BARS may still suffer from unreliability, leniency bias and lack of discriminant validity between performance dimensions.^[3][4]

Developing BARS

BARS are developed using data collected through the critical incident technique,^[5] or through the use of comprehensive data about the tasks performed by a job incumbent, such as might be collected through a task analysis. In order to construct BARS, several basic steps, outlined below, are followed.

1. Examples of effective and ineffective behavior related to job are collected from people with knowledge of job using the critical incident technique. Alternatively, data may be collected through the careful examination of data from a recent task analysis.
2. These data are then converted into performance dimensions. To convert these data into performance dimensions, examples of behavior (such as critical incidents) are sorted into homogeneous groups using the Q-sort technique. Definitions for each group of behaviors are then written to define each grouping of behaviors as a performance dimension
3. A group of subject matter experts (SMEs) are asked to re-translate the behavioral examples back into their respective performance dimensions. At this stage the behaviors for which there is not a high level of agreement (often 50–75%) are discarded while the behaviors which were re-translated back into their respective performance dimensions with a high level of SME agreement are retained. The re-translation process helps to ensure that behaviors are readily identifiable with their respective performance dimensions.
4. The retained behaviors are then scaled by having SMEs rate the effectiveness of each behavior. These ratings are usually done on a 5- to 9-point Likert-type scale.
5. Behaviors with a low standard deviation (for examples, less than 1.50) are retained while behaviors with a higher standard deviation are discarded. This step helps to ensure SME agreement about the rating of each behavior.
6. Finally, behaviors for each performance dimensions, all meeting re-translation and criteria, will be used as scale anchors.

See also

• Industrial and organizational psychology

References

1. Management of Human Resources, Gary Dessler^{[page needed][full citation needed]}
2. Smith, Patricia Cain; Kendall, L. M. (1963). "Retranslation of expectations: An approach to the construction of unambiguous anchors for rating scales". Journal of Applied Psychology. 47 (2): 149–55. doi:10.1037/h0047060.
3. Schwab, Donald P.; Heneman, Herbert G.; Decotiis, Thomas A. (1975). "Behaviorally Anchored Rating Scales: A Review of the Literature". Personnel Psychology. 28 (4): 549–62. doi:10.1111/j.1744-6570.1975.tb01392.x.
4. Kingstrom, Paul O.; Bass, Alan R. (1981). "A Critical Analysis of Studies Comparing Behaviorally Anchored Rating Scales (Bars) and Other Rating Formats". Personnel Psychology. 34 (2): 263–89. doi:10.1111/j.1744-6570.1981.tb00942.x.
5. Flanagan, John C. (1954). "The critical incident technique". Psychological Bulletin. 51 (4): 327–58. doi:10.1037/h0061470. PMID 13177800. S2CID 30937373.

Further reading

• Martin-Raugh, Michelle; Tannenbaum, Richard J.; Tocci, Cynthia M.; Reese, Clyde (2016). "Behaviorally anchored rating scales: An application for evaluating teaching practice". Teaching and Teacher Education. 59: 414–9. doi:10.1016/j.tate.2016.07.026.
• Konak, Abdullah; Magluilo, Steven; Kulturel-Konak, Sadan (2016). Behaviorally anchored rating scales for teamwork peer assessment. 2016 IEEE Integrated STEM Education Conference. pp. 168–72. doi:10.1109/ISECon.2016.7457525. ISBN 978-1-4673-9773-5.
• Ohland, M. W.; Loughry, M. L.; Woehr, D. J.; Bullard, L. G.; Felder, R. M.; Finelli, C. J.; Layton, R. A.; Pomeranz, H. R.; Schmucker, D. G. (2012). "The Comprehensive Assessment of Team Member Effectiveness: Development of a Behaviorally Anchored Rating Scale for Self- and Peer Evaluation". Academy of Management Learning & Education. 11 (4): 609–30. doi:10.5465/amle.2010.0177. S2CID 34593005.