What Is Interobserver Agreement In Psychology

Behaviouralists have developed a sophisticated method for assessing changes in behaviour that depend on accurate measurement of behaviour. Direct observation of behaviour is traditionally one of the carriers of behavioural measurement. Therefore, researchers need to address psychometric properties, such as the .B the Interobserver Agreement, of observational measures to ensure a reliable and valid measurement. Of the many indices of the Interobserver agreement, the percentage of the agreement is the most popular. Its use persists despite repeated reminders and empirical evidence that suggests that it is not the most psychometric statistic that determines interobserver agreement because of its inability to take into account chance. Cohens Kappa (1960) has long been proposed as a more psychometric statistic for the evaluation of the Interobserver agreement. Kappa is described and calculation methods are presented. Fiss, J. L. (1971). Measure of the scale rated correspondence between many advisors.

Psychological Bulletin, 76, 378-382. J. Cohen: Cohen. A coefficient of agreement for nominal scales. Educational and psychological measure, 20, 37-46. Langenbucher, J., Labouvie, E., Morgenstern, J. (1996). Methodological evolution: measurement of the diagnostic agreement. Journal of Consulting and Clinical Psychology, 64, 1285-1289. Landis, J.

R., Koch, G. G. (1977). The measure of the compliance agreement for categorical data. Biometrics, 33, 159-174. Hartmann, D. P. (1977, Spring). Reflections in the choice of the reliability estimates of inter-observers. Journal of Applied Behavior Analysis, 10, 103-116. Cicchetti, D. V.

(1994). Guidelines, criteria and ground rules for evaluating standardized and standardized assessment instruments in psychology. Psychological assessment, 6, 284-290. Berk, R. A. (1979). Generalization of behavioural observations: a clarification of the Interobserver agreement and the reliability of the inter-observer. American Journal of Mental Deficiency, 83, 460-472. Suen, H. K., Lee, P.S. (1985).

Impact of the use of a percentage agreement on behavioural observation: a reassessment. Journal of Psychopathology and Behavioral Assessment, 7, 221-234. Shrout, P.E., Spitzer, R. L., & Fleiss, J.