Skip to main content

Table 3 Inter-rater reliability of the PIR-GAS: empirical results

From: Inter-rater reliability and aspects of validity of the parent-infant relationship global assessment scale (PIR-GAS)

Reference Rater qualification Sample Material and setting Procedure Inter-rater reliability
[9] A trained child psychiatrist and a clinical psychologist. 15 clinically referred children who were younger than 36 months. The material and setting used for the PIR-GAS ratings were not further described.   Inter-rater-agreement of 92% for relationships diagnoses.
[14] Trained experts with postgraduate certification in child and adolescent psychiatry, clinical experience. 18 children of a normal population (approximately 18 months old). Fifty percent of these children were at-risk. Among these 18 children, there were two cases with a relationship disorder. The PIR-GAS rating was based on reviewing the case material, which included a ten-minute videotaped interaction situation. Examination of the test-retest reliability of the PIR-GAS within a time span of 3 to 12 months. Binary outcomes (PIR-GAS <40 and >40) were compared. The inter-rater agreement was 100% (kappa = 1), and a test-retest reliability of kappa = 1 was reported.
[19] Two independent and blinded raters. Not further defined. 53 children (29 boys, 24 girls), 20 months old; mothers with low socio-economic status. 10-minute videotaped interactions between the mother and infant that contained a free play session in a laboratory playroom with a standard set of toys. Ratings included the following dimensions: ‘behavioral quality of the interaction’, ‘affective tone’, ‘psychological involvement’. Inter-rater reliability was r = .83 (statistic not further defined). Mean score differences between the raters were not reported.
[20, 21] A therapist and an independent psychologist. 75 children who were younger than 18 months and whose mothers were worried about them. Ratings were based on the interaction between the child and the mother during the interview (from which a ten-minute videotape excerpt was used), as well as on the basis of information provided by the mother. The first rater uses the interview and information by the mother. The second rater rated 20 pre- and post-treatment interviews (10-minute- videotapes). Intraclass correlations were r = .90 at admission and r = .86 at discharge. Outcome analyses used rater means.
  1. Comment: We do not intend to understate the studies cited here, but have chosen them to describe the different procedures that have been used to conduct a PIR-GAS rating. We do recognize that the main intentions of these four studies were not reliability research.