Table 3 Inter-rater reliability of the PIR-GAS: empirical results
Reference | Rater qualification | Sample | Material and setting | Procedure | Inter-rater reliability |
|---|---|---|---|---|---|
[9] | A trained child psychiatrist and a clinical psychologist. | 15 clinically referred children who were younger than 36 months. | The material and setting used for the PIR-GAS ratings were not further described. | Inter-rater-agreement of 92% for relationships diagnoses. | |
[14] | Trained experts with postgraduate certification in child and adolescent psychiatry, clinical experience. | 18 children of a normal population (approximately 18 months old). Fifty percent of these children were at-risk. Among these 18 children, there were two cases with a relationship disorder. | The PIR-GAS rating was based on reviewing the case material, which included a ten-minute videotaped interaction situation. | Examination of the test-retest reliability of the PIR-GAS within a time span of 3 to 12 months. Binary outcomes (PIR-GAS <40 and >40) were compared. | The inter-rater agreement was 100% (kappa = 1), and a test-retest reliability of kappa = 1 was reported. |
[19] | Two independent and blinded raters. Not further defined. | 53 children (29 boys, 24 girls), 20 months old; mothers with low socio-economic status. | 10-minute videotaped interactions between the mother and infant that contained a free play session in a laboratory playroom with a standard set of toys. | Ratings included the following dimensions: ‘behavioral quality of the interaction’, ‘affective tone’, ‘psychological involvement’. | Inter-rater reliability was r = .83 (statistic not further defined). Mean score differences between the raters were not reported. |
A therapist and an independent psychologist. | 75 children who were younger than 18 months and whose mothers were worried about them. | Ratings were based on the interaction between the child and the mother during the interview (from which a ten-minute videotape excerpt was used), as well as on the basis of information provided by the mother. | The first rater uses the interview and information by the mother. The second rater rated 20 pre- and post-treatment interviews (10-minute- videotapes). | Intraclass correlations were r = .90 at admission and r = .86 at discharge. Outcome analyses used rater means. |