Skip to main content

Table 3 Inter-rater agreement on regulatory problems assessed with The Baby-DIPS (N = 132)

From: Inter-rater reliability and acceptance of the structured diagnostic interview for regulatory problems in infancy

Regulatory problems Frequencies
(Rater 1/Rater 2)
−/− −/+
+/− +/+
Estimated prevalence
(%)
Total agreement (%) Cohen’s kappa (SE) Yule’s Y ICC (95 % CI)
Current feeding 130 1 1.5 (1.14) 99.2 0.41 (0.26–0.54)
0 1
Sleeping I (settling at bedtime) 121 3 8 (6.06) 95.5 0.60 (0.15)* 0.78 0.73 (0.64–0.80)
3 5
Sleeping II (throught the night) 105 1 24 (18.18) 95.5 0.85 (0.06)*** 0.91 0.90 (0.86–0.93)
5 1
Severe form of sleeping II 111 2 17.5 (13.26) 94.7 0.77(0.08)*** 0.85 0.86 (0.80–0.90)
5 5
Excessive crying 130 0 2 (1.52) 100 1.0
0 2
No diagnosis 28 7 99 (75.0) 92.4 0.80 (0.06)*** 0.84
3 94
Lifetime feeding 129 1 2.5 (1.89) 99.2 0.80***
(0–3 × 10−4)
0.67 (0.56–0.75)
0 2
Sleeping I (settling at bedtime) 108 2 21 (15.91) 95.5 0.83 (0–3 × 10−4)*** 0.88 0.92 (0.89–0.94)
4 18
Sleeping II (throught the night) 87 3 42.5 (32.2) 96.2 0.91 (0–3 × 10−4)*** 0.92 0.95 (0.94–0.97)
2 40
Severe form of sleeping II 97 4 31.5 (23.86) 94.7 0.85 (0–3 × 10−4)*** 0.88 0.93 (0.90–0.95)
3 28
Excessive crying 106 0 26.5 (20.08) 100 0.98 (0–3 × 10−4)*** 0.97 (0.95–0.98)
1 26
No diagnosis 65 5 64.5 (48.86) 96.2 0.92 (0–3 × 10−4)***
0 62
  1. Where estimated prevalences do not equal or exceed 10 of the total observations (displayed in parentheses), kappa coefficients may underestimate agreement. Kappa coefficients are not calculated if no disorder is identified by at least one rater. Yule’s Y coefficients are incalculable if either cell frequency of the contingency tables equals zero. Significance of the kappa coefficients was determined with χ2-exact tests. Intra class coefficients (ICC) were calculated with a two-way mixed model, interpreting the single measure of the coefficients. Significance of the intra-class coefficients was detected with F-tests
  2. * p < 0.05; ** p < 0.01; *** p < 0.001