Skip to main content

Table 3 Inter-rater agreement on regulatory problems assessed with The Baby-DIPS (N = 132)

From: Inter-rater reliability and acceptance of the structured diagnostic interview for regulatory problems in infancy

Regulatory problems

Frequencies

(Rater 1/Rater 2)

−/− −/+

+/− +/+

Estimated prevalence

(%)

Total agreement (%)

Cohen’s kappa (SE)

Yule’s Y

ICC (95 % CI)

Current feeding

130

1

1.5 (1.14)

99.2

–

–

0.41 (0.26–0.54)

0

1

Sleeping I (settling at bedtime)

121

3

8 (6.06)

95.5

0.60 (0.15)*

0.78

0.73 (0.64–0.80)

3

5

Sleeping II (throught the night)

105

1

24 (18.18)

95.5

0.85 (0.06)***

0.91

0.90 (0.86–0.93)

5

1

Severe form of sleeping II

111

2

17.5 (13.26)

94.7

0.77(0.08)***

0.85

0.86 (0.80–0.90)

5

5

Excessive crying

130

0

2 (1.52)

100

–

–

1.0

0

2

No diagnosis

28

7

99 (75.0)

92.4

0.80 (0.06)***

0.84

–

3

94

Lifetime feeding

129

1

2.5 (1.89)

99.2

0.80***

(0–3 × 10−4)

–

0.67 (0.56–0.75)

0

2

Sleeping I (settling at bedtime)

108

2

21 (15.91)

95.5

0.83 (0–3 × 10−4)***

0.88

0.92 (0.89–0.94)

4

18

Sleeping II (throught the night)

87

3

42.5 (32.2)

96.2

0.91 (0–3 × 10−4)***

0.92

0.95 (0.94–0.97)

2

40

Severe form of sleeping II

97

4

31.5 (23.86)

94.7

0.85 (0–3 × 10−4)***

0.88

0.93 (0.90–0.95)

3

28

Excessive crying

106

0

26.5 (20.08)

100

0.98 (0–3 × 10−4)***

–

0.97 (0.95–0.98)

1

26

No diagnosis

65

5

64.5 (48.86)

96.2

0.92 (0–3 × 10−4)***

–

–

0

62

  1. Where estimated prevalences do not equal or exceed 10 of the total observations (displayed in parentheses), kappa coefficients may underestimate agreement. Kappa coefficients are not calculated if no disorder is identified by at least one rater. Yule’s Y coefficients are incalculable if either cell frequency of the contingency tables equals zero. Significance of the kappa coefficients was determined with χ2-exact tests. Intra class coefficients (ICC) were calculated with a two-way mixed model, interpreting the single measure of the coefficients. Significance of the intra-class coefficients was detected with F-tests
  2. * p < 0.05; ** p < 0.01; *** p < 0.001