To determine the interobserver agreement of history and physical examination findings in children undergoing evaluation in the emergency department (ED) for headaches.

We conducted a prospective, cross-sectional study of children aged 2-17 years evaluated at 3 tertiary-care pediatric EDs for non-traumatic headaches. Two clinicians independently completed a standardized assessment of each child and documented the presence or absence of history and physical examination variables. Unweighted κ statistics were determined for 68 history and 24 physical examination variables.

We analyzed 191 paired observations; median age was 12 years, with 19 (9.9%) children younger than 7 years. Interrater reliability was at least moderate (κ ≥ 0.41) for 41 (60.3%) patient history variables. Eleven (61.1%) of 18 physical examination variables for which κ statistics could be calculated had a κ that was at least moderate.

A substantial number of history and physical examination findings demonstrated at least moderate κ statistic values when assessed in children with headaches in the ED. These variables may be generalizable across different types of clinicians for evaluation of children with headaches. If also found to predict the presence or absence of emergent intracranial abnormalities, the more reliable clinical findings may be helpful in the development of clinical prediction rules or risk stratification models that could be used across settings for children with headaches.