Abstract
Purpose:
We evaluate a smartphone application (app) performing an automated photographic Hirschberg test for measurement of eye deviations.
Methods:
Three evaluation studies were conducted to measure eye deviations in the horizontal direction. First, gaze angles were measured with respect to the ground truth in nonstrabismic subjects (n = 25) as they fixated monocularly on targets of known eccentricity covering an angular range of approximately ±13°. Second, phoria measurements with the app at near fixation (distance = 40 cm) were compared with the modified Thorington (MT) test in normally-sighted subjects (n = 14). Third, eye deviations using the app were compared to a cover test with prism neutralization (CTPN; n = 66) and Synoptophore (n = 34) in strabismic subjects. Regression analyses were used to compare the app and clinical measurements of the magnitude and direction of eye deviations (prism diopters, Δ).
Results:
The gaze angles measured by the app closely followed the ground truth (slope = 1.007, R2 = 0.97, P < 0.001), with a root mean squared error (RMSE) of 2.4Δ. Phoria measurements with the app were consistent with MT (slope = 0.94, R2 = 0.97, P < 0.001, RMSE = 1.7Δ). Overall, the strabismus measurements with the app were higher than with Synoptophore (slope = 1.15, R2 = 0.91, P < 0.001), but consistent with CTPN (slope = 0.95, R2 = 0.95, P < 0.001). After correction of CTPN values for near fixation, the consistency of the app measurements with CTPN was improved further (slope = 1.01).
Conclusions:
The app measurements of manifest and latent eye deviations were consistent with the comparator clinical methods.
Translational Relevance:
A smartphone app for measurement of eye alignment can be a convenient clinical tool and has potential to be beneficial in telemedicine.
The results of the in-lab and clinical evaluation showed that through its various operating modes, the EyeTurn app measurements are repeatable (95% CI of within-subject HR differences = ± 1.57Δ), accurate with respect to the ground-truth (average RMSE of 2.5Δ for eye deviation measurements), and generally consistent with the commonly used clinical methods, such as the CTPN test, MT with red Maddox rod, or Synoptophore (slope of regression lines is close to 1). For strabismus measurements, CTPN generally is considered the clinical gold standard. While the app measurements were consistent with it, there are some important underlying issues related to use of prisms and the app for measuring eye deviations that must be considered when comparing the two methods.
The first issue is related to measurements with prisms at near fixation (the app and CTPN measurements were obtained at near fixation). At near fixation, the distance between the prism and the center of rotation of the eye becomes a factor affecting the magnitude of the prism power required for neutralization.
22 The actual prism power required for neutralization is larger than the true deviation as the distance between the prism and center of rotation of the eye increases. It should be noted that no such limitation exists for the use of the app at near fixation. Since there always is a finite distance between the center of rotation of the eye and the physical location of the prism (approximately back vertex distance + half of axial length), it leads to an overestimation of deviation when neutralizing at near fixation. After this error is corrected, CTPN and app measurements become even more consistent (slope becomes 1.01). It should be noted that precise measurement of the distance between the eye and prism was not possible in actual clinical testing, and the above compensation was based on average prism-to-eye distance for all subjects while assuming that the fixation distance was constant. While there was a good agreement between the overall app and CTPN measurements, individual differences existed (6.8Δ root mean squared difference). While CTPN may be the clinical gold standard for eye deviation measurement, it cannot be considered as ground-truth. Hence, the variability comes from the app and the CTPN, especially when measuring a diverse population including cases of intermittent strabismus. Here, we limited the discussion to the probable causes of error within the app that might lead to differences with respect to CTPN.
One possible source of error in the app measurements is the use of a population average HR value for computing the deviation (HR value of 19.26Δ/mm corresponding to the mean of 25 normally sighted adult subjects tested in the eye-deviation study in the lab). Normally, we would expect some variance in the HR values in a randomly sampled population, which would lead to noise in the estimates around the mean, but the mean itself should not change considerably (for example, larger error bars around the mean in
Fig. 5, Left). Hence, use of population average HR can lead to an error in individual measurements (
Fig. 5, Right). However, at lower deviation magnitudes (<15Δ), use of the population average HR has a relatively low impact on accuracy (both curves overlap at lower angles before diverging for larger angles in
Fig. 5, Right). Even at the highest measured deviation magnitude (23Δ), the difference between RMSE for the population average HR and individual HR curves is approximately 1Δ, indicating that the difference is small compared to the measured magnitude. Thus, the app is more accurate in lower angular ranges where it needs to be more accurate to reliably measure small angle strabismus, and the decrease in the accuracy at higher deviations is still comparable with the resolution of measurement offered by the prism bar, which is currently the clinical gold standard. In the context of providing prism correction for strabismic individuals, the accuracy of the app at lower angle deviations is important as 10Δ power is considered the upper range of feasible prism prescription (weight and aberration are problematic at higher values). Even for higher prism values the app provides a good starting point for trialing prism lenses, which can then be refined.
HR for an individual depends on two factors: the corneal curvature and anterior chamber depth.
16,24,25 It is likely that there are age-, sex-, or ethnicity-related differences in HR values. Ethnicity-related differences in corneal curvature
26–28 and anterior chamber depth,
29 age-related differences in anterior chamber depth,
30 and sex-related differences in the corneal curvature
31 have been reported. While overall our app measurement closely matched CTPN measurements for our study population, the HR value used in the app could be customized for a given individual or population in the future (for example, when using the app for screening children of a particular race), if sound biometric data are available. This is future work as we further tune the app for use in diverse scenarios.
We included comparisons of app measurements with Synoptophore as it also is an accepted clinical method for strabismus measurement in addition to or instead of CTPN. On average, the app measurements were higher than Synoptophore measurements (slope of line fitting = 1.15). A possible reason for this discrepancy could be the differences in the setup of Synoptophore measurements (taken with far fixation targets) compared to the app (near fixation). The measurement setup of Synoptophore may result in an increase in the measured angle in subjects with esotropia and a decrease in the case of exotropia.
32–34 In our study population of strabismic subjects, we had more subjects with exotropia than esotropia, which may result in relatively smaller deviations with Synoptophore compared to the EyeTurn app.
With phoria measurements, our aim was to determine if the alternating cover test method with the video recording mode of the app can detect eye deviations in dissociated conditions. Since some amount of phoria is present even in nonstrabismic individuals, this allowed app evaluation in obtaining clinically meaningful eye deviation measurements. The MT method has been more reliable/repeatable than other phoria measurement methods
35 and the app measurements were consistent with it. The app measurements were slightly more repeatable than MT (95% CI of within subject differences ± 2.3Δ with the app compared to ± 2.8Δ for MT).
The EyeTurn app presented in this study is an early prototype that is undergoing further development. Thus, the app and preliminary evaluation studies presented here have some limitations. In this study, we evaluated the ability of the app to measure eye alignment only at near fixation distances, in primary gaze, and only along horizontal direction. We also did not evaluate the effect of glasses on the accuracy of the app. Since the evaluation was limited to assessing the baseline ability of the app with commonly used clinical examinations, this study did not test any special or complicated patient cases. Future studies will involve evaluation of an updated version of the app to address the above issues.
The EyeTurn app has many unique features and differences compared to existing devices for strabismus detection and/or measurement, such as photoscreeners (Spot, Plusoptix, iScreen, Volk Eye Check),
14 vision screeners for detecting amblyogenic factors,
36 and vision screening mobile apps (GoCheckKids
37). First, it is self-contained within a conventional smartphone and does not require any external accessories or smartphone attachments for measurement. Second, it provides an objective measure of strabismus in terms of prism diopters without requirement of any explicit calibration or tightly controlled measurement conditions. Third, the app uses a semi-automated video analysis mode to enable dissociated measurements in intermittent strabismus and phoria; thus, combining the aspects of traditional cover testing with photographic Hirschberg method. In conclusion, the results showed that the app can reliably measure binocular and dissociated eye deviations in the horizontal direction and the app measurements are consistent with the clinical gold standard.
Supported by the National Eye Institute (Bethesda, MD; NIH SBIR R43EY025902) and by the Mass Eye & Ear Curing Kids Grant.
Disclosure: S. Pundlik, EyePhone, LLC (I), Mass Eye & Ear (P); M. Tomasi, EyePhone, LLC (I), Mass Eye & Ear (P); R. Liu, None; K. Houston, EyePhone, LLC (I), Mass Eye & Ear (P); G. Luo, EyePhone, LLC (I), Mass Eye & Ear (P)