Open Access
Retina  |   June 2024
Development and Validation of Performance-Based Assessment of Daily Living Tasks in Age-Related Macular Degeneration
Author Affiliations & Notes
  • Anna C. S. Tan
    Singapore National Eye Centre, Singapore, Singapore
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Claire L. Peterson
    Singapore National Eye Centre, Singapore, Singapore
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Hla M. Htoon
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Lynn L. Y. Tan
    Singapore National Eye Centre, Singapore, Singapore
  • Yanwen Tan
    Singapore General Hospital, Singapore, Singapore
  • Kai Ting Sim
    Singapore National Eye Centre, Singapore, Singapore
  • Lisa Ong
    Singapore National Eye Centre, Singapore, Singapore
  • Zhen K. Tan
    Singapore National Eye Centre, Singapore, Singapore
  • Shih H. Heng
    Singapore General Hospital, Singapore, Singapore
  • Ian Y. S. Yeo
    Singapore National Eye Centre, Singapore, Singapore
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Tien Y. Wong
    Singapore National Eye Centre, Singapore, Singapore
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Gemmy Cheung
    Singapore National Eye Centre, Singapore, Singapore
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Ryan Man
    Singapore National Eye Centre, Singapore, Singapore
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Eva K. Fenwick
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
  • Ecosse Lamoureux
    Singapore Eye Research Centre, Singapore, Singapore
    Duke-NUS Medical School, Singapore, Singapore
    University of Melbourne, Melbourne, Australia
  • Correspondence: Anna CS Tan, Singapore National Eye Centre, Singapore, 11 Third Hospital Avenue, Singapore 168751, Singapore. e-mail: annacstanwrk@gmail.com 
Translational Vision Science & Technology June 2024, Vol.13, 9. doi:https://doi.org/10.1167/tvst.13.6.9
  • Views
  • PDF
  • Share
  • Tools
    • Alerts
      ×
      This feature is available to authenticated users only.
      Sign In or Create an Account ×
    • Get Citation

      Anna C. S. Tan, Claire L. Peterson, Hla M. Htoon, Lynn L. Y. Tan, Yanwen Tan, Kai Ting Sim, Lisa Ong, Zhen K. Tan, Shih H. Heng, Ian Y. S. Yeo, Tien Y. Wong, Gemmy Cheung, Ryan Man, Eva K. Fenwick, Ecosse Lamoureux; Development and Validation of Performance-Based Assessment of Daily Living Tasks in Age-Related Macular Degeneration. Trans. Vis. Sci. Tech. 2024;13(6):9. https://doi.org/10.1167/tvst.13.6.9.

      Download citation file:


      © ARVO (1962-2015); The Authors (2016-present)

      ×
  • Supplements
Abstract

Purpose: To establish the reliability and validity of five performance-based activities of daily living task tests (ADLTT), to correlate structure to function, to evaluate the impact of visual impairment (VI) on age-related macular degeneration (AMD), and to develop new outcome measures.

Methods: A multidisciplinary team developed five ADLTTs: (1) reading test (RT); (2) facial expression (FE) recognition; (3) item search (IS) task; (4) money counting (MC) task; and (5) making a drink (MD), tested with binocular and monocular vision. ADLTTs were tested for known-group (i.e., difference between AMD group and controls) and convergent (i.e., correlation to other measures of visual function), validity metrics, and test-retest reliability in 36 patients with VI (visual acuity (logMAR VA > 0.4) in at least one eye caused by AMD versus 36 healthy controls without VI.

Results: Compared to controls, AMD patients had a slower reading speed (−77.41 words/min; P < 0.001); took longer to complete MC using monocular worse eye and binocular vision (15.13 seconds and 4.06 seconds longer compared to controls, respectively; P < 0.001); and MD using monocular worse eye vision (9.37 sec; P = 0.033), demonstrating known-group validity. Only RT and MC demonstrated convergent validity, showing correlations with VA, contrast sensitivity, and microperimetry testing. Moderate to good test-retest reliability was observed for MC and MD (interclass correlation coefficient = 0.55 and 0.77; P < 0.001) using monocular worse eye vision.

Conclusions: Real-world ADL functioning associated with VI-related AMD can be assessed with our validated ADLTTs, particularly MC and MD.

Translational Relevance: This study validates visual function outcome measures that are developed for use in future clinical practice and clinical trials.

Introduction
Age-related macular degeneration (AMD) is the leading cause of irreversible visual impairment (VI) in older people.1,2 Outcomes in clinical trials have mostly focused on assessing visual function by use of visual acuity (VA). Studies in AMD patients have also shown that VA does not reflect the impact of VF loss on activities of daily living (ADL) function38 and the significant implications for the patient and their caregivers. 
The assessment of ADL functioning is not routinely performed as an outcome measure in AMD in clinical practice,9 and in those that have, assessed ADL function used patient-reported outcome measures (PROMs).3,5 PROMs may be affected by the individual's disease perception, bias, and interpretation of the questions. Alternatively, patient-centered outcome measures (PCOMs), which are patient performance assessments that can be carried out in clinical settings, provide a more objective assessment of a patient's ADL function.1012 
PCOMs can also be tailored to focus on tasks that have been identified to be important and commonly performed by the target group of patients, such as reading ability in AMD.1315 However, there are other PCOMs, apart from reading ability, that have been used in studies on elderly individuals, low vision populations, and in visual rehabilitation but not specifically in AMD populations.1012,1620 One of these scales, the Melbourne Low-Vision ADL Index has been shown in visually impaired patients to be a reliable, reproducible measure, with good correlation to other visual function measures and good responsiveness to visual rehabilitation.18,21 It consists of 18 performance based items (PCOMs) with more complex ADLs and nine self-reported items related to self-care ADLs.18 Another large study used PCOMs, based on mobility, daily living tasks, and visually intensive tasks such as facial recognition and reading speed that was also developed in 2001 showed that visually intensive tasks were better correlated with milder VI compared to mobility tasks.20 Previous timed instrument ADL performance tests have also been developed to test patients with moderate visual impairment from cataracts.10 
During disease progression in AMD, early disease is associated with mild to moderate VI, progressing in an asymmetrical fashion in either eye to advanced diseases where central vision is affected resulting in central vision loss,2224 leaving peripheral vision intact. Hence, we hypothesize that more visual-intensive, timed PCOMs, are needed to provide a more robust evaluation of real-life VF in patients with AMD when compared to rest of the VI population. Hence, we designed a series of ADL task tests (ADLTT) specifically for AMD patients that can be easily performed and measured in a clinical setting. The primary aim of this study is to determine the psychometric validity of the ADLTTs developed in a clinical sample of AMD patients and healthy controls using the guidance from the COnsensus-based standards for the selection of health Measurement INstruments (COSMIN) risk of bias checklist.25 We also aimed to use the validated ADLTTs as a measure to correlate retina structure and function and also as a potential outcome measure for future AMD studies. 
Methods
Study Design and Setting
This was a cross-sectional study of patients >50 years with AMD and healthy controls, recruited from the outpatient clinic of a single tertiary ophthalmic center (Singapore National Eye Center, Singapore) from January 2017 to December 2020. The inclusion criterion for the AMD group was the diagnosis of AMD in at least one eye with VI for at least six months (logarithm of minimum angle of resolution (LogMAR ≥ 0.4) because of advanced AMD. Controls had no VI or eye disease and attended the retinal outpatient clinic for routine eye screening. 
All participants were able to provide informed consent and had to have normal cognitive function as assessed by the Mini Mental State Exam,26 defined as a score of >25. Exclusion criteria for both groups included any significant media opacity preventing good quality imaging, any other eye disease that would significantly affect VA, and inability to perform functional tests because of a cognitive or physical disability. Physical disability was assessed via observation by the recruiting doctor, with recruited patients needing to have normal mobility, not wheelchair-bound, no obvious tremors or difficulty writing and have the appearance of full function of all their limbs. Ethical approval was obtained from the SingHealth Centralised Institutional Review Board (protocol number R1413/99/2016), and all investigations were conducted in accordance with the Declaration of Helsinki of 1975. Participants provided written informed consent before any study procedures were carried out. 
Study Assessments and Clinical Examination
All study subjects underwent a standard ophthalmic examination and measurement of monocular and binocular unaided visual acuity and best-corrected visual acuity (BCVA) using a LogMAR Chart, and contrast sensitivity (CS) was assessed with the Mars Perceptrix Contrast Test. Monocular microperimetry (MP-3, Nidek, Japan) was performed with a standardized protocol assessing mean retinal sensitivity (MRS) and mean macula sensitivity (MMS). 
Developing the ADLTTs
The ADLTT battery was developed specifically for this study, by an experienced multi-disciplinary group of low vision experts consisting of a group of ophthalmologists, optometrists and occupational therapists (A.T., L.T., K.S., L.O., Z.T., T.Y., J.H.). This team had daily consultations with VI patients with AMD and identified common ADLs that these patients faced. A thorough literature search was performed to identify other already existing PCOM studies.18,20 A survey in AMD patients and normal controls was conducted on how important they rate these specific ADLs, how often they perform the specific identified ADLs, and how they rate their ability to perform these tasks. 
In comparison to the Melbourne Low-Vision ADL Index, which had 18 tasks, we had to compress and prioritize the number of tasks to be feasible for our study protocol. Ten out of the 18 tasks used reading ability, and this was compressed into reading a standardized text. Of the remaining tasks, our proposed ADLTTs included modified versions of the facial recognition, pouring, and identifying coins items. Of the remaining MVAI items, using a landline telephone and writing a bank check were less relevant in our modern society, and items such naming colors, buttoning a shirt, and threading a needle were less frequently performed by our target population compared to the latter tests and, hence, were excluded. We decided to increase the difficulty and complexity of the facial recognition, pouring and identifying coins items, and use the actual recorded timings required to complete the tasks for assessment measures similar to a previous study using timed ADLs(10). This was combined with qualitative ratings based on a Likert scale (0–3) on how independently the patient can complete each step of the tasks as assessed by the administrator (Supplementary Table S1). More detailed qualitative assessments of the individual steps taken to complete these tasks were also included as assessment measures for our proposed ADLTTs (Supplementary Table S1). 
Mobility, although deemed important by our team, was a less visually intensive task,20 less significantly affected in AMD patients and was more difficult to perform, and posed the risks of falls; hence it was not included. Item search had been previously tested in both VI participants16 and also in AMD participants through monitor simulated scene27 and was chosen as an important ADLTT. Our team proposed a more real-life item search task, which was visually intensive, and based on the adaptation a visual search tasks used in patients with homonymous hemianopia.28 
To perform structure-function correlations accurately, we had subjects perform the ADLTTs with both monocular and binocular vision. This is because binocular tests are not available for structural tests but ADL function is carried out with binocular vision. Each of our ADLTTs had to be performed at least twice to assess test-retest reliability, and with either eye occluded for monocular vision and then with binocular vision (3 sets of tests). 
The specific components of the ADLTT are outlined below: 
  • ADLTT (1)- Reading Test (RT) was assessed by reading speed and accuracy using the standardized International Reading Speed Texts (IReST)29 with the subject's own reading aids including the use of a standardized digital magnifier with known magnification. Illiterate subjects were exempt from this investigation but underwent other ADLTTs. This test has had previous validation and was available in both English and Mandarin.
  • ADLTT (2)- Facial Expression recognition (FE) was assessed based on the Warsaw set of emotional facial expressions, a set of high quality digital photographs presented to the subject.30 The number of correctly identified facial expressions and the time taken to identify each facial expression was recorded.
  • ADLTT (3)- Item Search (IS) included 16 standardized, everyday household items presented at a fixed distance, on pre-determined standardized position on the table equidistant apart chosen based on a previous publication.28 Both subject's eyes were first occluded and instructions were given to pick up four specified objects by the task administrator. The timing started from when the relevant eye/eyes were uncovered and the task was complete (timing stopped) when the subject had identified and picked up four items. The number of correct items identified and the time taken for the task completion was recorded.
  • ADLTT (4)- Money Counting (MC) assessed basic recognition of the denominations of local currency by presenting varying denominations of the local currency coins to the subject. The denominations were varied with each subsequent test to vary the total amount and to account for a learning effect, but there was a standardized total number of coins. The time taken to complete this task and the ability to complete each step of the task was graded (Supplementary Table S1).
  • ADLTT (5)- Making a Drink (MD) refers to the multi-step everyday standardized household task of making a drink. The steps include locating items, cup, and drink contents (sachets); pouring drink powder; pouring liquid; and stirring the drink. The time taken to complete this task and the ability to complete each step of the task was graded (Supplementary Table S1).
Conducting the ADLTTs and Administrating Questionnaire
The study team underwent relevant ADLTT training and standardization specific for this study. Subjects performed all tests using BCVA with their best spectacle correction. At each visit, all subjects completed the five ADLTTs monocularly, where one eye was occluded with a patch, and binocularly, in a standardized room under 235 Lux (Amprobe LM-100 Light Meter) of light measured in the center of the room. If fatigue was observed by the administrator at any time, a rest break was given. The patient was also asked periodically if they needed a rest in between testing. Although monocular BCVA through occlusion created an artificial situation that deviates from a real world functioning, it had to be performed in addition to binocular testing to assess convergent validity, which required correlations to microperimetry, that can only be tested monocularly. 
Patient-Reported Outcome Questionnaire Assessment
The validated Impact of Vision Impairment (IVI) questionnaire with Rasch analysis using the Andrich rating scale model with Winsteps software (version 3.91.2),31 was used to measure VRQoL, with scores analyzed overall and in the individual domains of (1) Reading & Accessing Information, (2) Mobility & Independence, and (3) Emotional well-being.2,31,32 
Sample Size Calculations
Sample size calculations were estimated based on the expected mean difference of IReST text reading speed between participants with intermediate AMD (no VA cutoff) and healthy controls was 15 words/min (estimated SD 25).33 A larger mean difference in reading speed was assumed because of our worse VA criteria and more advanced AMD (20 words/min). Assuming a power of 0.80 and a significance of 0.05, giving a minimum sample size of 25 AMD cases and 25 normal controls, an additional 10 participants in each group was planned to improve potential statistical significance of our results for validity testing of the other ADLTTs. 
Validity Testing of the ADLTTs
We planned our validity testing based on a modified version of the COSMIN checklist25 using items of the checklist that were relevant to PCOM assessment (Appendix). The COSMIN checklist was originally developed for use to assess the quality and validity of patient-reported outcome measures; however, previous studies have applied the items of the COSMIN checklist to assess PCOMs in other diseases and contexts.34,35 Areas addressed by our validation study included PCOM development, content validity, cross-cultural validity, reliability and measurement error, convergent and known-group validity. Aspects of PCOM development, content validity, and cross-cultural validity have already been described above. The COSMIN risk of bias checklist only assessed whether the individual standards for psychometric properties were included in the validation process, not whether these psychometric properties were satisfactory. 
All ADLTTs except RT (test-retest reliability already previously established36) were repeated twice (during the same session within three hours) consecutively to assess test-retest reliability and the average readings for each attempts were calculated. For tasks with continuous variable output (time), the interclass correlation coefficient (ICC) was used. For tasks that did not conform to continuous measured assumptions for repeatability such as “ability of tasks” and “number of items identified correctly,” Gwet's AC1 was used. For FE, which was an ordinal measure, a weighted Cohen's Kappa was used. Repeatability was graded as poor < 0.5, moderate = 0.5-0.75, good = 0.75-0.9, excellent > 0.9.37 
Convergent validity was assessed by calculating the Spearman correlation coefficient to determine correlations between mean time taken to complete the various ADLTTs in AMD patients, with monocular and binocular BCVA, CS and monocular MRS and MMS. We hypothesised that all the five ADLTTs would demonstrate at least moderate (0.3 < ρ > 0.7) correlation (low correlation ≤ 0.3, high correlation ≥0.7).38 
Known-group validity was assesed by comparing the ability grading and mean time taken to complete each ADLTT between AMD and control groups. All values were age-adjusted using analysis for covariance. Welch's t-test was used to test for significance of difference in means between the ADLTT groups. Our hypothesis was that significant differences in ADLTTs parameters would be observed between the AMD and control group. 
For most of the ADLTTs proposed, no accepted gold standard exists hence criterion validity was unable to be tested. Responsiveness is assessed based on a longitudinal cohort and was not assessed in this current study, which only analyzes cross-sectional results. 
Statistical Analysis
Statistical analyses were performed using R studio Version 1.1.383 (RStudio, Inc. Boston, MA, USA) and SPSS (Released 2016. IBM SPSS Statistics for Windows, Version 24.0; IBM Corp, Armonk, NY, USA). STATA/SE 16.1 (Statscorp LLC) was used for GWET's AC repeatability testing. For all tests, P values <0.05 were deemed statistically significant. For divergent validity where discrete variables were correlated with continuous variables with the point-biserial correlation, which is mathematically equivalent to the Pearson (product moment) correlation was performed. We determined a cutoff value for poor ADLTT function based on a ninetieth percentile value of the normal healthy controls for quantitative variables such as reading speed, time taken to complete MC and MD. This models a similar analysis done in a previous publication.39 For the qualitative grading scores, we assumed that a healthy control would be able achieve a maximum score at each step of performing MC or MD (independent: experience no difficulty performing tasks safely, accurately and efficiently), hence anything less than the maximum score was deemed poorly functioning. 
Results
We recruited 36 AMD cases and 36 normal controls for this study. Baseline characteristics of AMD participants and healthy controls are presented in Supplementary Table S2. In the AMD group, out of the 36 pairs of eyes, 25 were pseudophakic and in the control group out of 36 pairs of eyes, 35 were pseudophakic. 
Self-reported highest education levels for the AMD group versus the control group was primary education (12 [30%] vs. 8 [20%]), secondary education (19 [48%] vs. 16 [40%]), post-graduate degree and diploma and above (4 [10%] vs. 9 [23%]) (P = 0.3). Five AMD patients and seven controls refused to disclose this information. 
Compared to controls, AMD participants were significantly older, had worse unaided visual acuity, BCVA and CS in the worse eye, (Supplementary Table S2). In the AMD group, out of the 36 patients with advanced AMD in at least one eye, four (11.1%) participants had bilateral VI (both eyes logMAR VA >0.4) from advanced AMD in both eyes. Out of all the eyes that had advanced AMD, four eyes had geographic atrophy whereas the rest had neovascular AMD as diagnosed on multimodal imaging. Sixteen additional AMD patients had the presence of intermediate or advanced AMD (Beckman classification) in the better vision eye with logMAR ≤0.4. In the AMD group, mean binocular VA, monocular VA in the better and worse eye was logMAR 0.17(±0.16), 0.23 (±0.20), and 1.01 (±0.60), respectively. In the AMD group, nine patients were unable to perform reading in at least one eye, eight patients were unable to perform FE successfully in one eye, two patients were unable to perform MC in one eye, and one patient was unable to perform MD in one eye. All patients in the AMD group were able to perform the IS task with either eye. 
To assess content validity, based on the participant survey, MC and MD were reported to be performed daily and most frequently; and the majority of people described having to perform IS and FE at least once a month (Supplementary Figure S1). The mean rating of how important each ADLTTs was reported as above 7 (very- extremely important; 1 = not important, 10 = extremely important) for all five ADLTTs tested (Supplementary Table S3) in both AMD and controls. The mean self-reported ability of being able to perform each of these ADLTTs were reported as more than 8.5 for AMD and 10 for controls (mostly performed well with no help; 1 = cannot perform, 10 = performed well with no help) (Supplementary Table S3). 
Test-Retest Reliability of the ADLTT
There was poor repeatability for FE using monocular worse eye, better eye and binocular vision (Table 1). Moderate repeatability was observed in AMD participants for the number of items identified correctly in IS using monocular vision but poor using binocular vision (Table 1). Moderate repeatability was observed in the time taken to complete MC in AMD participants using their worse eye vision (Table 1). When performing MC, moderate repeatability was observed for AMD participants using the worse eye, using the better eye and binocular vision to perform MC showed poor repeatability (Table 1). Efficiency grading in completing MC showed moderate-good repeatability (Table 1). Good to excellent repeatability was observed for the time taken to complete MD for AMD participants using monocular worse or better eye and binocular vision (Table 1) and showed moderate to excellent repeatability of efficiency grading of this task (Table 1). 
Table 1.
 
Test-Retest Reliability of Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls
Table 1.
 
Test-Retest Reliability of Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls
Assessment of Convergent Validity of the ADLTT
In the AMD group, convergent validity was observed for RT, with a moderate-strong correlation of worse reading speed with worse monocular BCVA (Spearman correlation coefficient (ρ) = −0.74; P < 0.001) and binocular BCVA (ρ = −0.44; P = 0.01) (Table 2). A moderate-strong better reading speed correlation with better monocular CS (ρ = 0.59; P < 0.001), and higher MRS (ρ = 0.56; P < 0.001) was also observed (Table 2). For MC, there was a moderate-strong longer time taken to complete the task with worser binocular BCVA (ρ = 0.34; P = 0.045) and monocular BCVA (ρ = 0.71; P < 0.001)(Table 2). A moderate-strong correlation with longer time to complete test and poorer monocular CS (ρ = −0.62; P < 0.001) and lower MRS (ρ = −0.56; P < 0.001) was also observed (Table 2). No significant correlations were observed with FE, IS or MD (P > 0.05). No correlations with the IVI score (VF domain) were observed with ADLTT performed with either monocular or binocular vision (Supplementary Table S4). 
Table 2.
 
The Assessment of Convergent Validity in the Age-Related Macular Degeneration Group Though the Spearman Correlation of Binocular and Monocular Performance Based on ADLTT With Other Conventional Measures of Visual Function
Table 2.
 
The Assessment of Convergent Validity in the Age-Related Macular Degeneration Group Though the Spearman Correlation of Binocular and Monocular Performance Based on ADLTT With Other Conventional Measures of Visual Function
Assessment of Known-Group Validity of the ADLTT
RT
Using monocular BCVA (worse eye), AMD participants had a significantly slower reading speed (−77.41 words/min [P < 0.001]) and less correct words (−11.54 words [P < 0.001]) compared to controls (Table 3Figure), suggesting a good known-group validity for this test. 
Table 3.
 
The Assessment of Known-Group Validity in Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls Adjusted for Age*
Table 3.
 
The Assessment of Known-Group Validity in Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls Adjusted for Age*
Figure.
 
Representation pictures of activities of daily living tasks test include the IReST reading charts (top left), the set-up of the item search task layout (bottom left), local currency coins used in different combinations for the assessment of money counting (middle) and the various components used in the making a drink task (right).
Figure.
 
Representation pictures of activities of daily living tasks test include the IReST reading charts (top left), the set-up of the item search task layout (bottom left), local currency coins used in different combinations for the assessment of money counting (middle) and the various components used in the making a drink task (right).
FE
There was no statistically significant difference between AMD participants and healthy controls in the mean number of expressions identified correctly, using either monocular or binocular BCVA, showing poor known-group validity. 
IS
There was no statistically significant difference between AMD participants and healthy controls for the time taken to complete the task and the number of items using either monocular or binocular BCVA identified correctly, showing poor known-group validity (Table 3Figure). 
MC
Using both monocular (worse eye) and binocular BCVA, AMD participants required significantly longer to complete the money counting task (15.13 sec [P < 0.001]) and (4.06 sec [P < 0.001]), respectively, compared to controls Table 3Figure). Ability scores for this task were significantly worse for AMD participants versus controls using both the worse eye (−1.35 [P < 0.001]) and better eye (−0.37 [P = 0.016]) BCVA. These findings suggests excellent known-group validity. 
MD
Using monocular worse eye BCVA, AMD participants took significantly longer to complete the multi-step task (9.37 sec [P = 0.033]) and had a lower ability score (−0.55 sec [P = 0.048]), respectively, compared to controls Table 3Figure), suggesting excellent known-group validity. 
Known-group validity based on VA regardless of AMD status was also assessed (Supplementary Table S5). Similar trends supportive of known-group validity were observed for both monocular and binocular RT and MC (time taken), as well monocular MD (time taken), especially for those with VA >0.7 LogMAR. However, these differences were overall not statistically significant due to small numbers of those with poor VA. 
Table 4 provides a summary of the various psychometric properties of the 5 ADLTTs. We have established the normal cut-off ranges for the quantitative variable of the validated ADLTTs (RT, MC and MD) based on the normal range ninetieth percentile cutoff and assumed a qualitative ability score of less than the maximum score as poor function (Table 5). The overall development and validation of our proposed PCOMS based on the modified COSMIN checklist was assessed in Supplementary Table S6
Table 4.
 
Summary of Validation Results and Test-Retest Reliability Results of ADLTTs
Table 4.
 
Summary of Validation Results and Test-Retest Reliability Results of ADLTTs
Table 5.
 
Recommended Grading of validated ADLTT for AMD Patients, Reading, Money Counting, and Making a Drink
Table 5.
 
Recommended Grading of validated ADLTT for AMD Patients, Reading, Money Counting, and Making a Drink
Discussion
Three out of our five ADLTTs, RT, MC and MD, demonstrated satisfactory age-adjusted known-group validity; and reasonable test-retest repeatability and have the potential to be included in routine clinical practice and future research studies as PCOMs of visual functioning in AMD patients. In particular RT and MC showed good convergent validity in the AMD group, with moderate-high correlations with other related measures of VF, such as VA, contrast and MRS on microperimetry testing. Of note, some weaker correlations with VF measurements were observed with RT, IS and MD in the control group compared to the AMD group, and the significance of this is uncertain. Selected ADLTTs that performed well in this validation study, such as RT, MC and MD, are tasks that are performed commonly by AMD participants, and can be replicated in a clinical setting without the need for extensive resources. In addition, these specific ADLTTs are rated as important both AMD patients and controls in our study (Supplementary Fig. S1). Based on our results, we determined that the psychometric properties of RT, M,C and MD to be satisfactory. We proposed cutoff values based on our study results for suboptimal ADLTT function (Supplementary Fig. S2Table 5) as a basis for future studies, which may further validate these results in a cohort of patients with less advanced AMD. 
In our AMD patients, self-reported rating on their ability to complete these tasks were accurate, and the high qualitative grading scores showed that most AMD patients were able to complete the ADLTTs (Supplementary Table S3). Our proposed validated ADLTTs such as RT, MD and MC have the potential to be applied to other types of macula disease but will require further validation studies. At this point in time, based on our validation study, ADLTTs are to be scored separately and provide users with separate, specific information that may be used for directed visual rehabilitation training. At this stage, no overall score is recommended for the ADLTT because some of the ADLTTs need refining; however, future research will endeavor to fit the completion scores to the Rasch model using the Method of Successive Dichotomizations,40 which will allow an overall ADL score to be reported. 
Our study showed that FE and IS had poorer psychometric properties with no known-group validity, convergent validity, and poor test-retest repeatability and are currently not suitable for use in clinical practice. We are currently reviewing protocols and troubleshooting these ADLTTs in an effort to further improve repeatability during follow up ADL testing. FE was based on a standardized facial expression scale designed for use to identify particular emotions and based on a set of photographs of Western faces.30 In our local context, some of these emotional expressions were unfamiliar to participants, with limited understanding of the subtleties between some emotions (e.g., fear vs. disgust). Hence, we are currently developing an improved simplified facial expression identification scale with culturally applicable faces to measure facial expression recognition suitable for use in Asian participants who have VI. Future work is still needed to examine criterion, convergent and known-group validity and test-rest reliability for our revised FE tasks to be included in our ADLTT battery. For IS, we have attempted to improve repeatability by giving some practice attempts to perform the motions of these tasks before the actual results are recorded to give participants better familiarity with the basic motions of the tasks and also specifying the positions of each of the IS items on each attempt. In addition, IS was previously adapted from a test designed for use in a population with hemianopia and it may not represent a real world scenario or may be too simple in the AMD population where VI may not be as severe. Possible ways that we could increase the difficulty of the search task, would be to simulate more real-world situations (e.g., “cluttered table” or “a bookshelf with multiple objects”). Adding the eye tracking as an outcome measure during the search tasks would be also useful to understand the visual movements required to perform these tasks. Using computerized testing to create real-world scenarios and using wearable headsets that can monitor eye movements are possible research possibilities for the future. However, based on the lower frequency of how often participants report performing these 2 ADLTTs (Supplementary Fig. S1), it may also be reasonable to exclude these tasks in future studies to focus on more common tasks with better psychometric properties. 
Although none of the ADLTT correlated with the specific domains of the IVI, this may be because this is a relatively small sample size to measure PROMs and the ADLTT is a performance assessment that measures real-life ADL functioning, which may not always be consistent with patient-reported effects of VF, making it suitable as an alternative outcome measure. We did not observe any differences in scores for RT, FE and IS between the AMD and control groups when using binocular vision, which may be explained by the fact that in the AMD group, only 4 (11.1%) participants had bilateral visual impairment (both eyes logMAR VA >0.4). Hence, for certain ADLTTs, the difference in the ability to perform ADLTT between AMD and control groups may have been diminished as the majority of participants could still rely on their better eye vision, especially in our participants where often the better eye vision is similar to the binocular vision. In contrast, the MC test did show good known-group validity using binocular vision, which is likely because these were more complex tasks requiring multiple steps that rely more on binocular VF.4144 We acknowledge that it would have been preferable to include a larger sample of patients with binocular AMD and VI. However, these patients are less common and often elderly with co-morbidities, and therefore less willing to participate in physically and time demanding studies. 
The strength of this study is that it uses a robust case-control study design with standardized protocols with trained research staff to assess the ADLTTs and other functional assessments of vision, including contrast sensitivity and microperimetry testing, which are often lacking in other validation studies. Moreover, we assessed both better and worse eye monocular, and binocular vision, allowing correlations with monocular VF measurements such as microperimetry. We also acknowledge that this rigorous protocol may have resulted in some fatigue for patients during the session, hence efforts were made to give them frequent breaks and no obvious deterioration of ADLTT function was noted by administrators during repeated testing in a single session. Because of the lack of previous data on these specific ADLTTs, a limitation of this study is the small sample size, meaning that it may be underpowered to show known-group validity for certain ADLTTs, and we are currently collecting a larger cohort for longitudinal testing. Another limitation of this study is that more subtle disabilities, not obvious to the observer and unrelated to their vision, may not have been accounted for in this study. We also restricted the assessment of reading ability to the IRest standardized reading text, and we acknowledge this may not fully reflect other reading tasks performed in a real-world setting such as reading medication labels or food packaging. However, because of time limitations and the need for reading tasks to be conducted in both English and Chinese, the IRest test was deemed the most suitable. We also acknowledge that in this validation study, our proposed ADLTTs were designed for our local context, and for these performance assessments to be more widely implemented, further validation and implementation studies with opinions and consensus from ophthalmologists, allied health specialists, and patients from more diverse backgrounds is needed. For example, MC is largely dependent on the appearance of the currency denominations, and this may vary in color and size, which may affect the difficulty of this tasks. 
In conclusion, three of our objectively measured series of ADLTTs (RT, MC and MD) displayed excellent validity and reliability results in patients with VI due to AMD. Although satisfactory psychometric properties were observed most commonly in worse vision eyes, it was encouraging that MC using the better vision eye and binocular vision also showed known-group validity, hence can be considered for use in the assessment of individuals with mild VI. Further testing of protocols, that may increase the difficulties of RT and MD may have the potential to show known group validity even in cases with milder VI. Further work is required to refine the remaining ADLTTs, to enable us to develop valid, reliable and objective PCOM assessments, which can complement current PROMs, to provide a holistic assessment of patients’ real world VF. These measures have important applications for clinical practice, clinical trials, and are relevant to funding bodies and health authorities for assessing value-based healthcare. 
Acknowledgments
Disclosure: A.C.S. Tan, Zeiss (F, R), Nidek (F, R), Bayer (F, R), Novartis (F, R), Roche (F, R), Allergan (R); C.L. Peterson, None; H.M. Htoon, None; L.L.Y. Tan, None; Y. Tan, None; K.T. Sim, None; L. Ong, None; Z.K. Tan, None; H.S. Hui, None; I.Y.S. Yeo, None; T.Y. Wong, None; G. Cheung, Bayer (F, R), Novartis (F, R), Roche (F, R), Boehringer (F, R), Ingelheim (F, R), Topcon (F, R), Samsung (F, R); R. Man, None; E.K. Fenwick, None; E. Lamoureux, None 
References
Jonas JB, Bourne RR, White RA, et al. Visual impairment and blindness due to macular diseases globally: a systematic review and meta-analysis. Am J Ophthalmol. 2014; 158: 808–815. [CrossRef] [PubMed]
Lamoureux EL, Mitchell P, Rees G, et al. Impact of early and late age-related macular degeneration on vision-specific functioning. Br J Ophthalmol. 2011; 95: 666–670.
Yuzawa M, Fujita K, Tanaka E, Wang EC. Assessing quality of life in the treatment of patients with age-related macular degeneration: clinical research findings and recommendations for clinical practice. Clin Ophthalmol. 2013; 7: 1325–1332. [PubMed]
Hochberg C, Maul E, Chan ES, et al. Association of vision loss in glaucoma and age-related macular degeneration with IADL disability. Invest Ophthalmol Vis Sci. 2012; 53: 3201–3206. [CrossRef] [PubMed]
Finger RP, Fleckenstein M, Holz FG, Scholl HP. Quality of life in age-related macular degeneration: a review of available vision-specific psychometric tools. Qual Life Res. 2008; 17: 559–574. [CrossRef] [PubMed]
Lotery A, Xu X, Zlatava G, Loftus J. Burden of illness, visual impairment and health resource utilisation of patients with neovascular age-related macular degeneration: results from the UK cohort of a five-country cross-sectional study. Br J Ophthalmol. 2007; 91: 1303–1307. [CrossRef] [PubMed]
Lamoureux EL, Mitchell P, Rees G, et al. Impact of early and late age-related macular degeneration on vision-specific functioning. Br J Ophthalmol. 2011; 95: 666–670. [CrossRef] [PubMed]
Gopinath B, Liew G, Burlutsky G, Mitchell P. Age-related macular degeneration and 5-year incidence of impaired activities of daily living. Maturitas. 2014; 77: 263–266. [CrossRef] [PubMed]
Taylor DJ, Hobby AE, Binns AM, Crabb DP. How does age-related macular degeneration affect real-world visual ability and quality of life? A systematic review. BMJ Open. 2016; 6(12): e011504. [CrossRef] [PubMed]
Owsley C, McGwin G, Sloane ME, Stalvey BT, Wells J. Timed instrumental activities of daily living tasks: relationship to visual function in older adults. Optom Vis Sci. 2001; 78: 350–359. [CrossRef] [PubMed]
Owsley C, Sloane M, McGwin G, Ball K. Timed instrumental activities of daily living tasks: relationship to cognitive function and everyday performance assessments in older adults. Gerontology. 2002; 48: 254–265. [CrossRef] [PubMed]
Gobeille MR, Fujiwara K, Massof RW. Application of Rasch analysis to timed instrumental activities of daily living in low vision: a validation study. Optom Vis Sci. 2023; 100: 397–405. [CrossRef] [PubMed]
Sato T, Suzuki M, Ooto S, Spaide RF. Multimodal imaging findings and multimodal vision testing in neovascular age-related macular degeneration. Retina. 2015; 35: 1292–1302. [CrossRef] [PubMed]
Sunness JS, Applegate CA, Haselwood D, Rubin GS. Fixation patterns and reading rates in eyes with central scotomas from advanced atrophic age-related macular degeneration and Stargardt disease. Ophthalmology. 1996; 103: 1458–1466. [CrossRef] [PubMed]
Sunness JS, Applegate CA. Long-term follow-up of fixation patterns in eyes with central scotomas from geographic atrophy that is associated with age-related macular degeneration. Am J Ophthalmol. 2005; 140: 1085–1093. [CrossRef] [PubMed]
Ross CK, Stelmack JA, Stelmack TR, Fraim M. Preliminary examination of the reliability and relation to clinical state of a measure of low vision patient functional status. Optom Vis Sci. 1991; 68: 918–923. [CrossRef] [PubMed]
Haymes SA, Johnston AW, Heyes AD. Relationship between vision impairment and ability to perform activities of daily living. Ophthalmic Physiol Opt. 2002; 22: 79–91. [CrossRef] [PubMed]
Haymes SA, Johnston AW, Heyes AD. The development of the Melbourne low-vision ADL index: a measure of vision disability. Invest Ophthalmol Vis Sci. 2001; 42: 1215–1225. [PubMed]
Duquette J, Loiselle J, Fréchette C, et al. Reliability and validity of the Canadian-French ecological adaptation of the weighted version of the Melbourne low-vision ADL Index. Disabil Rehabil. 2020; 42: 1021–1030. [CrossRef] [PubMed]
West SK, Rubin GS, Broman AT, Muñoz B, Bandeen-Roche K, Turano K. How does visual impairment affect performance on tasks of everyday life? The SEE Project. Salisbury Eye Evaluation. Arch Ophthalmol. 2002; 120: 774–80. [CrossRef] [PubMed]
Haymes SA, Johnston AW, Heyes AD. Preliminary investigation of the responsiveness of the Melbourne Low Vision ADL index to low-vision rehabilitation. Optom Vis Sci. 2001; 78: 373–380. [CrossRef] [PubMed]
Markowitz SN, Aleykina N. The relationship between scotoma displacement and preferred retinal loci in low-vision patients with age-related macular degeneration. Can J Ophthalmol. 2010; 45: 58–61. [CrossRef] [PubMed]
Cheong AM, Legge GE, Lawrence MG, Cheung SH, Ruff MA. Relationship between visual span and reading performance in age-related macular degeneration. Vision Res. 2008; 48: 577–588. [CrossRef] [PubMed]
Schuchard RA. Preferred retinal loci and macular scotoma characteristics in patients with age-related macular degeneration. Can J Ophthalmol. 2005; 40: 303–312. [CrossRef] [PubMed]
Mokkink LB, Terwee CB, Patrick DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010; 19: 539–549. [CrossRef] [PubMed]
Bassuk SS, Murphy JM. Characteristics of the Modified Mini-Mental State Exam among elderly persons. J Clin Epidemiol. 2003; 56: 622–628. [CrossRef] [PubMed]
Wiecek E, Jackson ML, Dakin SC, Bex P. Visual search with image modification in age-related macular degeneration. Invest Ophthalmol Vis Sci. 2012; 53: 6600–6609. [CrossRef] [PubMed]
Roth T, Sokolov AN, Messias A, Roth P, Weller M, Trauzettel-Klosinski S. Comparing explorative saccade and flicker training in hemianopia: a randomized controlled study. Neurology. 2009; 72: 324–31. [CrossRef] [PubMed]
Trauzettel-Klosinski S, Dietz K. Standardized assessment of reading performance: the New International Reading Speed Texts IReST. Invest Ophthalmol Vis Sci. 2012; 53: 5452–61. [CrossRef] [PubMed]
Olszanowski M, Pochwatko G, Kuklinski K, Scibor-Rylski M, Lewinski P, Ohme RK. Warsaw set of emotional facial expression pictures: a validation study of facial display photographs. Front Psychol. 2014; 5: 1516. [PubMed]
Lamoureux EL, Pallant JF, Pesudovs K, Rees G, Hassell JB, Keeffe JE. The impact of vision impairment questionnaire: an assessment of its domain structure using confirmatory factor analysis and rasch analysis. Invest Ophthalmol Vis Sci. 2007; 48: 1001–1006. [CrossRef] [PubMed]
Weih LM, Hassell JB, Keeffe J. Assessment of the impact of vision impairment. Invest Ophthalmol Vis Sci. 2002; 43: 927–35. [PubMed]
Pondorfer SG, Terheyden JH, Heinemann M, Wintergerst MWM, Holz FG, Finger RP. Association of vision-related quality of life with visual function in age-related macular degeneration. Sci Rep. 2019; 9(1): 15326. [CrossRef] [PubMed]
Barry Walsh C, Cahalan R, Hinman RS, K OS. Psychometric properties of performance-based measures of physical function administered via telehealth among people with chronic conditions: a systematic review. PLoS One. 2022; 17(9): e0274349. [CrossRef] [PubMed]
Leonardi NT, Kawakami DMO, Hurst JR, Cruz J, Mendes RG. Performance-based outcome measures to assess functionality in hospitalised patients with COPD exacerbations: a systematic review of the measurement properties. Eur Respir Rev. 2023; 32(169): 230013. [CrossRef] [PubMed]
Trauzettel-Klosinski S, Dietz K, Group IS. Standardized assessment of reading performance: the New International Reading Speed Texts IReST. Invest Ophthalmol Vis Sci. 2012; 53: 5452–5461. [CrossRef] [PubMed]
Oremus M, Oremus C, Hall GB, McKinnon MC, Team ECSR. Inter-rater and test-retest reliability of quality assessments by novice student raters using the Jadad and Newcastle-Ottawa Scales. BMJ Open. 2012; 2(4): e001368. [CrossRef] [PubMed]
Schober P, Boer C, Schwarte LA. Correlation coefficients: appropriate use and interpretation. Anesth Analg. 2018; 126: 1763–1768. [CrossRef] [PubMed]
Taylor DJ. Everyday visual function and the visual experience in dry age-related macular degeneration. London: University of London; 2018.
Bradley C, Massof RW. Method of successive dichotomizations: an improved method for estimating measures of latent variables from rating scale data. PLoS One. 2018; 13(10): e0206106. [CrossRef] [PubMed]
Deruaz A, Matter M, Whatham AR, et al. Can fixation instability improve text perception during eccentric fixation in patients with central scotomas? Br J Ophthalmol. 2004; 88: 461–463. [CrossRef] [PubMed]
Cheong AM, Legge GE, Lawrence MG, Cheung SH, Ruff MA. Relationship between slow visual processing and reading speed in people with macular degeneration. Vision Res. 2007; 47: 2943–2955. [CrossRef] [PubMed]
Altpeter E, Mackeben M, Trauzettel-Klosinski S. The importance of sustained attention for patients with maculopathies. Vision Res. 2000; 40(10-12): 1539–47. [CrossRef] [PubMed]
Timberlake GT, Omoscharka E, Quaney BM, Grose SA, Maino JH. Effect of bilateral macular scotomas from age-related macular degeneration on reach-to-grasp hand movement. Invest Ophthalmol Vis Sci. 2011; 52: 2540–2450. [CrossRef] [PubMed]
Appendix. Modified COSMIN checklist for the assessment of PCOMs
Validated performance based standardized ADL task tests are complimentary clinical outcome measures of real-life functioning in patients with AMD (See Supplementary File S9). 
Figure.
 
Representation pictures of activities of daily living tasks test include the IReST reading charts (top left), the set-up of the item search task layout (bottom left), local currency coins used in different combinations for the assessment of money counting (middle) and the various components used in the making a drink task (right).
Figure.
 
Representation pictures of activities of daily living tasks test include the IReST reading charts (top left), the set-up of the item search task layout (bottom left), local currency coins used in different combinations for the assessment of money counting (middle) and the various components used in the making a drink task (right).
Table 1.
 
Test-Retest Reliability of Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls
Table 1.
 
Test-Retest Reliability of Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls
Table 2.
 
The Assessment of Convergent Validity in the Age-Related Macular Degeneration Group Though the Spearman Correlation of Binocular and Monocular Performance Based on ADLTT With Other Conventional Measures of Visual Function
Table 2.
 
The Assessment of Convergent Validity in the Age-Related Macular Degeneration Group Though the Spearman Correlation of Binocular and Monocular Performance Based on ADLTT With Other Conventional Measures of Visual Function
Table 3.
 
The Assessment of Known-Group Validity in Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls Adjusted for Age*
Table 3.
 
The Assessment of Known-Group Validity in Performance-Based Measurement of the ADLTT in Persons With AMD Versus Normal Controls Adjusted for Age*
Table 4.
 
Summary of Validation Results and Test-Retest Reliability Results of ADLTTs
Table 4.
 
Summary of Validation Results and Test-Retest Reliability Results of ADLTTs
Table 5.
 
Recommended Grading of validated ADLTT for AMD Patients, Reading, Money Counting, and Making a Drink
Table 5.
 
Recommended Grading of validated ADLTT for AMD Patients, Reading, Money Counting, and Making a Drink
×
×

This PDF is available to Subscribers Only

Sign in or purchase a subscription to access this content. ×

You must be signed into an individual account to use this feature.

×