Skip to main content

Self-assessed visual function outcome in cataract surgery: minimum important difference of the Catquest-9SF questionnaire

Abstract

Background

The purpose of this study was to study the minimum important difference (MID) of the Catquest-9SF questionnaire in cataract surgery.

Methods

A nationwide multi-center prospective randomized study was conducted using the Swedish National Cataract Register and the Catquest-9SF questionnaire. Randomized patients (n = 400) who had completed the Catquest-9SF before surgery and three months after surgery were sent an anchor question on self-assessed change in visual function after cataract surgery 14 days after the postoperative Catquest-9SF. Rasch analysis was performed on the preoperative and postoperative Catquest-9SF questionnaires, and the patients were dichotomized with regard to their preoperative Rasch score. The MID range of the two groups was calculated based on the anchor question, and the anchor question based MID was then estimated in a scatter plot. The MID was also estimated based on distribution by calculating Cohen’s effect size.

Results

The analyses included 231 patients who had completed the Catquest-9SF on both occasions as well as the questionnaire with the anchor question. The group with better preoperative visual function had an anchor question based MID of − 0.5 and a Cohen’s effect size based MID of − 1.07. The group with worse preoperative visual function had an anchor question based MID of − 1.80 and a Cohen’s effect size based MID of − 1.46.

Conclusion

This article contributes detailed knowledge of the MID of Catquest-9SF, enabling even more accurate high-quality evaluation of the outcome and benefit of cataract surgery worldwide.

Background

Cataract is not only a common disease, but also remains the leading cause of blindness in the world [1]. This is also true in high-income countries. Worldwide, significant resources are spent treating the large and steadily increasing number of patients with cataract [2]. The situation calls for continued accurate high-quality evaluation of the outcome and benefit of cataract surgery.

Visual acuity is perhaps the most common and accessible measure of vision, but it does not sufficiently reflect the entirety of the complex human visual function. Complete evaluation of the patient’s visual function and the impact of cataract surgery demands a more advanced measure. The Swedish National Cataract Register (NCR) was introduced in 1992 [3], and from 1995 began to use the Catquest questionnaire to collect data on patient-reported visual function [4]. Since then, the questionnaire has been revised using Rasch analysis, resulting in the current version: Catquest-9SF (Fig. 1) [5]. The Rasch model, which is often used to assess psychometric data such as individual abilities, attitudes, and personality traits, is based on probabilistic relationships between persons (e.g., patients) and items (e.g., questions). The ordinal (raw) data are converted to an interval level measurement (a logit unit), which allows assessment of the psychometric properties of the measurement using the Rasch model.

Fig. 1
figure 1

The English version of the Catquest-9SF

To evaluate a patient’s visual function and the impact of cataract surgery, the Catquest-9SF is completed by the patient before cataract surgery and then again three months postoperatively. The Rasch-revised version has been shown to be highly valid in measuring visual disability outcomes of cataract surgery in several different populations: Swedish [5], Australian [6], German and Austrian [7], Malay and Chinese [8, 9], Italian [10], Spanish [11], Dutch [12], English [13], Danish [14], New Zealander [15], and Vietnamese [16]. A recent systematic review of these validation reports concluded that the Catquest-9SF is a valid and reliable tool to measure visual function in patients with cataract in various populations [17]. In a comparison with other tools, the Catquest-9SF was found to be short, highly responsive to cataract surgery, and a good measure of visual function outcomes [18]. In 2017, it was chosen as the recommended tool for version 2.0.1 of the ICHOM Cataracts Data Collection Guide [19]. Moreover, a review of the quality of 17 patient-reported cataract outcome instruments concluded that the Catquest-9SF demonstrated superior psychometric properties as well as high responsiveness, and should be considered the recommended instrument for cataract surgery [20]. A recent test-retest study also showed excellent reliability [21].

Earlier studies using the Catquest-9SF to assess the association between ocular comorbidity and self-assessed visual function after cataract surgery [22] and the association between intraoperative difficulties and self-assessed visual function after cataract surgery [23] showed several significant associations. Using extensive data from the NCR, often with more than 10,000 patients in each study, makes even rather small associations statistically significant. However, it remains unclear if these associations are of clinical importance to the patient. Therefore, the aim of the current study was to investigate the minimum important difference (MID) of the Catquest-9SF.

Methods

Study design

The study was conducted as a prospective randomized multi-center study using the NCR, one questionnaire with a single anchor question, and the Catquest-9SF questionnaire. For the sample size calculation, we used 100,000 Monte-Carlo simulations. It has already been shown that the difference in preoperative and postoperative Rasch score is normally distributed, and so the simulations were based on a multivariate normal distribution with a correlation of 0.7. A regression analysis was performed for each simulation, with the anchor question as explanatory category variable and the difference in Rasch score as the outcome. With 240 patients, a significant difference in Rasch score between the response options “somewhat better” and “much better” was seen in 100% of the simulations and between “somewhat better” and “no change” in 72% of the simulations. We considered this to give enough precision to associate a positive change in Rasch score with a positive change according to the anchor question.

Intervention

Randomly selected patients (n = 400) from the nationwide NCR scheduled for cataract surgery in the first or second eye completed the Catquest-9SF before surgery and three months postoperatively. The Catquest-9SF questionnaire includes nine questions: two on global vision-related difficulties and satisfaction with vision, and the remaining seven on difficulties performing specific activities (Fig. 1). Each question has five response options, including “cannot decide”. Fourteen days after completing the postoperative Catquest-9SF questionnaire, the anchor question on self-assessed change in visual function after cataract surgery was distributed to the patients via a questionnaire containing a single question: “How do you experience your present vision compared to your vision before the cataract surgery?” This had five response options: “much better”, “somewhat better”, “no difference”, “somewhat worse”, and “much worse”. The study was approved by the Stockholm Regional Ethical Review Board (reference number 2017/130-31/2) and adhered to the tenets of the Declaration of Helsinki.

Statistics

Rasch analysis was performed using version 4.2.0 of Winsteps (Chicago, IL, USA) on the preoperative and postoperative Catquest-9SF questionnaires (n = 231), and the patients were dichotomized with regards to their preoperative Rasch score. The concept of MID in this study is based on the change in Rasch score from before to after surgery. The room for improvement is smaller for patients with few problems (low Rasch score) before surgery compared with those having more problems before surgery (high Rasch score). In such circumstances it is reasonable to use different MID values depending on the baseline score. Therefore, we chose to dichotomize the preoperative Rasch score, and we used the lower percentile (25%) as the dividing point. Patients with Rasch scores of − 4.91 to − 1.50 were placed in Group 1, and those with scores of − 1.49 to 5.73 in Group 2. The Rasch score change was calculated by subtracting the preoperative Rasch score from the postoperative Rasch score. MID range of the two groups (mean Rasch score change) was calculated on the basis of the anchor question. The anchor question based MID was then estimated in a scatter plot. Version 27 of IBM SPSS (SPSS Inc., Chicago, IL, USA) was used for statistics. The MID was also estimated on the basis of distribution via Cohen’s effect size (d) [24], which is calculated by dividing the difference of the mean postoperative Rasch score and the mean preoperative Rasch score by the standard deviation of the preoperative Rasch score: d = (mean postop Rasch − mean preop Rasch)/SD. The MID is half of Cohen’s effect size.

Results

Of the 400 originally included patients, 234 responded (59%) and 231 were included in the final analyses. Of the 234 patients who completed both occasions of the Catquest-9SF and the questionnaire with the anchor question, three were excluded due to giving an inconclusive answer to the anchor question. The inconclusive answers did not stick to the given response options but instead text that could not be interpreted. The analyses therefore included 231 patients with a mean age of 74 years, of whom 60% were female. The mean age of the excluded patients (n = 169, of whom n = 166 were non-responders) was also 74 years, and 62% were female.

The results of the anchor question for Groups 1 and 2 are shown in Tables 1 and 2, respectively. The MID range for Group 1 was estimated to be between 0.2033 and − 1.1756, based on the mean Rasch score change in patients who felt there was “no difference” in their vision and patients who felt they had “somewhat better” vision after cataract surgery. The MID range for Group 2 was estimated to be between − 0.6250 and − 2.6892. A more precise MID of − 0.5 in Group 1 and MID of − 1.80 in Group 2 was then calculated from the scatter plot where the trend line met the x value of 2.5, corresponding to the midpoint between answer 2 (“somewhat better”) and answer 3 (“no difference”) (Figs. 2, 3). The MID estimated on the basis of distribution by calculating Cohen’s effect size was − 1.07 for Group 1 and − 1.46 for Group 2. The different estimations of MID are shown in Table 3.

Table 1 Mean Rasch score change in Group 1
Table 2 Mean Rasch score change in Group 2
Fig. 2
figure 2

Scatter plot showing improvement in Rasch score and answers to anchor question in Group 1. Group 1 comprises patients with a preoperative Rasch score of − 4.91 to − 1.50. The central line in the scatterplot is a line of best fit using the least squares method and the upper and lower lines represent 95% confidence intervals

Fig. 3
figure 3

Scatter plot showing improvement in Rasch score and answers to anchor question in Group 2. Group 2 comprises patients with a pre-operative Rasch score of − 1.49 to 5.73. The central line in the scatterplot is a line of best fit using the least squares method and the upper and lower lines represent 95% confidence intervals

Table 3 Estimations of minimum important difference (MID) in each group

Discussion

The aim of the current study was to investigate the MID of the Catquest-9SF. One previous study using the Catquest-9SF to assess the association between ocular comorbidity and self-assessed visual function after cataract surgery [22] showed several significant associations. Using extensive data from the NCR, often with more than 10,000 patients makes even rather small associations statistically significant. However, it remains unclear if these associations are of clinical importance to the patient when MID is not known. For example, in the previous study [22], assessing the effect of glaucoma on changes in subjective visual function after cataract surgery, glaucoma turned out to be significantly associated with changes in patient-reported visual function with a logit change of − 0.355. The MID estimations from the current study (e.g., − 0.79 as in Group 1) can be used to determine if it is likely that the presence of glaucoma is of clinical importance to the patient. In this case, the change of − 0.355 being less than the MID of − 0.79, indicates that the presence of glaucoma is probably of minor clinical importance.

The MIDs estimated by the two methods in the current study were similar. Using two separate methods to estimate the MID of Catquest-9SF could be argued to add to the accuracy of the estimation. A previous study including 846 patients who completed the Catquest-9SF before and after cataract surgery showed an effect size of − 1.87, which corresponds to a MID of − 0.935 [25]. This value is similar to the results of the current study.

A strength of this study is the expected finding that Rasch score change after cataract surgery differed depending on the baseline Rasch score and the subsequent dichotomization into separate groups. The room for improvement is smaller for patients with few problems (low Rasch score) before surgery compared with those having more problems before surgery (high Rasch score). In such circumstances, it is reasonable to use different MID values depending on the baseline score. Without the dichotomization into two separate groups, the estimated MID would be imprecise. The rather large difference in the estimated MID of the two groups indicates the importance of taking the baseline Rasch score into account when evaluating the Rasch score change after cataract surgery. As in the example above, when assessing the effect of glaucoma on changes in subjective visual function after cataract surgery, it is of great importance to adjust for the baseline Rasch score in the study population when assessing if it is likely that the presence of glaucoma is of clinical importance to the patient.

As mentioned, one reason for dichotomizing is that patients with better preoperative visual function already have a low Rasch score, with limited scope for improvement. The analysis of the two groups showed that Group 1 (with a better preoperative visual function) had a significantly lower MID than Group 2 (with a worse preoperative visual function) even though the change in Rasch score was almost twice as large in Group 2. This is an interesting finding. One can argue that patients with a rather good visual function before surgery are just as likely as their worse-functioning counterparts to self-assess their visual function as having improved after surgery, even though the expected improvement measured in logits is lower compared to patients with worse preoperative visual function. Regardless, this new information of MID variation being dependent on the Rasch baseline allows a more precise evaluation of self-assessed visual function after cataract surgery.

Of the 400 originally included patients, 234 responded (59%) and 231 were included in the final analyses. The excluded patients were of similar age and gender as the included patients.

It is worth discussing whether the number of included patients is a weakness. A limitation of the study’s statistical power is the proportionally few patients experiencing only a mild improvement or no change of the visual function, as the vast majority considered their postoperative visual function to be “much better” than before the surgery. This is consistent with previous knowledge that a majority of cataract patients experience a marked improvement of visual function after surgery. Under these circumstances, it is difficult to construct an anchor question with many patients experiencing only a mild improvement or no change of the visual function, which could give this study better statistical power. However, our finding that two separate methods produced similar estimations for the MID of Catquest-9SF could be argued to add to the accuracy of the estimation.

Conclusion

This article contributes detailed knowledge of the MID of Catquest-9SF, enabling even more accurate high-quality evaluation of the outcome and benefit of cataract surgery worldwide.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Pascolini D, Mariotti SP. Global estimates of visual impairment: 2010. Br J Ophthalmol. 2012;96(5):614–8.

    Article  Google Scholar 

  2. Lee CM, Afshari NA. The global state of cataract blindness. Curr Opin Ophthalmol. 2017;28(1):98–103.

    Article  Google Scholar 

  3. Behndig A, Montan P, Stenevi U, Kugelberg M, Lundström M. One million cataract surgeries: Swedish National Cataract Register 1992–2009. J Cataract Refract Surg. 2011;37(8):1539–45.

    Article  Google Scholar 

  4. Lundström M, Roos P, Jensen S, Fregell G. Catquest questionnaire for use in cataract surgery care: description, validity, and reliability. J Cataract Refract Surg. 1997;23(8):1226–36.

    Article  Google Scholar 

  5. Lundström M, Pesudovs K. Catquest-9SF patient outcomes questionnaire: nine-item short-form Rasch-scaled revision of the Catquest questionnaire. J Cataract Refract Surg. 2009;35(3):504–13.

    Article  Google Scholar 

  6. Gothwal VK, Wright TA, Lamoureux EL, Lundström M, Pesudovs K. Catquest questionnaire: re-validation in an Australian cataract population. Clin Exp Ophthalmol. 2009;37(8):785–94.

    Article  Google Scholar 

  7. Harrer A, Gerstmeyer K, Hirnschall N, Pesudovs K, Lundström M, Findl O. Impact of bilateral cataract surgery on vision-related activity limitations. J Cataract Refract Surg. 2013;39(5):680–5.

    Article  Google Scholar 

  8. Lin X, Li M, Wang M, Zuo Y, Zhu S, Zheng Y, et al. Validation of Catquest-9SF questionnaire in a Chinese cataract population. PLoS One. 2014;9(8):e103860.

    Article  Google Scholar 

  9. Adnan TH, Mohamed Apandi M, Kamaruddin H, Salowi MA, Law KB, Haniff J, et al. Catquest-9SF questionnaire: validation of Malay and Chinese-language versions using Rasch analysis. Health Qual Life Outcomes. 2018;16(1):5.

    Article  Google Scholar 

  10. Skiadaresi E, Ravalico G, Polizzi S, Lundström M, González-Andrades M, McAlinden C. The Italian Catquest-9SF cataract questionnaire: translation, validation and application. Eye Vis (Lond). 2016;3:12.

    Article  Google Scholar 

  11. Lundström M, Llovet F, Llovet A, Martinez Del Pozo M, Mompean B, González JV, et al. Validation of the Spanish Catquest-9SF in patients with a monofocal or trifocal intraocular lens. J Cataract Refract Surg. 2016;42(12):1791–6.

    Article  Google Scholar 

  12. Visser MS, Dieleman M, Klijn S, Timman R, Lundström M, Busschbach JJ, et al. Validation, test-retest reliability and norm scores for the Dutch Catquest-9SF. Acta Ophthalmol. 2017;95(3):312–9.

    Article  Google Scholar 

  13. Sparrow JM, Grzeda MT, Frost NA, Johnston RL, Liu CSC, Edwards L, et al. Cataract surgery patient-reported outcome measures: a head-to-head comparison of the psychometric performance and patient acceptability of the Cat-PROM5 and Catquest-9SF self-report questionnaires. Eye (Lond). 2018;32(4):788–95.

    Article  CAS  Google Scholar 

  14. Nielsen E, Lundström M, Pesudovs K, Hjortdal J. Validation of Catquest-9SF in Danish: developing a revised form of the Catquest-9SF—the Danish Catquest-7SF. Acta Ophthalmol. 2019;97(2):173–7.

    Article  Google Scholar 

  15. Li SS, Misra S, Wallace H, Hunt L, McKelvie J. Patient-reported quality of life for cataract surgery: prospective validation of the ‘Impact on Life’ and Catquest-9SF questionnaires in New Zealand. N Z Med J. 2019;132(1503):34–45.

    CAS  Google Scholar 

  16. To QG, Huynh VAN, Do DV, Do VQ, Congdon N, Dingle K, et al. Psychometric properties of the Vietnamese Catquest-9 short form questionnaire. Optom Vis Sci. 2020;97(3):192–7.

    Article  Google Scholar 

  17. Kabanovski A, Hatch W, Chaudhary V, El-Defrawy S, Reid R, Ahmed IIK, et al. Validation and application of Catquest-9SF in various populations: a systematic review. Surv Ophthalmol. 2020;65(3):348–60.

    Article  Google Scholar 

  18. McAlinden C, Gothwal VK, Khadka J, Wright TA, Lamoureux EL, Pesudovs K. A head-to-head comparison of 16 cataract surgery outcome questionnaires. Ophthalmology. 2011;118(12):2374–81.

    Article  Google Scholar 

  19. ICHOM Cataracts Data Collection Reference Guide version 2.0.1. International Consortium for Health Outcome Measurements. 2017. Available from: https://www.ichom.org/portfolio/cataracts/.

  20. Khadka J, McAlinden C, Pesudovs K. Quality assessment of ophthalmic questionnaires: review and recommendations. Optom Vis Sci. 2013;90(8):720–44.

    Article  Google Scholar 

  21. Grimfors M, Lundström M, Hammar U, Kugelberg M. Patient-reported visual function outcome in cataract surgery: test-retest reliability of the Catquest-9SF questionnaire. Acta Ophthalmol. 2020;98(8):828–32.

    Article  Google Scholar 

  22. Grimfors M, Mollazadegan K, Lundström M, Kugelberg M. Ocular comorbidity and self-assessed visual function after cataract surgery. J Cataract Refract Surg. 2014;40(7):1163–9.

    Article  Google Scholar 

  23. Grimfors M, Lundström M, Höijer J, Kugelberg M. Intraoperative difficulties, complications and self-assessed visual function in cataract surgery. Acta Ophthalmol. 2018;96(6):592–9.

    Article  Google Scholar 

  24. Copay AG, Subach BR, Glassman SD, Polly DW Jr, Schuler TC. Understanding the minimum clinically important difference: a review of concepts and methods. Spine J. 2007;7(5):541–6.

    Article  Google Scholar 

  25. Lundstrom M, Behndig A, Kugelberg M, Montan P, Stenevi U, Pesudovs K. The outcome of cataract surgery measured with the Catquest-9SF. Acta Ophthalmol. 2011;89(8):718–23.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Open access funding provided by Karolinska Institute. Financial support was provided by the Stockholm County Council (ALF project), Sweden. The funding organization had no role in the design or conduct of this study.

Author information

Authors and Affiliations

Authors

Contributions

All authors participated in planning the study and in the analysis of data, ML was a major contributor. All authors participated in the data collection and writing of the manuscript, MG was a major contributor with substantial assistance of MK. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Magnus Grimfors.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Stockholm Regional Ethical Review Board (reference number 2017/130-31/2) and adhered to the tenets of the Declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Grimfors, M., Lundström, M. & Kugelberg, M. Self-assessed visual function outcome in cataract surgery: minimum important difference of the Catquest-9SF questionnaire. Eye and Vis 9, 46 (2022). https://doi.org/10.1186/s40662-022-00318-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40662-022-00318-x

Keywords