Abstract
Purpose:
Photoactivated chromophore for keratitis-corneal cross-linking (PACK-CXL) stabilizes the corneal stroma and eliminates microorganisms. Numerous PACK-CXL protocols, using different energy sources and chromophores, have been applied in preclinical studies, including live animal studies, with various experimental designs and endpoints. So far, a systematic mapping of the applied protocols and consistency across studies seems lacking but is essential to guide future research.
Methods:
The scoping review protocol was in line with the JBI Manual for Evidence Synthesis. Electronic databases were searched (Embase, MEDLINE, Scopus, Web of Science) to identify eligible records, followed by a two-step selection process (title and abstract screening, full text screening) for record inclusion. We extracted information on (1) different PACK-CXL protocol characteristics; (2) infectious pathogens tested; (3) study designs and experimental settings; and (4) endpoints used to determine antimicrobial and tissue stabilizing effects. The information was charted in frequency maps.
Results:
The searches yielded 3654 unique records, 233 of which met the inclusion criteria. With 103 heterogeneous endpoints, the researchers investigated a wide range of PACK-CXL protocols. The tested microorganisms reflected pathogens commonly associated with infectious keratitis. Bacterial solutions and infectious keratitis rabbit models were the most widely used models to study the antimicrobial effects of PACK-CXL.
Conclusions:
If preclinical PACK-CXL studies are to guide future translational research, further cross-disciplinary efforts are needed to establish, promote, and facilitate acceptance of common endpoints relevant to PACK-CXL.
Translational Relevance:
Systematic mapping of PACK-CXL protocols in preclinical studies guides future translational research.
Only peer-reviewed primary research publications and published conference abstracts from scientific ophthalmology or vision science meetings were eligible for inclusion into the scoping review. The described work needed to involve the use of animals with spontaneous or experimentally induced infectious keratitis, or be laboratory-based work using bacteria, fungi, or amoebas. Furthermore, the records needed to include at least one endpoint relevant to antimicrobial or tissue-stabilizing effects of PACK-CXL. Language restrictions were not imposed. Records based on non-photoactivated CXL and records published before the year 2000 were excluded from the review. The second exclusion criterium was chosen because CXL had not been investigated as a treatment for infectious keratitis before the year 2000. Endpoints related to the biomechanical effects of CXL that were investigated in records included in the review were not considered because such endpoints are mainly relevant for the treatment of keratoconus and not infectious keratitis.
Two reviewers screened the records’ title and abstract list and applied the eligibility criteria in parallel. Three questions were asked to establish record eligibility, and records were included if the answer to all three questions was “yes.”
- • Does this study involve the use of an intervention or treatment method based on the combination of a chromophore (photosensitive agent) and energy source?
- • Are any of the study findings relevant to PACK-CXL treatment efficacy in terms of antimicrobial activity or tissue stabilization (tissue resistance to enzymatic digestion, structural changes, or treatment depth)?
- • Can this study be considered preclinical (in vitro or in vivo clinical or laboratory-based animal study)?
In case of disagreement, a third reviewer was included in the decision-making process and a consensus was sought. EndNote software
42 was used to generate publication lists and a Google Sheets document was used to store the decisions regarding record inclusion or exclusion. The reliability of agreement among the three reviewers was checked with Fleiss kappa.
This scoping review demonstrated that preclinical research into the antimicrobial and tissue stabilizing effects of PACK-CXL is a large and diverse field. Many PACK-CXL protocol modifications are being explored towards the elimination of clinically relevant infectious agents in both in vitro/ex vivo and in vivo studies. Two major problems were observed that preclude the conduction of a meta-analysis, evaluation of the strength of evidence, and the subsequent translation of existing research results to clinical practice. The first major problem is widespread shortcomings in the reporting of research designs and results, which can only partially be explained by the inclusion of both conference abstracts and full text manuscripts in the review. The second major problem is the large heterogeneity of experimental methods and the lack of consensus on the common most relevant endpoints for infectious keratitis. Those shortcomings slow down advancement in the field of PACK-CXL research and lead to an ineffective use of resources.
A scoping review is a form of knowledge synthesis that addresses an exploratory research question aimed at mapping key concepts, types of evidence, and research gaps related to a defined area or field by systematically searching, selecting, and synthesizing existing knowledge.
91–93 A scoping review does not analyze data to answer a narrow research question. Instead, it provides a broad overview of what has been published in a field.
91 Arksey and O'Malley
92 proposed the first framework for scoping reviews, which was further developed by various authors.
40,91,94,95 A summary of the available methodology was recently published through the Joanna Briggs Institute.
96 In addition, the PRISMA Extension for Scoping Reviews (PRISMA-ScR) provides an item list to improve the reporting quality of scoping reviews.
41
Despite its rigor, this review also has several notable limitations. For example, the inclusion of records without a primary focus on infectious keratitis largely depended on the reviewers’ judgment of the relevance of these studies to infectious keratitis treatment. The authors attempted to reduce personal bias through the use of three questions to determine record eligibility for inclusion (see Methods section, Selection of studies). The exclusion of endpoints only relevant to the biomechanical effects of CXL treatment, and thus deemed to be relevant mainly for the treatment of keratoconus and other ectatic disorders, and not infectious keratitis, also depended on the reviewers’ judgment. The grouping of PACK-CXL studies into application domains and effect categories, and the grouping of original endpoint descriptions under common endpoint names, may also have been influenced by personal decisions. The authors therefore acknowledge that other choices regarding grouping would have been possible. Additionally, one person was responsible for data extraction. Finally, the results were presented at an overview level, and many interesting subanalyses were not conducted. The possibilities for data analysis on this and similar datasets are therefore far from exhausted, and the authors hope that this work will inspire and enable a deeper investigation into the topics discussed here.
The authors acknowledge that the reporting of study design and results is a complex undertaking and that some items can easily be overlooked. However, when reporting guidelines are readily available, errors may be avoided. Based on the review, the authors have identified four areas relevant to study reporting that could be improved to enable knowledge synthesis and to secure the reproducibility of scientific studies or results. These areas are presented below.
- 1) None of the included records fully adhere to the selected items from the ARRIVE guidelines,44,55 which provide an easy-to-use reporting system with checklists for animal experimentation reporting. These guidelines are available online and should be considered as a minimum standard for study reporting. In the context of reproducibility of infectious keratitis animal models, the authors further suggest the inclusion of the following information: the pathogen load (total amount, concentration) used to induce disease, the method of wounding, and the time between induction of infection and treatment start.
- 2) Treatment and maintenance of experimental animals in accordance with the ARVO Statement was claimed in most records.43 However, especially in the context of infectious keratitis, a painful disease, it is unsettling that the information provided on pain control strategies was incomplete in many records. Information on pain control was not supplied in 12 of 34 full text records involving an animal model of induced infectious keratitis. According to the information provided in 20 of 34 full text records, pain control was provided only during the “wounding” or PACK-CXL procedure. Four records described a three-week follow-up period during which some animals developed corneal perforations. Additionally, in two full-text records in the “keratoconus/ectatic disorders” domain, topical antibiotics were listed as pain control medications. The authors assume that the fact that pain control information was missing from many records means that the information was not provided and not that pain control itself was not provided during the observation periods after the induction of corneal infections and treatment with PACK-CXL. However, authors and reviewers should be aware of existing reporting standards regarding pain control strategies and pain scoring systems in experimental animals, which can prevent omissions of the information supplied in published records.
- 3) Details regarding the intervention (PACK-CXL protocol) were insufficiently reported. The biggest gaps were observed in the reporting of chromophore saturation time, total dose of delivered energy (fluence), and irradiation duration or intensity. Chromophore concentrations were reported using various SI units, which complicates overall treatment effect quantification across different protocols used. Information detailing PACK-CXL protocols used is crucial for the knowledge synthesis that is necessary to direct translational research.
- 4) Despite the adoption of the term PACK-CXL in 2013 by clinical opinion leaders in the field, many synonyms and alternative terms continue to be used in publication titles and abstracts, which may hinder knowledge synthesis by preventing relevant publications to easily be identified. Since PACK-CXL is an abbreviation and the full name is long, it may be considered an unpractical name for usage in titles.
Apart from incomplete study reporting, the large heterogeneity of reported endpoints is another problem precluding quantitative knowledge synthesis. It was difficult to extract the outcomes of interest and their corresponding endpoint measurements from some of these published records. Ting et al.
30 observed that clinical trials and case series on PACK-CXL treatment of human patients with infectious keratitis suffered from a similar heterogeneity in outcome reporting. The Core Outcome Measures in Effectiveness Trials (COMET) initiative
97 defines a core outcome set as an agreed standardized set of outcomes that should be measured and reported, as a minimum, in specific health or healthcare domains. The authors believe that the establishment of clinically relevant core outcome sets for infectious keratitis, which would reflect different PACK-CXL treatment effects, would address the large reported endpoint heterogeneity in PACK-CXL-related research and thus benefit the field of PACK-CXL.
An interdisciplinary approach involving clinicians, epidemiologists, and basic scientists would be needed to define core outcome sets for preclinical and clinical PACK-CXL studies. With such core outcome sets in place, authors that aim to publish in the field of PACK-CXL would be expected to have collected and reported the relevant core outcome sets, without having to restrict their outcome measurements solely to the core set. This would facilitate the comparison of results while allowing researchers to continue exploring additional outcomes as well.
The semiquantitative preclinical ocular toxicology scoring (SPOTS) system is an established scoring system that is available to be adapted and used for preclinical in vivo infectious keratitis studies.
98 This system provides scoring criteria for the anterior and posterior segment, and focuses on the standardization of examination procedures and scoring criteria for corneal and anterior segment pathology. Adaptation and adoption of the SPOTS system could limit discrepancies between currently used keratitis scoring systems, which were illustrated in
Table 5.
Assessing risk of bias was not part of this scoping review because this is typically conducted in systematic reviews. However, the authors point out that nonsignificant results were reported in only three of the 233 records included. It is therefore likely that a bias toward the publication of significant results is present in the preclinical PACK-CXL research field.
99,100
In conclusion, a quantitative knowledge synthesis of the antimicrobial and tissue stabilizing effects of PACK-CXL, as in a meta-analysis or systematic review, is impossible despite the wide range of PACK-CXL protocol modifications that have been explored in in vitro/ex vivo and in vivo preclinical studies. Incomplete reporting and the large heterogeneity of reported endpoints are the two major problems that slow down advancement in the field. Harmonization through the establishment of core outcome sets is urgently needed.