Abstract
Purpose:
To digitally stain spectral-domain optical coherence tomography (OCT) images of the optic nerve head (ONH), and highlight either connective or neural tissues.
Methods:
OCT volumes of the ONH were acquired from one eye of 10 healthy subjects. We processed all volumes with adaptive compensation to remove shadows and enhance deep tissue visibility. For each ONH, we identified the four most dissimilar pixel-intensity histograms, each of which was assumed to represent a tissue group. These four histograms formed a vector basis on which we ‘projected' each OCT volume in order to generate four digitally stained volumes P1 to P4. Digital staining was also verified using a digital phantom, and compared with k-means clustering for three and four clusters.
Results:
Digital staining was able to isolate three regions of interest from the proposed phantom. For the ONH, the digitally stained images P1 highlighted mostly connective tissues, as demonstrated through an excellent contrast increase across the anterior lamina cribrosa boundary (3.6 ± 0.6 times). P2 highlighted the nerve fiber layer and the prelamina, P3 the remaining layers of the retina, and P4 the image background. Further, digital staining was able to separate ONH tissue layers that were not well separated by k-means clustering.
Conclusion:
We have described an algorithm that can digitally stain connective and neural tissues in OCT images of the ONH.
Translational Relevance:
Because connective and neural tissues are considerably altered in glaucoma, digital staining of the ONH tissues may be of interest in the clinical management of this pathology.
In this study, we developed a digital staining algorithm that can classify (or isolate) different tissue groups of the ONH. Our main assumption is that the pattern distribution of reflectivity of the ONH tissues (as measured by OCT and corrected with adaptive compensation) varies according to tissue composition/type. For each OCT volume of the ONH, we aimed to extract N pixel-intensity histograms to represent the N different tissues (or tissue groups) of the ONH. These N histograms can then be used to digitally stain the OCT volumes.
The principle of OCT digital staining is as follows: for each OCT volume of the ONH, we first manually selected a region of interest (ROI) within the LC. The selected ROI was assumed to exhibit pixel intensity values representative of ONH connective tissues. The ROI pixel intensities were then represented as a histogram-vector h1 (vector size: 256 × 1), in which each vector component was the number of ROI voxels for a given gray scale value (from 1–256).
For our next step, we aimed to identify the histogram-vector h
2 that was the most dissimilar to h
1. We assumed that if h
2 was highly dissimilar to h
1, it would be representative of an ONH tissue (or tissue group) different from connective tissues. For simplicity, we assumed that h
2 was most dissimilar to h
1 when a function of the scalar product h
1 × h
2 was minimum. Note that this process is similar to minimizing a cross-correlation coefficient applied to histogram-vectors.
36 To this end, we first divided each OCT volume into multiple partially overlapping (8 × 8 × 5 voxels) ROIs (33 × 33 × 5 voxels). For each ROI (now represented as a histogram-vector h
2), we computed the scalar product h
1 × h
2. We then identified the ROI (and corresponding h
2) that provided the smallest scalar product value.
Once the first two most dissimilar histogram-vectors (representing tissues) were found the technique could be iterated. For instance, a histogram-vector hn can be obtained when the function of its scalar products with the n − 1 previous histogram-vectors is minimum. Using the proposed approach, we aimed to identify a basis of four histogram-vectors (assumed to be representative of four tissues or tissue groups, including background noise) for each OCT volume of the ONH.
For a given OCT volume, the four histogram-vectors can now be used to generate four digitally stained volumes representative of four different tissue types. To this end, each OCT volume was divided into multiple overlapping ROIs (9 × 9 × 1 voxels). The digitally stained image P1 was obtained by projecting all histogram-vectors (representative of all ROIs; the histograms are normalized and sorted in the base according to maximum position, and extrema histograms are maximized below and above their maximum values positions, respectively) on h1. In other words, the voxel intensity of P1 with voxel coordinates (i, j, k) was the scalar product of h1 with the histogram-vector representing an ROI centered on (i, j, k). The digitally stained images P2, P3, and P4 were obtained by performing similar projections with h2, h3, and h4, respectively.
The digital staining algorithm was implemented in MATLAB (Mathworks Inc., Natick, MA).
In this study, we have developed and tested a digital staining algorithm for OCT images of the ONH. Our algorithm was verified with a digital phantom and tested with OCT data from 10 healthy subjects. For OCT images of the ONH, we found that our algorithm was able to isolate connective tissues, prelaminar tissues and the nerve fiber layer, other retinal layers, and the OCT background, as four separate digitally stained volumes. Our method is as attractive as it is simple and could have applications for the clinical management of glaucoma using OCT. To the best of our knowledge, no digital staining techniques have yet been proposed for OCT images of the eye.
In this work, we found that connective tissues of the ONH (including the peripapillary sclera. the LC, the choroid, Bruch's membrane, and the central retinal vessels) were highly visible in the digitally stained images P1. This was confirmed quantitatively by a marked increase in digital stain contrast across the anterior LC boundary. The results were also highly consistent for all 10 subjects. An improved visibility of connective tissues of the ONH has important clinical implication for glaucoma. Connective tissues are the main load bearing elements of the ONH, and there is evidence to suggest that biomechanical and/or morphologic features of these tissues may serve as strong biomarkers for glaucoma. For instance, we recently reported that LC shape was associated with several risk factors for glaucoma,
36 and that LC strain relief following trabeculectomy was associated with visual field loss.
37 Furthermore, a recent study by Yang et al.
7 summarized the main connective tissue changes associated with chronic IOP elevation in a monkey model. The five connective tissue changes included: post-laminar deformation, laminar thickening, scleral canal expansion, laminar migration, and scleral bowing. It is highly plausible that some or all of these phenomena will hold true in humans (as already demonstrated for some),
38,39 emphasizing the importance of monitoring connective tissue behavior in vivo. Our digital staining algorithm may help serve that purpose.
Digital staining, as proposed herein, should also considerably facilitate the automated segmentation of connective tissues. While automated segmentation of retinal cell layers in OCT images is robust,
40 automated segmentation of the LC and of the choroidal vessels has remained a challenge, and only a few solutions, sometimes complex, have been proposed.
41–44 While this is beyond the scope of the present work, simple segmentation algorithms should be able to be combined with digital staining to automatically identify structures such as the anterior LC surface or the choroidal vessels and this is the focus of ongoing work within our group.
In this study, we found the digitally stained images P2 represented the nerve fiber layer and the prelaminar tissue, while the digitally stained images P3 represented all other retinal layers. These tissues were identified because they were found to be the most dissimilar to connective tissues (through the minimization of scalar products between histogram vectors). We believe that digital staining opens the door to robust and automated quantification methods to assess nervous tissue damage/changes in glaucoma. For instance, automated characterization of nervous tissue parameters, such as nerve fiber layer thickness, prelaminar volume, and minimum rim width should become facilitated with digital staining.
Interestingly, the digitally stained images P4 highlighted the image background, that is, the vitreous humor above the inner limiting membrane and the OCT noise in the deepest part of the images. In other words, the images P4 provided a mask of all visible ONH tissues, P4 images could eventually be used to detect the inner limiting membrane, and/or to filter deep OCT noise, which may be useful as the first step of a segmentation algorithm.
It is worth noting that the performance of digital staining was optimum only when combined with adaptive compensation. If digital staining were to be directly applied to baseline OCT images of the ONH, typical OCT artifacts, such as blood vessel shadows and poor connective tissue visibility at high depth would still remain in the digitally stained images (data not shown). As discussed in our prior publication,
16 this illustrates that adaptive compensation may be a necessary first step toward a simple solution to automatically segment the ONH tissues.
When compared with k-means clustering, it was observed that digital staining was able to extract four different layers of tissue textures, whereas k-means clustering generated mixed results. With four clusters, k-means clustering was not able to isolate the anterior LC boundary (4C1versus P1 in
Fig. 5), and the nerve fiber layer (4C2 and 4C3 versus P2). In addition, 4C4 contained both nerve tissues and noise (whereas P4 only highlighted noise). With three clusters, k-means clustering was able to produce a ‘connective-tissue' image (3C1) with similarities to P1, but other features such as the nerve fiber layer and the noise could not be extracted. On the other hand, k-means clustering is relatively faster than digital staining, and it may prove useful when extracting the ‘connective-tissue' image 3C1. However, it remains important to emphasize that digital staining is able to isolate several tissue textures and does not simply separate gray levels as clusters in the compensated images.
Several limitations in our work warrant further discussion. First, we were unable to provide an additional validation of our algorithm by comparing our digitally stained images to those obtained from histology. This is, unfortunately, extremely difficult to achieve as one would need to image an ONH with OCT, process it with 3D histology, and register both volumes. Note that the broad understanding of OCT ONH anatomy to histology has been based on a single comparison with a normal monkey eye scanned in vivo at an IOP of 10 mm Hg and then perfusion fixed at time of sacrifice at the same IOP.
45 The tissue typing delineated by our digital staining techniques matches the expected relationships observed in this canonical work. At the time of writing, there have been no published experiments matching human ONH histology to OCT images. While the absence of this work prevents an absolute validation of our technique, the same shortcoming necessarily applies to every other in vivo investigation of deep OCT imaging of the human investigation, many publications of which predate even the publication of the comparison with the monkey ONH.
Second, we limited our analysis to a small group (10 subjects). We did not include cases with ‘complex' ONH morphologies such as glaucoma, papilledema, peripapillary atrophy, and ONH drusen. However, it is encouraging to note that our data were highly consistent across these subjects. Current work is ongoing to further test the performance of digital staining in larger groups of subjects, with various disorders, and using additional commercially available OCT devices.
Third, digital staining was only tested for a given number of histogram vectors (here, 4) and a given set of ROI values. Note that other parameters values were explored and led to similar digital stain results (data not shown). It should be emphasized that as long as the chosen ROIs are representative but smaller than the tissues of interest that need to be detected, digital stain results will remain consistent.
Fourth, our digital staining algorithm requires an initial manual input to generate the first histogram vector h1 (representative of connective tissues). This meant that the user of the algorithm had to first identify a small ROI within the LC. We chose such an implementation because it helped considerably reduce computational time, and because in practice, the user may be interested in selecting a specific tissue that needs to be digitally stained. Future research may offer the possibility to fully automate the process if needed.
Fifth, digital staining is currently unable to differentiate the LC from the retrolaminar tissues. We believe this is because current commercial OCT technology (wavelength in the range of 800–1000 nm) fails to properly identify the posterior surface of the LC. In our previous work, we found that the posterior LC was poorly visible and only visible in 6.3% to 13.5% of patients in a population of 60 healthy and 60 glaucoma patients imaged with 3 commercial OCT devices.
18 The visibility of the posterior LC boundary was only slightly improved when enhanced-depth imaging and/or adaptive compensation was combined with OCT (visible in 12.3%–21% of patients). Because digital staining is highly dependent on the original OCT signal, an improvement in OCT hardware would likely be required to differentiate the LC from the retrolaminar tissues.
Sixth, while compensation can significantly improve image quality, in some instances, it may generate its own artifacts. These artifacts will naturally remain during the digital staining step, as digital staining does not modify the images but rather highlight tissue groups. Next-generation compensation algorithms are required to further improve digital staining.
Seventh, it should be noted that the present method is not a segmentation method nor a clustering method, but indeed a texture staining approach where specific tissues are highlighted. Future work could consider using more complex texture features or seek to combine the digital staining outputs with segmentation algorithms to automatically delineate the boundaries of the different tissue types.
Eighth, digital staining when combined with swept-source OCT (instead of spectral-domain OCT) may provide improved tissue visibility. However, our previous study demonstrated that swept-source OCT (with adaptive compensation) performed as well as spectral-domain OCT (with enhanced-depth imaging and adaptive compensation) in identifying the anterior LC surface and the LC insertions into the peripapillary sclera. The visibility of the posterior LC surface remained poor with either swept-source or spectral-domain OCT.
18 Further studies are required to assess the performance of digital staining when combined with swept-source OCT.
Ninth, digital staining will not be able to provide direct information about changes in neural and/or connective tissues. To assess such changes, digital staining will need to be combined with other segmentation algorithms that can quantify (e.g., thickness, volume, curvature, and morphology).
Tenth, digital staining approximately took 60 minutes to process a 3D OCT volume composed of 100 B-scans (<1 minute per slice) on a standard computer (Intel Processor i5; Intel Corporation, Santa Clara, CA) using Matlab. K-means clustering was faster and only took several seconds for a single B-scan. However, please note the following: (1) k-means clustering was not implemented in 3D (only 2D) and a 3D implementation is likely to be more computationally expensive, (2) digital staining was not optimized for code efficiency, (3) digital staining will run significantly faster (several orders of magnitude) in a different language such as C++, or if implemented in a Graphics Processing Unit environment.
Finally. It would have been ideal to quantitatively compare the results from digital staining with those from k-means clustering, but such a comparison would be arbitrary as the results are different in nature. Indeed, the k-means algorithm returns information about clusters (binarized information) while digital staining the ‘likeliness' (in %) of a given pixel to belong to a specific tissue or tissue group. As the cluster information is either one or zero, either a distance measure (measure of differences) would be based on arbitrary values, or the comparison of binarized images with both approaches would depend on a selected binarization threshold value (for digital staining). Furthermore, as there is currently no OCT ground truth information to assess both results independently, it is difficult to determine a quantitative level of success for each approach. One could argue that the comparison could be performed on synthetic data; however, the results would be excellent for both approaches, and a quantitative distance-based comparison would provide inconclusive results. Nevertheless, we still believe a qualitative comparison, as presented herein, is useful in assessing both approaches.
In conclusion, we have described a novel algorithm that can digitally stain connective and neural tissues in OCT images of the ONH. Our algorithm was verified with a digital phantom, compared with a modern clustering algorithm, and tested in 10 subjects with consistent digital stains. Because ONH connective and neural tissues are altered in glaucoma, digital staining (when combined with segmentation algorithms to derive measures of ONH morphology) may be of interest in the clinical management of glaucoma. Digital staining may also have wide applicability in other areas of ophthalmic interest, such as the identification of corneal scars in anterior segment images.
17 Furthermore, it will also be of interest in other fields of medicine in which there is clinical application of OCT, such as in cardiology for the identification of atherosclerotic plaques.
46
Supported by grants from a NUS Young Investigator Award (MJAG; NUSYIA_FY13_P03, R-397-000-174-133). The National Institute for Health Research (NIHR) Biomedical Research Centre based at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute of Ophthalmology (NGS). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health. This work was presented in part as a talk at the ARVO Imaging of the Eye Conference in May 2016 in Seattle, WA.
Disclosure: J.-M. Mari, None; T. Aung, None; C.-Y. Cheng, None; N.G. Strouthidis, None; M.J.A. Girard, None