#PAGE_PARAMS# #ADS_HEAD_SCRIPTS# #MICRODATA#

Accuracy of intraocular lens power calculation formulas using a swept-source optical biometer


Authors: Se Young Kim aff001;  Seung Hyun Lee aff001;  Na Rae Kim aff001;  Hee Seung Chin aff001;  Ji Won Jung aff001
Authors place of work: Department of Ophthalmology and Inha Vision Science Laboratory, Inha University School of Medicine, Incheon, South Korea aff001
Published in the journal: PLoS ONE 15(1)
Category: Research Article
doi: https://doi.org/10.1371/journal.pone.0227638

Summary

Purpose

To compare the accuracy of the five commonly used intraocular lens (IOL) calculation formulas integrated to a swept-source optical biometer, the IOLMaster 700, and evaluate the extent of bias within each formula for different ocular biometric measurements.

Methods

The study included patients undergoing cataract surgery with a ZCB00 IOL implant, using IOLMaster 700 optical biometry. A single eye per patient was included in the final analysis for a total of 324 cases. The SRK/T, Hoffer Q, Haigis, Holladay 2, and Barrett Universal II formulas were evaluated. The correlations between the refractive prediction errors calculated using the five formulas and ocular dimensions such as axial length (AL), anterior chamber depth (ACD), corneal power, and lens thickness (LT) were analyzed.

Results

There were significant differences in the median absolute error predicted by the five formulas after the adjustment for mean refractive prediction errors to zero (P = 0.038). The Barrett Universal II formula had the lowest median absolute error (0.263) and resulted in a higher percentage of eyes with prediction errors within ±0.50 D, ±0.75 D, and ±1.00 D (all P < 0.050). The refractive errors predicted by only the Barrett formula showed no significant correlation with the ocular dimensions: AL, ACD, corneal power, and LT.

Conclusions

Overall, the Barrett Universal II formula, integrated to a swept-source optical biometer had the lowest prediction error and appeared to have the least bias for different ocular biometric measurements for the ZCB00 IOL.

Keywords:

Surgical and invasive medical procedures – Eyes – Cornea – Cataract surgery – eye lens – Surgeons – Biometrics – Biostatistics

Introduction

The development of optical biometry and intraocular lens (IOL) power calculation formulas has improved the refractive outcomes of cataract surgery. Advanced technologies related to optical biometry such as partial coherence interferometry (PCI), optical low-coherence reflectometry (OLCR), and swept-source optical coherence tomography (SS-OCT) have increased the precision of biometric measurements. [14] Modern IOL power calculation formulas have tried to improve the accuracy of their predictions of effective lens position (ELP). For the most part, this has been accomplished by increasing the number of variables—including preoperative anterior chamber depth (ACD, measured from epithelium to lens), lens thickness (LT), corneal diameter, preoperative refraction, and age—as well as basic variables such as axial length (AL) and corneal power (K).

The IOL calculation formulas show similarly accurate refractive results in eyes with normal AL. [5] However, the accuracy of these formulas differ in eyes with short and long AL. [57] The Hoffer Q formula provide the more accurate outcomes in eyes with a short AL [5,8,9] and the SRK/T and Haigis formulas are suitable in eyes with a long AL. [8,1013] Nevertheless, accurately predicting the ELP remains a major source of error in IOL power calculations, and controversy persists about the accuracy of refractive predictions among many formulas. [14] Because there is no single highly accurate formula across a range of eye characteristics such as long or short AL, flat or steep cornea, and deep or shallow ACD, many cataract surgeons should consider and use several formulas in eyes with various ocular dimensions. [8,15,16]

The Barrett Universal II formula was recently introduced and its accuracy has been studied, and better refractive outcomes than those of other formulas have been reported. [14,16,1719] The newly developed IOLMaster 700 (Carl Zeiss Meditec AG, Jena, Germany) adopted SS-OCT technology and recently integrated the latest-generation Barrett IOL power calculation formulas. Therefore, cataract surgeons can automatically apply this formula using this device.

The purpose of this study was to determine which of the commonly used IOL formulas integrated to the IOLMaster 700 swept-source optical biometer is the best predictor of actual postoperative refractive outcomes: SRK/T, Hoffer Q, Haigis, Holladay 2, and Barrett Universal II. We also evaluated the extent of bias within each formula for the different ocular biometric measurements (AL, corneal power, ACD, LT).

Materials and methods

This retrospective chart review comprised all cataract surgeries performed in 2018 and 2019 at a tertiary center. The study received approval from the institutional review board of Inha University Hospital (no. 2018-11-010), and the IRB waived the requirement for informed consent. All research and data collection followed the tenets of the Declaration of Helsinki. Confidentiality of the information was maintained thoroughly by excluding names as identification in data abstraction form and keeping their privacy during data collection. No one had access to the non-coded data except investigators, data collectors and supervisor due to responsibilities associated with the study. This retrospective cross-sectional study included consecutive Korean patients who underwent uncomplicated phacoemulsification with an implantation of the most commonly used IOL (TECNIS® ZCB00, Johnson & Johnson Vision, Santa Ana, CA, USA) at our institution. Two surgeons performed the surgery by clear corneal temporal incision phacoemulsification. All patients underwent preoperative measurements by the IOLMaster 700, a swept-source optical biometer.

Our selection criteria for the study subjects and methods followed the recommendations of recent studies regarding the protocols for studies of IOL formula accuracy. [20,21] The exclusion criteria were incomplete biometry, corneal astigmatism more than 2.0 diopters (D), LT measurement less than 2.50 mm, complicated cataract surgery (posterior capsular rupture), additional procedures during cataract surgery (combined vitrectomy or glaucoma surgery), postoperative corrected distance visual acuity (CDVA) worse than 20/40, refraction performed before 4 weeks postoperatively, postoperative complications, and incomplete documentation. Patients with a history of corneal disease or refractive surgery and phacomorphic glaucoma were excluded. If both eyes were eligible, the first eye was selected. Fig 1 shows an overview of the study’s selection criteria.

Overview of the study selection process.
Fig. 1. Overview of the study selection process.

The commonly used and more recent five IOL power calculation formulas built-in software of IOLMaster 700 (software version 1.8) were evaluated: SRK/T, Hoffer Q, Haigis, Holladay 2, and Barrett Universal II. Lens constant optimizations for the ZCB00 IOL were performed in collaboration with Carl Zeiss Meditec AG, which has licensed versions of the proprietary Barrett Universal II and Holladay 2 as well as implementations of the SRK/T, Hoffer Q, and Haigis formulas. [5, 22, 23] The A-constant for SRK/T was 119.3 and the pseudophakic ACD was 5.80 for the Hoffer Q formula. The a0, a1, and a2 constants were -1.302, 0.210, and 0.251, respectively, for the Haigis formula and the ACD was 5.786 for the Holladay 2. The lens factor was 2.04 for the Barrett Universal II. [24]

Postoperative subjective manifest refraction was measured at least 1 month after surgery, when the refraction is considered stable. The refractive prediction error was then calculated as the actual postoperative refraction minus the refractive result predicted by each formula for the IOL implanted. The mean refractive prediction errors for each formula were zeroed out by adjusting the refractive prediction error for each eye. After the adjustment of the mean refractive prediction error to zero, the standard deviation (SD) of prediction error, median absolute error (MedAE), and mean absolute error (MAE) for each formula were calculated. The percentages of eyes within ±0.25 D, ±0.50 D, ±0.75 D, and ±1.00 D of the refractive prediction error were calculated.

Statistical analysis

All statistical analyses were performed using SPSS for Windows (version 20.0; SPSS Inc., Chicago, IL, USA). To compare the accuracies of the five formulas, we used the Friedman non-parametric test of the MedAE. The post-hoc test of the Wilcoxon signed rank test was performed for multiple comparisons of the formulas. We used Cochran’s Q test to compare the percentage of eyes within a certain range of prediction errors between the five formulas. The post-hoc test of McNemar’s test was performed for multiple comparisons of the formulas. Bonferroni correction was applied for multiple comparisons. Linear regression analysis was used to evaluate the correlation between refractive errors predicted by each formula and preoperative biometric factor. Adjusted P values (by Bonferroni correction) less than 0.05 were considered statistically significant.

Results

Data from 324 eyes of 324 patients were evaluated. The majority (n = 179, 55.2%) of the samples were left eyes and more women (n = 193, 59.6%) than men underwent cataract surgery during the study period. The demographic and biometric characteristics of the patient populations are shown in Table 1. The mean axial length was 23.34 ± 1.10 mm, mean corneal power was 44.42 ± 1.65 diopter, and mean ACD was 3.06 ± 0.48 mm.

Tab. 1. Demographics and biometric data using a single optical biometry device (IOLMaster 700) in the patients who underwent cataract surgery (n = 324).
Demographics and biometric data using a single optical biometry device (IOLMaster 700) in the patients who underwent cataract surgery (n = 324).

Table 2 shows the mean refractive prediction errors, SD of prediction error, MedAE, and MAE determined by the five formulas in the 324 eyes after the prediction errors for each formula were zeroed out. The MedAEs with adjusting the refractive prediction error to zero are shown in Fig 2. The Friedman test confirmed that there were statistically significant differences among the absolute prediction errors of the five formulas (P = 0.038). Post hoc analysis using Wilcoxon signed-rank pairwise comparisons for nonparametric samples with Bonferroni correction showed that the Barrett had a significantly smaller MedAE than the other formulas; SRK/T (P = 0.020), Hoffer Q (P = 0.048), Haigis (P = 0.012), and Holladay 2 (P = 0.024).

Box plot of the absolute error (in diopters) of the five intraocular lens (IOL) calculation formulas for the ZCB00 model.
Fig. 2. Box plot of the absolute error (in diopters) of the five intraocular lens (IOL) calculation formulas for the ZCB00 model.
Dark gray boxes represent the second quartile, and white boxes represent the third quartile.
Tab. 2. Clinical outcomes of refractive prediction error and absolute error and among the five IOL formulas after adjusting the mean refractive prediction error to zero (n = 324).
Clinical outcomes of refractive prediction error and absolute error and among the five IOL formulas after adjusting the mean refractive prediction error to zero (n = 324).

The percentage of eyes within a certain range of prediction errors is shown in Table 2 and Fig 3. The percentages of eyes within ±0.50 D, ±0.75 D, and ±1.00 D of error were significantly different among the five formulas using the Cochran’s Q test (all P < 0.050). Post hoc analysis using McNemar’s test with Bonferroni correction was performed. The Barrett formula produced a higher percentage of eyes within ± 0.50 D of error than the Hoffer Q and Holladay 2 formulas (P < 0.001 and P = 0.016). The Barrett formula produced a higher percentage of eyes within ± 0.75 D of error than the other formulas; SRK/T (P = 0.048), Hoffer Q (P = 0.008), Haigis (P = 0.020), and Holladay 2 (P = 0.004). The Barrett also produced a higher percentage of eyes within ± 1.00 D of error than the Holladay 2 (P = 0.016).

Stacked histogram comparing the percentage of cases within a given diopter range of predicted refraction outcome of the five intraocular lens (IOL) calculation formulas for the ZCB00 model.
Fig. 3. Stacked histogram comparing the percentage of cases within a given diopter range of predicted refraction outcome of the five intraocular lens (IOL) calculation formulas for the ZCB00 model.

The refractive errors predicted by all formulas except that by the Barrett Universal II were significantly correlated with the AL on linear regression analysis (all P < 0.050). The refractive errors predicted by the SRK/T formula showed a significant negative correlation with keratometry (P < 0.001), while the Hoffer Q and Haigis formula showed a significant positive correlation with keratometry (P = 0.023 and P < 0.001). The Hoffer Q and Haigis formulas showed a significant positive correlation with ACD (P < 0.001 and P = 0.027), and the refractive errors predicted by the Haigis and Holladay 2 formulas were correlated with LT (all P < 0.001; Fig 4).

Scatterplots showing the correlations between the refractive prediction error calculated using the five formulas and ocular dimensions including axial length (AL), anterior chamber depth (ACD), mean keratometry, and lens thickness (LT).
Fig. 4. Scatterplots showing the correlations between the refractive prediction error calculated using the five formulas and ocular dimensions including axial length (AL), anterior chamber depth (ACD), mean keratometry, and lens thickness (LT).

Discussion

To our knowledge, this is the first study to compare the accuracy of IOL power calculation formulas on one IOL type (TECNIS® ZCB00) using a swept-source optical biometer, the IOLMaster 700. We reported on five commonly used IOL calculation formulas: popular third-generation (SRK/T, Hoffer Q) and fourth-generation (Haigis, Holladay 2, and Barrett Universal II). These formulas were preinstalled on the IOLMaster 700. We followed the recently published protocols comparing their respective accuracies. [20,21]

Overall, the refractive outcomes and percentages of eyes with prediction errors within ±0.25 D, ±0.50 D, ±0.75 D, and ±1.00 D for each formula were similar to those in the recent study by Melles et al. using a Lenstar 900 optical biometer. [16] All five formulas achieved above 92% of eyes within ±1.00 D of the predicted refraction, much higher than the 85% suggested by Gale et al. [25] Recent studies reported that the Barrett Universal II formula was more accurate and showed the better refractive outcomes than the other formulas. [16,1719,26] One large population study assessed the Barrett Universal II formula over the entire AL range and showed that this formula had the lowest MAE and SD of the prediction error and a higher percentage of eyes with prediction errors within ±0.25 D, ±0.50 D, and ±1.00 D, which was congruent with our findings. [18] In our study, the Barrett Universal II formula had the lowest median absolute error (0.263) and a higher percentage of eyes with prediction errors within ±0.50 D, ±0.75 D, and ±1.00 D compared to the other formulas. Cooke and Cooke [17] found that the same formula could give different results depending on the optical biometer (OLCR and PCI) and the preinstalled version or not. Our results suggested that the Barrett Universal II formula was the most accurate among the commonly used and representative five formulas integrated to an advanced swept-source optical biometer in our study subjects, who had mostly normal ranges of ocular dimension.

Hoffer et al. [27] reported a similar accuracy of IOL power calculation using the Hoffer Q, Holladay 1, and SRK/T formulas using both SS-OCT and OLCR instruments. In their study, the MedAEs and the percentage of eyes with prediction errors within ±0.50 D for Hoffer Q using IOLMaster 700, were better than our results. They evaluated the outcomes of different IOL models (MX60 and SA60AT) and ocular dimensions of their subjects were relatively different from those of our subjects. These were estimated as the possible causes of this discrepancy.

Here we also evaluated the extent of bias within each formula for different ocular biometric measurements. The refractive errors predicted by all but the Barrett Universal II formula, was significantly correlated with the AL. The SRK/T and Haigis formulas have significant bias with varying corneal power in opposite directions. According to the ACD, Hoffer Q and Haigis formulas showed a significant positive correlation, and the refractive errors predicted by Haigis and Holladay 2 formulas were correlated with the LT. Overall, the Barrett formula appeared to have the least bias of the formulas as measured by prediction error with variations in AL, corneal power, ACD, and LT. These results were similar to those reported by Melles et al., [16] who found notable biases in the errors of all other formulas except the Barrett when plotted versus ocular dimensions using a Lenstar 900 biometer.

When cataract surgeons select the IOL power during cataract surgery, they mainly use the preferred formula such as the Hoffer Q or SRK/T because modern IOL formulas have similar accuracy in eyes with a normal range. [6,28] However, surgeons should cross-check different IOL formulas in eyes with an unusual range of ocular dimensions such as a short or long AL, flat or steep cornea, or a recently shallow ACD. A swept-source optical biometer, the IOLMaster 700, integrated the various IOL formulas including the latest-generation Barrett IOL power calculation formula, and we can automatically apply these formulas and compare the predicted results without using a separate program. Because the formulas gave different results depending on which optical biometry measurements were used and the preinstalled version, [17] we first compared the accuracy of various IOL formulas integrated to a device and confirmed the bias of these formulas as measured by prediction error with variations in ocular dimensions.

The present study has some limitations. First, because we evaluated one popular IOL model, we caution that these results may not be generalizable to other IOL models. Second, the sample size of eyes with unusual ranges of ocular dimensions was relatively small; therefore, further studies with larger sample size are needed in these subgroups.

In conclusion, we found statistically significant differences in the MedAEs for the five formulas after the adjustment for mean refractive prediction errors to zero. Overall, the Barrett Universal II formula, integrated to a swept-source optical biometer, had the lowest prediction error for ZCB00 IOL model. The Barrett Universal II formula also appeared to have the least bias as measured by prediction error with variations in different biometric ocular dimensions including AL, corneal power, ACD, and LT.


Zdroje

1. Ferrer-Blasco T, Dominguez-Vicent A, Esteve-Taboada JJ, Aloy MA, Adsuara JE, Montes-Mico R. Evaluation of the repeatability of a swept-source ocular biometer for measuring ocular biometric parameters. Graefes Arch Clin Exp Ophthalmol. 2017;255: 343–349. doi: 10.1007/s00417-016-3555-z 27900479

2. Jung S, Chin HS, Kim NR, Lee KW, Jung JW. Comparison of repeatability and agreement between swept-source optical biometry and dual-scheimpflug topography. J Ophthalmol. 2017;2017: 1516395. doi: 10.1155/2017/1516395 29375908

3. Savini G, Hoffer KJ, Shammas HJ, Aramberri J, Huang J, Barboni P. Accuracy of a new swept-source optical coherence tomography biometer for IOL power calculation and comparison to IOLMaster. J Refract Surg. 2017;33: 690–695. doi: 10.3928/1081597X-20170721-05 28991337

4. Srivannaboon S, Chirapapaisan C, Chonpimai P, Loket S. Clinical comparison of a new swept-source optical coherence tomography-based optical biometer and a time-domain optical coherence tomography-based optical biometer. J Cataract Refract Surg. 2015;41: 2224–2232. doi: 10.1016/j.jcrs.2015.03.019 26703299

5. Hoffer KJ. The Hoffer Q formula: a comparison of theoretic and regression formulas. J Cataract Refract Surg. 1993;19: 700–712; errata 1994;20:677 and 2007;33:2–3. doi: 10.1016/s0886-3350(13)80338-0 8271165

6. Hoffer KJ. Clinical results using the Holladay 2 intraocular lens power formula. J Cataract Refract Surg. 2000;26: 1233–1237. doi: 10.1016/s0886-3350(00)00376-x 11008054

7. Olsen T, Thim K, Corydon L. Accuracy of the newer generation intraocular lens power calculation formulas in long and short eyes. J Cataract Refract Surg. 1991;17: 187–193. doi: 10.1016/s0886-3350(13)80249-0 2040976

8. Aristodemou P, Knox Cartwright NE, Sparrow JM, Johnston RL. Formula choice: Hoffer Q, holladay 1, or SRK/T and refractive outcomes in 8108 eyes after cataract surgery with biometry by partial coherence interferometry. J Cataract Refract Surg. 2011;37: 63–71. doi: 10.1016/j.jcrs.2010.07.032 21183100

9. Gavin EA, Hammond CJ. Intraocular lens power calculation in short eyes. Eye (Lond). 2008;22: 935–938.

10. Bang S, Edell E, Yu Q, Pratzer K, Stark W. Accuracy of intraocular lens calculations using the IOLMaster in eyes with long axial length and a comparison of various formulas. Ophthalmology. 2011;118: 503–506. doi: 10.1016/j.ophtha.2010.07.008 20884057

11. Chen C, Xu X, Miao Y, Zheng G, Sun Y, Xu X. Accuracy of Intraocular Lens Power Formulas Involving 148 Eyes with Long Axial Lengths: A Retrospective Chart-Review Study. J Ophthalmol. 2015;2015: 976847. doi: 10.1155/2015/976847 26793392

12. Chong EW, Mehta JS. High myopia and cataract surgery. Curr Opin Ophthalmol. 2016; 27: 45–50. doi: 10.1097/ICU.0000000000000217 26569522

13. Wang JK, Hu CY, Chang SW. Intraocular lens power calculation using the IOLMaster and various formulas in eyes with long axial length. J Cataract Refract Surg. 2008;34: 262–267. doi: 10.1016/j.jcrs.2007.10.017 18242451

14. Gokce SE, Zeiter JH, Weikert MP, Koch DD, Hill W, Wang L. Intraocular lens power calculations in short eyes using 7 formulas. J Cataract Refract Surg. 2017;43: 892–897. doi: 10.1016/j.jcrs.2017.07.004 28823434

15. Ladas JG, Siddiqui AA, Devgan U, Jun AS. A 3-D "super surface" combining modern intraocular lens formulas to generate a "super formula" and maximize accuracy. JAMA Ophthalmol. 2015;133: 1431–1436. doi: 10.1001/jamaophthalmol.2015.3832 26469147

16. Melles RB, Holladay JT, Chang WJ. Accuracy of intraocular lens calculation formulas. Ophthalmology. 2018;125: 169–178. doi: 10.1016/j.ophtha.2017.08.027 28951074

17. Cooke DL, Cooke TL. Comparison of 9 intraocular lens power calculation formulas. J Cataract Refract Surg. 2016;42: 1157–1164. doi: 10.1016/j.jcrs.2016.06.029 27531292

18. Kane JX, Van Heerden A, Atik A, Petsoglou C. Intraocular lens power formula accuracy: Comparison of 7 formulas. J Cataract Refract Surg. 2016;42: 1490–1500. doi: 10.1016/j.jcrs.2016.07.021 27839605

19. Reitblat O, Assia EI, Kleinmann G, Levy A, Barrett GD, Abulafia A. Accuracy of predicted refraction with multifocal intraocular lenses using two biometry measurement devices and multiple intraocular lens power calculation formulas. Clin Exp Ophthalmol. 2015;43: 328–334. doi: 10.1111/ceo.12478 25491591

20. Hoffer KJ, Aramberri J, Haigis W, Olsen T, Savini G, Shammas HJ, et al. Protocols for studies of intraocular lens formula accuracy. Am J Ophthalmol. 2015;160: 403–405.e1. doi: 10.1016/j.ajo.2015.05.029 26117311

21. Wang L, Koch DD, Hill W, Abulafia A. Pursuing perfection in intraocular lens calculations: III. criteria for analyzing outcomes. J Cataract Refract Surg. 2017;43: 999–1002. doi: 10.1016/j.jcrs.2017.08.003 28917430

22. Retzlaff JA, Sanders DR, Kraff MC. Development of the SRK/T intraocular lens implant power calculation formula. J Cataract Refract Surg. 1990;16: 333–340; erratum, 528. doi: 10.1016/s0886-3350(13)80705-5 2355321

23. Haigis W, Lege B, Miller N, Schneider B. Comparison of immersion ultrasound biometry and partial coherence interferometry for intraocular lens calculation according to Haigis. Graefes Arch Clin Exp Ophthalmol. 2000;238: 765–773. doi: 10.1007/s004170000188 11045345

24. User Group for Laser Interference Biometry (ULIB). Available:http://ocusoft.de/ulib/c1.htm.

25. Gale RP, Saldana M, Johnston RL, Zuberbuhler B, McKibbin M. Benchmark standards for refractive outcomes after NHS cataract surgery. Eye (Lond). 2009;23: 149–152.

26. Wang JK, Chang SW. Optical biometry intraocular lens power calculation using different formulas in patients with different axial lengths. Int J Ophthalmol. 2013;6: 150–154. doi: 10.3980/j.issn.2222-3959.2013.02.08 23638414

27. Hoffer KJ, Hoffmann PC, Savini G. Comparison of a new optical biometer using swept-source optical coherence tomography and a biometer using optical low-coherence reflectometry. J Cataract Refract Surg. 2016;42: 1165–1172. doi: 10.1016/j.jcrs.2016.07.013 27531293

28. Yang S, Whang WJ, Joo CK. Effect of anterior chamber depth on the choice of intraocular lens calculation formula. PLoS One. 2017;12: e0189868. doi: 10.1371/journal.pone.0189868 29253884


Článek vyšel v časopise

PLOS One


2020 Číslo 1
Nejčtenější tento týden
Nejčtenější v tomto čísle
Kurzy

Zvyšte si kvalifikaci online z pohodlí domova

Svět praktické medicíny 1/2024 (znalostní test z časopisu)
nový kurz

Koncepce osteologické péče pro gynekology a praktické lékaře
Autoři: MUDr. František Šenk

Sekvenční léčba schizofrenie
Autoři: MUDr. Jana Hořínková

Hypertenze a hypercholesterolémie – synergický efekt léčby
Autoři: prof. MUDr. Hana Rosolová, DrSc.

Význam metforminu pro „udržitelnou“ terapii diabetu
Autoři: prof. MUDr. Milan Kvapil, CSc., MBA

Všechny kurzy
Kurzy Podcasty Doporučená témata Časopisy
Přihlášení
Zapomenuté heslo

Zadejte e-mailovou adresu, se kterou jste vytvářel(a) účet, budou Vám na ni zaslány informace k nastavení nového hesla.

Přihlášení

Nemáte účet?  Registrujte se

#ADS_BOTTOM_SCRIPTS#