|Year : 2021 | Volume
| Issue : 2 | Page : 118-124
Natural history and clinical course of symptomatic and asymptomatic COVID-19 patients in the Kingdom of Saudi Arabia
Rasha A Almubark1, Ziad A Memish2, Hani Tamim3, Thamer H Alenazi4, Mohammed Alabdulla5, Faisal M Sanai6, Nasser F BinDhim7, Sarah Alfaraj8, Saleh A Alqahtani9
1 Scientific Affairs Department, Sharik Association for Health Research, Riyadh, Saudi Arabia
2 Research and Innovation Center, King Saud Medical City, Ministry of Health; College of Medicine, Al-Faisal University, Riyadh, Saudi Arabia; Hubert Department of Global Health, Rollins School of Public Health, Emory University, Atlanta, GA, USA
3 Department of Internal Medicine, American University of Beirut Medical Center, Beirut, Lebanon
4 Department of Medicine, King Abdulaziz Medical City; College of Medicine, King Saud Bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia
5 Department of Transplant Infectious Disease, Prince Mohammed Bin Abdulaziz Hospital, Riyadh, Saudi Arabia
6 Department of Medicine, Gastroenterology Unit, King Abdulaziz Medical City, Jeddah, Saudi Arabia
7 Scientific Affairs Department, Sharik Association for Health Research; College of Medicine, Al-Faisal University, Riyadh, Saudi Arabia; CEO Office, Saudi Food and Drug Authority, Rollins School of Public Health, Emory University, Atlanta, GA, USA
8 Infection Control and Corona Center, Prince Mohammed Bin Abdulaziz Hospital, Riyadh, Saudi Arabia
9 Liver Transplantation Unit, King Faisal Specialist Hospital and Research Center, Riyadh, Saudi Arabia; Division of Gastroenterology and Hepatology, John Hopkins University, Baltimore, USA
|Date of Submission||30-Nov-2020|
|Date of Decision||18-Feb-2021|
|Date of Acceptance||01-Apr-2021|
|Date of Web Publication||29-Apr-2021|
Rasha A Almubark
6996 Abi Baker As Siddiq Road, Yasmin Dis, Riyadh 13326
Objectives: To analyze symptomatic and asymptomatic COVID-19 patients in Saudi Arabia in terms of initial presentation, risk factors, laboratory findings, clinical outcomes and healthcare utilization.
Methods: All laboratory-confirmed reverse transcription–polymerase chain reaction positive COVID-19 patients who had been tested at three governmental hospitals in Saudi Arabia (two in Riyadh and one in Makkah) between March 8 and May 18, 2020 were included. Demographics, COVID-19 variables, clinical characteristics and healthcare utilization variables were extracted and combined, and a descriptive analysis was conducted. Symptomatic and asymptomatic (on presentation) patients' data were compared.
Results: Eighty percent of the patients were males (81.4% of symptomatic and 73.2% of asymptomatic patients, P = 0.02). Moreover, 47.6% and 38.4% of symptomatic and asymptomatic patients were aged 40–64 years, respectively. Fever, cough and breathing difficulties were frequent presenting symptoms. Overall, diabetes (16.4%), hypertension (11.7%), chronic respiratory disease (7.1%) were the most frequent comorbidities, with no differences between the two groups. Symptomatic patients had higher C-reactive protein levels (3.55 vs. 0.30 mg/L; P < 0.0001) and lower total lymphocytes (1.41 vs. 1.70; P = 0.02). ICU admission and mortality were 12.1% and 4.1% in symptomatic, compared to 6.0% and 2.9% in asymptomatic patients, respectively.
Conclusion: In the studied COVID-19 cohort, symptomatic patients tended to be older, had higher C-reactive protein and more lymphopenia with worse outcome than asymptomatic patients. This granular analysis of COVID-19 cohorts enables identification of at-risk cohorts in future waves, optimizing development of patient pathways and public health interventions.
Keywords: Coronavirus, epidemiology, public health surveillance, SARS-CoV-2, Saudi Arabia, symptoms
|How to cite this article:|
Almubark RA, Memish ZA, Tamim H, Alenazi TH, Alabdulla M, Sanai FM, BinDhim NF, Alfaraj S, Alqahtani SA. Natural history and clinical course of symptomatic and asymptomatic COVID-19 patients in the Kingdom of Saudi Arabia. Saudi J Med Med Sci 2021;9:118-24
|How to cite this URL:|
Almubark RA, Memish ZA, Tamim H, Alenazi TH, Alabdulla M, Sanai FM, BinDhim NF, Alfaraj S, Alqahtani SA. Natural history and clinical course of symptomatic and asymptomatic COVID-19 patients in the Kingdom of Saudi Arabia. Saudi J Med Med Sci [serial online] 2021 [cited 2021 Sep 18];9:118-24. Available from: https://www.sjmms.net/text.asp?2021/9/2/118/315141
| Introduction|| |
Coronavirus disease 2019 (COVID-19), caused by severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), remains one of the most challenging zoonotic infectious disease faced worldwide. As of February 10, 2021, over 106 million cases of COVID-19 had been reported worldwide that have resulted in > 2 million deaths. In the Kingdom of Saudi Arabia (KSA), which is the largest country in the Arabian Peninsula with a population of 34 million, 370,987 COVID-19 cases had been reported with 6410 deaths as of March 2nd, 2021.
A large proportion of those testing positive for COVID-19 are pauci-symptomatic or asymptomatic. In symptomatic patients, the clinical presentation of COVID-19 varies markedly and is impacted by risk factor groups, including older age and patients with comorbidities. The clinical features of COVID-19 appears to differ in prevalence in different clinical populations.
In the Middle East, few studies have reported the course and clinical presentation of COVID-19 and compared these between symptomatic and asymptomatic patients. Therefore, this study aims to compare the initial presentation, risk factors, laboratory findings and healthcare utilization of symptomatic and asymptomatic COVID-19 patients from KSA.
| Methods|| |
This retrospective study analyzed the clinical data of all laboratory-confirmed reverse transcription–polymerase chain reaction-positive COVID-19 patients who had been tested at three governmental hospitals in KSA (two in Riyadh and one in Makkah) between March 8 and May 18, 2020. This study was approved by the Ethics Committee of Ministry of Health (MoH) (Ref no.: 20-63E) and permissions were obtained from the concerned departments of all three hospitals.
Participants and setting
In KSA, healthcare is available for free at governmental hospitals for nationals, and expatriates typically access the private healthcare system through insurance supplied by their employer. Nonetheless, the Saudi government had passed an order for free COVID-19 treatment across the country to ensure larger accessibility. In addition, the testing facility was freely made available by the MoH at healthcare facilities, all individuals with suspected COVID-19 – either based on symptoms or exposure to those with confirmed COVID-19 – can be tested at these sites. If positive, they are immediately enrolled in the MoH testing and contact tracing program. In the early phase of the pandemic, all patients who tested positive were admitted to hospitals, which was later changed to only include symptomatic patients. To provide data for comparison between symptomatic and asymptomatic patients, this study retrospectively analyzed the data of the initial phase.
All cases presented in this study are from three governmental hospitals, that are part of the Saudi MoH: Al Noor Specialist Hospital, a 500-bed specialized teaching hospital located centrally in Makkah; Prince Mohammed bin Abdulaziz Hospital, a 500-bed hospital in Riyadh that is one of the major hospitals for COVID-19 case referrals; and Al-Imam Abdulrahman Al Faisal Hospital, Riyadh.
Grouping of patients was based on their initial presentation, with those presenting with at least one of the following symptoms were considered symptomatic: fever, cough, shortness of breath (SOB), sore throat, digestive symptoms, rhinorrhea, headache, or other symptoms. In the absence of any of the mentioned symptoms, patients were considered asymptomatic.
The following data were collected: demographics (gender, weight, and height), symptoms at presentation, reasons for testing (suspected as per case definition, contact of a positive case or travel history), baseline vitals and laboratory results, complete blood count, liver function, C-reactive protein, lactate dehydrogenase (LDH), D-dimer, alkaline phosphatase, albumin and total bilirubin. Moreover, information regarding treatment received, intensive care unit (ICU) admission, discharge date and survival (i e., death date) were also extracted. Data extraction was done by a single author and was quality checked by another author to ensure accuracy and quality of data.
The data were manually entered into a Microsoft Excel (Microsoft Corp, Redmond, WA), and then transferred to SPSS version 25 (SPSS Inc., Chicago, IL, USA) for data cleaning, management and analysis. The collected information is presented as total numbers and valid percentage for categorical variables, and as median and interquartile range (IQR) for continuous variables. Differences between variables for symptomatic and asymptomatic patients were assessed with a Chi-square test or independent t-test, as appropriate. P < 0.05 was considered statistically significant.
| Results|| |
A total of 1051 patients tested positive for COVID-19 in the three hospitals during the included period. [Table 1] details the demographic characteristics of these patients. The sample consisted of 80.3% males, with 2.0% being aged ≤18 years and 8.9% aged ≥65 years. Further, 24.7% of the patients were Saudi, 3.1% were healthcare workers, 5.9% were tested due to travel and 16.4% were linked epidemiologically to a confirmed case. In total, 913 (86.9%) patients were symptomatic. Significantly more males were symptomatic than asymptomatic (81.4% vs. 73.2%, respectively; P = 0.02). Moreover, symptomatic patients were more likely to be non-Saudi (P < 0.0001), and were less likely to be linked epidemiologically to a confirmed case (13.9%) compared to asymptomatic patients (32.6%, P < 0.0001).
|Table 1: Demographic, occupation, and reason for testing for patients infected with severe acute respiratory syndrome coronavirus-2 as well as distribution according to symptoms|
Click here to view
Comorbidities and symptomatology of the studied patients
The most common comorbidities were diabetes (16.4%), hypertension (11.7%) and chronic respiratory disease (7.1%). Diabetics were more likely to be symptomatic (17.5% vs. 12.0% among non-symptomatic), although the association was not statistically significant (P = 0.15). No significant differences were found in other comorbidities between the two groups. For BMI, data on weight was only available for 551 patients (52.4%), and symptomatic patients were found to more likely be obese than asymptomatic patients (26.6% and 18.8%, respectively, P = 0.09) was observed [Table 2].
|Table 2: Comorbidities and body mass index among patients infected with severe acute respiratory syndrome coronavirus-2 as well as distribution according to symptoms|
Click here to view
In the symptomatic group, the most common symptoms were fever and cough (66.0% and 64.5%, respectively). SOB, sore throat, and digestive symptoms were also frequently reported, although at a lower frequency (26.2%, 20.3% and 6.4%, respectively) [Figure 1]. Headache, fatigue, rhinorrhea or any other symptom were rarely reported.
|Figure 1: Prevalence of symptoms among patients infected with SARS-CoV-2 who were reported to be symptomatic|
Click here to view
Overall, no medians were found to be outside the reference ranges. When comparing the two groups, symptomatic patients were found to have significantly higher C-reactive protein levels (3.55 vs. 0.30 mg/L; P = <0.0001) and lower total lymphocyte levels (1.41 vs. 1.70; P = 0.02). Significant difference was not noted in any other studied parameters. Regarding vital signs, symptomatic patients had higher heart rate (95.0 beats/min) than asymptomatic patients (86.0 beats/min) (P < 0.0001) [Table 3].
|Table 3: Baseline laboratory results and vital signs for patients infected with severe acute respiratory syndrome coronavirus-2 as well as distribution according to symptoms|
Click here to view
Healthcare utilization and outcome
Antibiotics and hydroxychloroquine were frequently administered (73.9% and 32.0%, respectively), while steroids and antiviral drugs were less common (14.8% and 20.5%, respectively) [Table 4]. Antibiotics were more frequently administered to symptomatic patients (78.6% vs. 34.5%, P < 0.0001). Similarly, hydroxychloroquine and corticosteroids were more frequently administered to symptomatic patients (34.7% and 14.8%, respectively) than asymptomatic patients (9.2% and 2.5%, respectively) (P < 0.0001 and 0.001, respectively). Oseltamivir use was not significantly different between the two groups.
|Table 4: Intensive care unit admission, management, and outcome of patients infected with severe acute respiratory syndrome coronavirus-2 as well as distribution according to symptoms|
Click here to view
A total of 11.3% of the patients were admitted to the ICU, with symptomatic patients more likely to be admitted (12.1% vs. 6.0%, P = 0.04). Hospital stay of less than 2 days was rare (10.2%); most were admitted for 2–7 days (52.5%%), followed by 8–14 days (26.8%) and >2 weeks (10.4%). No differences were found between the two groups in terms of lengths of hospital stay. The vast majority (73.3%) of the patients had been discharged at the time of data collection, but about one-fifth (22.8%) remained admitted, while 3.9% had died.
| Discussion|| |
The clinical features of patients hospitalized for COVID-19 in the KSA were similar to patients in studies from other parts of the world: a significant number of our patients had underlying medical conditions, and a considerable proportion of patients were asymptomatic.
About 80% of COVID-19 patients in this study were male; similar proportions have been observed in China, Italy and the United States.,, It is currently unclear why COVID-19 infects males at a higher rate, and further research will be needed to understand this epidemiologic trend. The median age in this study (41 years) was noticeably lower than that in other countries. For example, the median age of patients with COVID-19 reported from other countries was between 62 − and 66 − years old in the United States,,, 63 − years old in Italy, and ranged from 49 − to 56 − years old in Wuhan, China.,, This could be attributed to the fact that that KSA has a younger population compared to European and Asian countries.,
Diabetes, hypertension, and chronic lung disease were common comorbidities, similar to previous reports of patients hospitalized for COVID-19,,,, It is well established that patients with diabetes are at increased risk of viral infections and related complications, due to impaired immune responses against viral pathogens. Although not yet fully established, it has been postulated that the weakened immune system expedites the progression of COVID-19 in patients with diabetes. Accordingly, those with diabetes are at higher risk of severe disease, need for mechanical ventilation and admission to ICU; these factors likely contribute to the overall poor survival in this subset of patients. Although the pathogenesis of COVID-19 in patients with hypertension or COPD remains poorly understood, both comorbidities are independently associated with a 2.5-and a 5.7-fold risk of COVID-19 disease severity and death, respectively.,,
In our cohort, the majority of the patients were symptomatic. Among asymptomatic patients, some developed symptoms during the hospital stay. We believe the percentage of positive asymptomatic is underestimated, as one of the criteria for undertaking a COVID-19 test in KSA is the presence of symptoms or known exposure to a confirmed case. A random community wide testing would provide a more robust understanding of the percentage of asymptomatic patients. Further studies focused on random, unbiased testing of individuals would be necessary to accurately determine the exact percentage of patients who remain asymptomatic. Understanding this proportion is of great importance, as asymptomatic patients are at risk of transmitting the virus., In fact, it is believed that the spread of the infection by asymptomatic individuals, combined with the relatively high basic reproduction number (R0) of 5.7 hastened the global pandemic and hindered public health efforts to effectively prevent and control the pandemic. Several studies have attempted to estimate the rate of asymptomatic COVID-19 infection, but the estimates vary widely (from 2% to 52%) and depend on the geographic location and setting.,,, Irrespective of the actual value, our results support a low threshold for testing of COVID-19 and stress the need for testing availability to diagnose COVID-19, particularly in asymptomatic patients.
Interestingly, most of the laboratory values were within normal ranges. The degree of abnormalities in the laboratory findings of patients with COVID-19 varies across different studies,,,,, but the levels of LDH and total lymphocytes are consistently reported as elevated in these patients. In our study, both the LDH and lymphocytes level were within the normal range. It must be noted that the patients in this study were younger and had fewer comorbidities; presumably, they were healthier and more able to mount an adequate immune response against the virus, which would minimize the degree of laboratory abnormalities. To fully understand the link between age and degree of laboratory abnormalities, future large-scale studies are needed to compare patients with and without laboratory abnormalities, particularly LDH, lymphocyte, ferritin, D-dimer, procalcitonin and interleukin 6 levels. Similarly, the lack of laboratory abnormalities combined with fewer comorbidities and younger age may have contributed to the study's favorable composite endpoints. Overall, 10% of our cohort was admitted to the ICU, nearly 73% of patients were discharged and <4% died. These rates compared favorably to previously reported values for ICU admission (14%−39%), discharge (26%−66%) and mortality (7%−26%).,,,,,,,
The study had some noteworthy limitations and strengths. The study was a retrospective, cross-sectional analysis, and no patient data were collected after hospital discharge. Further, we were unable to collect the data for several different parameters for a significant proportion of patients. Notwithstanding, the study included COVID-19 patients from hospitals in two large metropolitan cities in KSA. To our knowledge, this is only the third study that describes the characteristics of patients with confirmed COVID-19 hospitalized in the KSA., Therefore, this study adds to the growing body of literature characterizing the clinical features of COVID-19. The majority of currently available studies are retrospective in design, limited to single centers and carried out during short time periods. In the future, larger prospective, multi-center studies are required to be conducted over longer observation periods and with a larger sample size. Likewise, more studies are necessary to adequately examine and compare the clinical features and outcomes of patients with COVID-19 and MERS, to facilitate the implementation of optimal prevention and control strategies not only for COVID-19 but also in the event of any future coronavirus outbreaks.
| Conclusion|| |
In this studied COVID-19 cohort in KSA, about 80% of the patients were male. Symptomatic patients tended to be older, had higher C-reactive protein and more lymphopenia with worse outcome than asymptomatic patients. This granular analysis of COVID-19 cohorts enables identification of at-risk cohorts in future waves, optimizing development of patient pathways and public health interventions.
Ethical approval for this study was obtained from the Ethics Committee of Saudi Ministry of Health (Ref no.: 20-63E) on April 22, 2020.
This article was peer-reviewed by three independent and anonymous reviewers.
Financial support and sponsorship
Conflict of interest
There are no conflicts of interest.
| References|| |
WHO. WHO Coronavirus Disease (COVID-19) Dashboard. WHO Health Emergency Dashboard 2021. Available from: https://covid19.who.int.
[Last accessed on 2021 Feb 10].
Day M. Covid-19: Four fifths of cases are asymptomatic, China figures indicate. BMJ 2020;369:m1375.
Jiang F, Deng L, Zhang L, Cai Y, Cheung CW, Xia Z. Review of the clinical characteristics of coronavirus disease 2019 (COVID-19). J Gen Intern Med 2020;35:1-5.
Alshammari TM, Altebainawi AF, Alenzi KA. Importance of early precautionary actions in avoiding the spread of COVID-19: Saudi Arabia as an Example. Saudi Pharm J 2020;28:898-902.
Goyal P, Choi JJ, Pinheiro LC, Schenck EJ, Chen R, Jabri A, et al
. Clinical characteristics of COVID-19 in New York City. N Engl J Med 2020;382:2372-4.
Grasselli G, Zangrillo A, Zanella A, Antonelli M, Cabrini L, Castelli A, et al
. Baseline Characteristics and Outcomes of 1591 Patients Infected With SARS-CoV-2 Admitted to ICUs of the Lombardy Region, Italy. JAMA 2020;323:1574-81.
Wang D, Hu B, Hu C, Zhu F, Liu X, Zhang J, et al
. Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan, China. JAMA 2020;323:1061-9.
Aggarwal S, Garcia-Telles N, Aggarwal G, Lavie C, Lippi G, Henry BM. Clinical features, laboratory characteristics, and outcomes of patients hospitalized with coronavirus disease 2019 (COVID-19): Early report from the United States. Diagnosis (Berl) 2020;7:91-6.
Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al
. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized With COVID-19 in the New York City Area. JAMA 2020;323:2052-9.
Chen N, Zhou M, Dong X, Qu J, Gong F, Han Y, et al
. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: A descriptive study. Lancet 2020;395:507-13.
Huang C, Wang Y, Li X, Ren L, Zhao J, Hu Y, et al
. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020;395:497-506.
Saudi Arabia General Authority for Statistics. General Authority for Statistics. General Authority for Statistics n.d. Available from: https://www.stats.gov.sa/en.
[Last accessed on 2020 Jan 06].
Alyami MH, Naser AY, Orabi MA, Alwafi H, Alyami HS. Epidemiology of COVID-19 in the Kingdom of Saudi Arabia: An ecological study. Front Public Health 2020;8:506.
Centers for Disease Control and Prevention. Morbidity and Mortality Weekly Report (MMWR) | MMWR n.d. Available from: https://www.cdc.gov/mmwr/index.html.
[Last accessed on 2020 Jun 18].
Emami A, Javanmardi F, Pirbonyeh N, Akbari A. Prevalence of underlying diseases in hospitalized patients with COVID-19: A systematic review and meta-analysis. Arch Acad Emerg Med 2020;8:e35.
Pranata R, Lim MA, Huang I, Raharjo SB, Lukito AA. Hypertension is associated with increased mortality and severity of disease in COVID-19 pneumonia: A systematic review, meta-analysis and meta-regression. J Renin Angiotensin Aldosterone Syst 2020;21:1470320320926899.
Yang J, Zheng Y, Gou X, Pu K, Chen Z, Guo Q, et al
. Prevalence of comorbidities and its effects in patients infected with SARS-CoV-2: A systematic review and meta-analysis. Int J Infect Dis 2020;94:91-5.
Kronsteiner B, Chaichana P, Sumonwiriya M, Jenjaroen K, Chowdhury FR, Chumseng S, et al
. Diabetes alters immune response patterns to acute melioidosis in humans. Eur J Immunol 2019;49:1092-106.
Hussain A, Bhowmik B, do Vale Moreira NC. COVID-19 and diabetes: Knowledge in progress. Diabetes Res Clin Pract 2020;162:108142.
Yan Y, Yang Y, Wang F, Ren H, Zhang S, Shi X, et al
. Clinical characteristics and outcomes of patients with severe COVID-19 with diabetes. BMJ Open Diabetes Res Care 2020;8:e001343.
Lippi G, Henry BM. Chronic obstructive pulmonary disease is associated with severe coronavirus disease 2019 (COVID-19). Respir Med 2020;167:105941.
Lippi G, Wong J, Henry BM. Hypertension in patients with coronavirus disease 2019 (COVID-19): A pooled analysis. Pol Arch Intern Med 2020;130:304-9.
Almadi MA, Aljebreen AM, Azzam N, Alammar N, Aljahdli ES, Alsohaibani FI, et al
. COVID-19 and endoscopy services in intermediately affected countries: A position statement from the Saudi Gastroenterology Association. Saudi J Gastroenterol 2020;26:240-8.
] [Full text]
Gao Z, Xu Y, Sun C, Wang X, Guo Y, Qiu S, et al
. A systematic review of asymptomatic infections with COVID-19. J Microbiol Immunol Infect 2021;54:12-16.
Nishiura H, Kobayashi T, Miyama T, Suzuki A, Jung SM, Hayashi K, et al
. Estimation of the asymptomatic ratio of novel coronavirus infections (COVID-19). Int J Infect Dis 2020;94:154-5.
Ki M; Task Force for 2019-nCoV. Epidemiologic characteristics of early cases with 2019 novel coronavirus (2019-nCoV) disease in Korea. Epidemiol Health 2020;42:e2020007.
Kimball A. Asymptomatic and presymptomatic SARS-CoV-2 infections in residents of a long-term care skilled nursing facility – King County, Washington, March 2020. MMWR Morb Mortal Wkly Rep 2020;69:377-81.
Mizumoto K, Kagaya K, Zarebski A, Chowell G. Estimating the asymptomatic proportion of coronavirus disease 2019 (COVID-19) cases on board the Diamond Princess cruise ship, Yokohama, Japan, 2020. Euro Surveill 2020;25:2000180.
Gold JA, Wong KK, Szablewski CM, Patel PP, Rossow J, da Silva J, et al
. Characteristics and Clinical Outcomes of Adult Patients Hospitalized with COVID-19 — Georgia, March 2020. MMWR Morb Mortal Wkly Rep 2020;69:545–550.
Alsofayan YM, Althunayyan SM, Khan AA, Hakawi AM, Assiri AM. Clinical characteristics of COVID-19 in Saudi Arabia: A national retrospective study. J Infect Public Health 2020;13:920-5.
Alahmari AA, Khan AA, Elganainy A, Almohammadi EL, AM Hakawi, Assiri AM, et al
. Epidemiological and clinical features of COVID-19 patients in Saudi Arabia. J Infect Public Health. 2021:14:437-43.
[Table 1], [Table 2], [Table 3], [Table 4]