|Year : 2017 | Volume
| Issue : 1 | Page : 38-44
Reliability of sonographic estimation of fetal weight: A study of three tertiary hospitals in Nigeria
Cletus Uche Eze1, Christopher Chukwuemeka Ohagwu2, Livinus Chibuzo Abonyi1, Nicholas Kayode Irurhe1, Zachaeus Ayo Ibitoye1
1 Department of Radiation Biology, Radiotherapy, Radiodiagnosis and Radiography, Faculty of Clinical Sciences, College of Medicine, University of Lagos, Ishaga Road, Idi-Araba, Surulere, Lagos, Nigeria
2 Department of Medical Radiography, Faculty of Health sciences, College of Medicine, Nnamdi Azikiwe University, Nnewi Campus, Nnewi, Anambra, Nigeria
|Date of Web Publication||16-Nov-2016|
Cletus Uche Eze
Department of Radiation Biology, Radiotherapy, Radiodiagnosis and Radiography, Faculty of Clinical Sciences, College of Medicine, University of Lagos, Ishaga Road, Idi-Araba, Surulere, Lagos
Source of Support: None, Conflict of Interest: None
Context: There is a dearth of sonologists in Nigeria, yet sonographic estimation of actual birth weight (ABW) is important in antenatal care.
Aim: To determine the reliability of estimated fetal weight (EFW) by sonographers and sonologists in Lagos Nigeria.
Settings and Design: In the cross-sectional study, a convenience sample of 663 healthy women with singleton pregnancy at term was selected. Ethical approval for the study design and consent of participants were obtained.
Subjects and Methods: Three sonographers and three sonologists used a single ultrasound scanner with Hadlock-3 algorithm to measure biparietal diameter, abdominal circumference, and femur length in three centers while three midwives used a single neonatal weighing scale to measure ABW.
Statistical Analysis Used: Medical® statistical software version 12.5 was used to analyze data. Descriptive and inferential statistics, as well as Bland/Altman plots were used to determine reliability of EFWs. Results were tested for statistical significance at P ≤ 0.05.
Results: Majority (76.2%) of babies had normal weight while mean EFW and ABW were 3.50 ± 0.10 kg and 3.45 ± 0.12 kg, respectively and the difference between them is not statistically significant (P > 0.05). For sonographers and sonologists in each center, mean error and coefficient of variation were very small while Pearson's correlation coefficient as well as intra- and interclass correlation coefficients was very high.
Conclusion: Independent estimation of ABW by sonographers in Lagos metropolis was very reliable. Sonography was also highly reliable in predicting macrosomia.
تهدف هذه الدراسة المستقبلية إلى معرفة دقة تقدير وزن الجنين بواسطة السونار، أجريت هذه الدراسة في ثلاث مستشفيات جامعية، وشملت 663 سيدة حامل بجنين واحد، بينت هذه الدراسة قبل الولادة أن (%76.2) من الأطفال كان وزنهم طبيعيا. لم توجد أي اختلافات ذات دلاله إحصائية تذكر بين الوزن التقديري والوزن الحقيقي ... وتخلص هذه الدراسة إلى أن تقدير الوزن للجنين بواسطة السونار جدير بالثقة.
Keywords: Estimation, fetal weight, reliability, sonography
|How to cite this article:|
Eze CU, Ohagwu CC, Abonyi LC, Irurhe NK, Ibitoye ZA. Reliability of sonographic estimation of fetal weight: A study of three tertiary hospitals in Nigeria. Saudi J Med Med Sci 2017;5:38-44
|How to cite this URL:|
Eze CU, Ohagwu CC, Abonyi LC, Irurhe NK, Ibitoye ZA. Reliability of sonographic estimation of fetal weight: A study of three tertiary hospitals in Nigeria. Saudi J Med Med Sci [serial online] 2017 [cited 2023 Feb 9];5:38-44. Available from: https://www.sjmms.net/text.asp?2017/5/1/38/194256
| Introduction|| |
Maternal and infant mortality remains a major challenge in Sub-Saharan Africa with an incidence rate of >90%. In 2013, Nigeria had one of the highest maternal and infant mortality rates in the world.,, Obstructed labor (8%) and postpartum hemorrhage (25%) are major causes of maternal mortality. Birth weight is an important parameter that determines the outcome of pregnancy and neonatal survival in the 1st year of life., Fetal macrosomia is associated with obstructed labor, shoulder dystocia, birth trauma, and asphyxia. Furthermore, perinatal morbidity and mortality are associated with low birth weight in >16% of live born infants.,
Optimal antenatal and perinatal care reduces maternal and infant mortality and fetal weight estimation has since been an integral part of routine obstetric care. Estimation of fetal weight, especially in the third trimester of pregnancy, is important to clinicians because that is the period when growth assessment is most likely to influence clinical decisions., The clinical method of fetal weight estimation involves measurement of symphysiofundal height and abdominal girth at the level of the umbilicus, whereas the sonographic method involves measurement of multiple fetal biometric parameters, after which fetal weight is computed by the ultrasound scanner using a regression algorithm., The ultrasound method is, however believed to be more accurate than the clinical method, hence >20% of all pregnant women now undergo a third-trimester ultrasound examination specifically for the assessment of fetal growth and fetal weight estimation.,,
Sonography is, however operator-dependent and errors in estimated fetal weight (EFW) as high as 20% have been reported while adequate training of sonographers, use of well-designed modern equipment and adherence to a standardized scanning protocol reduces observer errors in sonographic EFW. It is standard practice in America for well-trained sonographers to acquire images and sonologists to interpret. However, this is not so in Nigeria because of lack of sonologists. Developing countries with high infant and maternal mortality have therefore, been advised to ensure that there is more emphasis on the training of sonographers.
The majority of sonographers and sonologists in Nigeria are radiographers and physicians respectively. Nigerian sonologists are medically qualified diagnostic radiologists who obtained the West African College of Surgeons Fellowship and or the National Postgraduate Medical College Fellowship in Radiology. Sonographers on the other hand, are radiographers who possess the Bachelor of Science degree in diagnostic radiography before obtaining a Master of Science (M. Sc) degree or a postgraduate diploma (PgD) in ultrasonography. The M. Sc and PgD programs take at least 24 and 12 months respectively to complete. Knowledge acquired during these programs are assessed using formative and summative examinations and candidates are obliged to complete a dissertation and show evidence of successful clinical training by submitting a logbook endorsed by a senior sonographer or sonologist in the hospital where the training was carried out. Such clinical training takes not <6 months and emphasis is always placed on acquiring hands-on experience.
In view of Nigeria's current maternal and infant mortality rate and an acute scarcity of sonologists, encouraging independent sonographic EFW by sonographers has been advocated., However, observer error is associated with sonographic EFW, but with adequate training, use of state-of-the-art modern equipment and adherence to standardized scanning protocol errors can be reduced. The reliability of independent EFW by sonographers needs to be assessed to ascertain its usefulness. Unfortunately, formative and summative examinations do not provide adequate long-term feedback or information on the depth of knowledge, competence and skill of sonographers to carry out fetal weight estimation. On the other hand, a reproducibility study to assess agreement within and between replicate EFW by sonographers is a better method of determining the effectiveness of didactic education and training of sonographers., Therefore, the aim of this study was to determine the intra- and interobserver reliability of sonographic estimation of actual birth weight (ABW) in three tertiary hospitals in Lagos metropolis, southwest Nigeria, to highlight the usefulness of independent sonographic EFW by sonographers.
| Subjects and Methods|| |
The prospective cross-sectional study was carried out in three tertiary hospitals (Hospitals A, B, and C) between August 2013 and October 2014. The study design was approved by the Health Research and Ethics committee in each hospital and informed written consent was obtained before participants were recruited.
The study group comprised a convenience sample of 663 women. Only healthy women (absolute body weight >95 kg) with term singleton pregnancy with no sonographically detected fetal anomaly were included because maternal weight, multiple pregnancy and or fetal defects affect the reliability of sonographic EFW.,, Pregnancy at term is defined as the period between 37 completed weeks up to and including 41 completed weeks and 6 days of gestation., Gestational age (GA), as calculated from each woman's last menstrual period (LMP), was confirmed by standardized sonographic estimation of GA by measuring fetal crown-rump length (CRL) between nine plus zero (9 + 0) and 14 + 0 weeks of gestation. The GA calculated from LMP is deemed accurate if the difference between GA calculated from LMP and CRL is ≤7 days. Furthermore, fetuses with dolichocephaly or those with brachycephaly (normal variants of fetal head shape) were excluded from the study. This is because such fetal head shapes are known to adversely affect the accuracy of biparietal diameter (BPD) measurement.
A single Sichuan-Xukang ultrasound scanner, Model XK/21355 LCD manufactured in 2011 by Sichuan-Xukang Medical Electrical Appliances Co. Ltd., China, with a 3.5MHz convex transducer and Hadlock-3 fetal weight estimation algorithm was used. ABW was measured with a “Crown” neonatal weighing scale manufactured in 2008 by Ramon Surgical Co. Ltd., New Delhi, India. Weekly quality assurance tests were performed on the ultrasound scanner by a medical physicist to ensure optimal performance of all equipment while the weighing scale was standardized for zero error before use.
Three well-trained sonographers each with an M. Sc degree in ultrasonography (designated observer 1 in each center) and three sonologists (designated observer 2 in each center) were recruited to perform sonographic EFW. Each observer had 5 years of experience on obstetric sonography. Biparietal diameter, abdominal circumference (AC), and femur length (FL) were independently measured by each observer who were blinded to each other's measurements to reduce bias following the “ACR–ACOG–AIUM–SRU practice parameter for the performance of obstetrical ultrasound” guidelines.
Biparietal parietal diameter was measured on a transverse image of the fetal skull obtained at the level of the thalami and cavum septi pellucidi but without the cerebellar hemispheres in the plane. The cross-end of the caliper was placed in the outer edge of the parietal bone closer to the probe and then taken to the inner edge of the parietal bone farther from the probe to measure BPD. A true transverse image of the fetal abdomen was obtained at the level of the junction of the fetal umbilical vein, portal sinus with fetal stomach clearly visible. To measure AC, the cursor was placed on the outer border of the fetal abdomen and the ellipse facility used to trace the AC. For FL measurement, an iliac bone was identified and the transducer then maneuvered until the full length of the femur was visible and as horizontal as possible. FL is the distance between outer borders of the diaphysis of the femoral bone.
| Sonographic Estimation of Fetal Weight|| |
After BPD, AC, and FL were measured, EFW was automatically computed by the scanner using its regression algorithm. After the first scanning session, participants were randomly called in for subsequent measurements. In all, each subject had two pairs of sonographically EFW. Measurement of ABW: Three experienced midwives (blinded to all EFWs) weighed babies using the same standardized “Crown” weighing scale within 30 min of delivery and before the infant's first feeding. ABW was read to the nearest 0.1 kg only when the baby was most calm and the pointer of the weighing scale at rest.
Data were analyzed using Medical ® Statistical Software for biomedical research, version 12.5 (Medical Software, Acacialaan 22, B-8400 Ostend, Belgium). Fetal weight was categorized into normal, microsomia and macrosomia (2.50 kg–4.00 kg, <2.50 kg and >4.00 kg) respectively. Descriptive statistics (mean and standard deviation [SD]) and coefficient of variation (CV) were calculated. Intra- and interobserver agreement between pairs of EFW and ABW was assessed by calculating mean and SD of the difference. Reliability of EFW was determined using Pearson's correlation (r), intra- and interclass correlation coefficients (ICC) with their 95% confidence interval (CI)., Bland-Altman plot was also used to graphically depict agreement between replicate EFWs and ABWs by observers. Results were tested for statistical significance at P ≤ 0.05.
| Results|| |
The mean age of the population was 30.5 ± 11.3 (range 19–42) years and the majority (245; 36.9%) of the women were in the 31–34 years age range [Table 1]. [Table 1] also shows that 76.2% of babies had normal weight at birth while 10.6% and 13.2% were microsomic and macrosomic respectively. The mean EFW in the population was 3.50 ± 0.10 kg while the mean ABW was 3.45 ± 0.12 kg. For the microsomic weight category, the mean EFW was 2.32 ± 0.03 kg while the mean ABW was 2.33 ± 0.10. For normal weight fetuses, the mean EFW was 3.63 ± 0.10 kg, whereas the mean ABW was 3.52 ± 0.10 kg. For the macrosomic weight category, however mean EFW was 4.43 ± 0.17 kg, whereas the mean ABW was 4.50 ± 0.20 kg [Table 2]. Mean intra- and interobserver errors (0.18 kg and 0.17 kg, respectively) between EFW and ABW were not statistically significant (P > 0.05) in each center.
|Table 1: Age range of mothers and categories of actual birth weight of babies in each hospital|
Click here to view
|Table 2: Mean estimated fetal weight and actual birth weight for each weight category in the three centers|
Click here to view
Mean EFWs correlated positively with mean ABWs, and Pearson's correlation coefficient (r) was very high and statistically significant (P = 0.0001) within and between pairs of EFW and ABW for each weight category in each center [Table 3]. Intra- and interclass correction within and between pairs of EFW and ABW was very high and statistically significant (P = 0.0001) [Table 4], whereas CV within and between pairs of EFW and ABW was <5.0% for each observer in each center [Table 5]. Bland-Altman plotting of mean errors between EFW and ABW [Figure 1] clearly showed that only very few measurements fell outside the 95% limit of agreement.
|Table 3: Correlation between estimated fetal weight and actual birth weight|
Click here to view
|Table 4: Intra- and inter-class correlation between estimated fetal weight and actual birth weight|
Click here to view
|Table 5: Coefficient of variation within pairs of estimated fetal weight and actual birth weight in each center|
Click here to view
|Figure 1: Bland and Altman plots of differences between estimated fetal weight and actual birth weight showing highly significant agreement between estimated fetal weight and actual birth weight.|
Click here to view
| Discussion|| |
In the study, the number of mothers decreased sharply after the 31–34 years age range. This seems to suggest that most women in the population appear to be less inclined to conceive after reaching 34 years of age. This supports a rather very well-known trend among women and childbirth. Furthermore, a majority of babies who were predicted by sonography to have normal weight actually had normal weight at birth. This is consistent with reported mean ABW of normal full-term babies., Furthermore, 10.6% prevalence of microsomia found in the population is significantly lower than 13.0% average for most Asian countries in general and 20.0% in India, in particular. It is also significantly lower than 13.0% reported for most countries in Sub-Saharan Africa by UNICEF., The 13.2% prevalence of macrosomia found in our study is however, higher than 11.8% prevalence reported among Iranians. Reasons for the disparity in fetal weight may include racial factors, maternal age, nutrition and social habits.
Standard deviation of the mean was very small for EFW and ABW in each weight category in the study. SD is an index of variability which determines the level of agreement between replicate measurements. When SD is very small, agreement between replicate estimations performed under the same condition is very high and shows that a given measurement can easily be reproduced. This implies that the EFW performed by sonographers and sonologists included in the study was very reliable. Moreover, calculated mean intra- and interobserver errors are also inferential statistics used to estimate variability. Since both were very small and not statistically significant (P > 0.05) within and between pairs of EFW and ABW for each observer in each center, they also support the fact that agreement between replicate EFW and ABW performed by the two observer groups was very high and, therefore, reliable. These results suggest that the sonographers studied appear to have acquired the adequate skills needed to independently perform useful EFW.
In the study, we found that Pearson's correlation coefficient (r with its 95% CI) and intraclass correlation (ICC) were quite high and statistically significant (P < 0.0001). When Pearson's correlation coefficient (r) with its 95% CI and intra- and interclass correlation coefficient (ICC) are high and statistically significant, they indicate easy reproducibility, a high level of agreement and reliability of replicate measurements (EFW and ABW in this case) performed under the same conditions., This implies that EFW in the study was easily reproducible and therefore, reliable predictors of ABW. Similar results have been reported with sonography said to be “highly accurate” in the estimation of ABW. Quite remarkably, however both coefficients were highest in the estimation of microsomia but least in the estimation of macrosomia, either by sonographers or sonologists in each center, thus suggesting that sonography appears to be slightly more reliable in the prediction of microsomia than macrosomia. This agrees with some researchers who had earlier reported that sonography tends to show the least absolute percentage error in the prediction of microsomia.,,, Since differences between mean errors in EFW and ABW were not statistically significant (P > 0.05) within and between pairs of measurements in each center, the clinical significance of this result is not clear.
In this study, CV was <5% in each weight category for each observer in the three centers but was least in the estimation of microsomia and highest in the estimation of macrosomia. CV (range = 1–100%) is the ratio of the SD to the mean and refers to the level of disparity between replicate measurements performed under the same condition., Very low CV between replicate measurements in this study indicates very good agreement between replicate measurements as well as easy reproducibility of such measurements. We can, therefore, conclude that EFW by the two observer groups in the study were quite easily reproducible and therefore, reliable since CV was very small for each observer in each weight category. These results support opinions earlier expressed by some researchers who carried out similar studies., Furthermore, these small CVs seem to suggest that sonography appears marginally more accurate in predicting microsomia than macrosomia.
The trend followed by Bland and Altman plot of mean errors between EFW and ABW in our study depict highly significant agreements within and between pairs of EFW and ABW [Figure 1] as only very few measurement errors fell outside the 95% limit of agreement. These plots appear to support Pearson's correlation coefficient, ICC, and CV, in suggesting that EFW by sonographers and sonologists was very reliable in the population studied. There was however, a similar pattern of clustering of errors around microsomic and macrosomic weight categories suggesting that sonography may actually be very highly reliable in detecting both microsomia and macrosomia. Some researchers, however had earlier reported that sonography appears to be poor in the assessment of macrosomia.,, In spite of this, we are convinced that errors associated with sonographic prediction of macrosomia might be of limited clinical significance.
The localized nature of this study appears to be a major limitation in that only Lagos metropolis was studied in A large country such as Nigeria. The sample studied may, however be considered suitable because studies on the reliability of sonographic measurements involve multiple measurements and most investigators tend to prefer a moderate sample. Moreover, BPD is no longer used in fetal weight estimation in some countries such as the United Kingdom because head shapes adversely affect the accuracy of BPD measurement. In Nigeria, BPD is still widely used, but we ensured that all fetuses with dolichocephaly or brachycephaly were excluded from the study.
| Conclusion|| |
Fetal weight independently estimated by sonographers and sonologists in Lagos metropolis was very reliable; therefore, well-trained and experienced sonographers who follow a standardized scanning protocol and use a state-of-the-art modern ultrasound machine can independently perform useful fetal weight estimation. Moreover, sonography appears to be highly reliable in detecting macrosomia.
We sincerely like to thank the managers in the three tertiary hospitals included in the study for allowing us to carry out this study. We also wish to thank the Research and Ethics Committee of each hospital for approving our research design and supervising the study.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Zureick-Brown S, Newby H, Chou D, Mizoguchi N, Say L, Suzuki E, et al.
Understanding global trends in maternal mortality. Int Perspect Sex Reprod Health 2013;39:32-41.
Shittu AS, Kuti O, Orji EO, Makinde NO, Ogunniy SO, Ayoola OO, et al.
Clinical versus sonographic estimation of foetal weight in southwest Nigeria. J Health Popul Nutr 2007;25:14-23.
Fuchs F, Bouyer J, Rozenberg P, Senat MV. Adverse maternal outcomes associated with fetal macrosomia: What are the risk factors beyond birthweight? BMC Pregnancy Childbirth 2013;13:90.
Gardosi J, Madurasinghe V, Williams M, Malik A, Francis A. Maternal and fetal risk factors for stillbirth: Population based study. BMJ 2013;346:f108.
Chauhan SP, Magann EF. Screening for fetal growth restriction. Clin Obstet Gynecol 2006;49:284-94.
Kurmanavicius J, Burkhardt T, Wisser J, Huch R. Ultrasonographic fetal weight estimation: Accuracy of formulas and accuracy of examiners by birth weight from 500 to 5000 g. J Perinat Med 2004;32:155-61.
Ugwu EO, Udealor PC, Dim CC, Obi SN, Ozumba BC, Okeke DO, et al.
Accuracy of clinical and ultrasound estimation of fetal weight in predicting actual birth weight in Enugu, Southeastern Nigeria. Niger J Clin Pract 2014;17:270-5.
Hadlock FP, Harrist RB, Carpenter RJ, Deter RL, Park SK. Sonographic estimation of fetal weight. The value of femur length in addition to head and abdomen measurements. Radiology 1984;150:535-40.
Francis A, Tonks A, Gardosi J. Accuracy of ultrasound estimation of fetal weight at term. Arch Dis Child Fetal Neonatal Ed 2011;96: Fa61 doi:10.1136/adc.2011.300161.24.
Colman A, Maharaj D, Hutton J, Tuohy J. Reliability of ultrasound estimation of fetal weight in term singleton pregnancies. N Z Med J 2006;119:U2146.
Bricker L, Mahsud-Dornan S, Dornan JC. Detection of foetal growth restriction using third trimester ultrasound. Best Pract Res Clin Obstet Gynaecol 2009;23:833-44.
Dudley NJ. A review of ultrasound fetal weight estimation in the early prediction of low birth weight. Ultrasound 2013;21;181-6.
Bajracharya J, Shrestha NS, Karki C. Accuracy of prediction of birth weight by fetal ultrasound. Kathmandu Univ Med J (KUMJ) 2012;10:74-6.
Mckenzie TC. Planning, Implementing, and Evaluating Health Promotion Programs. San Francisco, CA: Pearson Education; 2009. p. 202-16.
Sarris I, Ioannou C, Chamberlain P, Ohuma E, Roseman F, Hoch L, et al.
Intra- and interobserver variability in fetal ultrasound measurements. Ultrasound Obstet Gynecol 2012;39:266-73.
Ohagwu CC, Onoduagu HI, Eze CU, Ohagwu CI. Intra- and inter-observer reproducibility study of gestational age estimation using three common fetal biometric parameters: Experienced versus inexperienced sonographer. Radiography 2015;21:54-60.
Benacerraf B. The use of obstetrical ultrasound in the obese gravida. Semin Perinatol 2013;37:345-7.
Fleischman AR, Oinuma M, Clark SL. Rethinking the definition of “term pregnancy”. Obstet Gynecol 2010;116:136-9.
Robinson HP. Sonar measurement of fetal crown-rump length as means of assessing maturity in first trimester of pregnancy. Br Med J 1973;4:28-31.
Villar J, Cheikh Ismail L, Victora CG, Ohuma EO, Bertino E, Altman DG, et al.
International standards for newborn weight, length, and head circumference by gestational age and sex: The Newborn Cross-Sectional Study of the INTERGROWTH-21st
Project. Lancet 2014;384:857-68.
Alcazar JL, Mercie LT, Manero MG, Bau S, Lopez-Garcia G. Endometrial volume and vascularity measurements by transvaginal 3-dimensional ultrasonography and power Doppler angiography in stimulated and tumoral endometrium: An introduction to reproducibility study. J Ultrasound Med 2005;24:1091-8.
Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res 1999;8:135-60.
Bharati P, Pal M, Bandyopadhyay M, Bhakta A, Chakraborty S, Bharati P. Prevalence and causes of low birth weight in India. Malays J Nutr 2011;17:301-13.
Mardani M, Khalkhalirad A, Rossta S, Rezapour P. Evaluation of the prevalence of macrosomia and the risk factors. Iran J Neonatol 2014;5:5-9.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]
|This article has been cited by|
||Validity of sonographic prediction of birth weight: A study of three algorithms in a cohort of healthy pregnant women of Yoruba descent in a suburb of Lagos state, Southwest Nigeria
| ||CletusUche Eze, KingsleyChibuike Cosmas, JoshuaIfeanyichukwu Nwamba, ErnestRuto Upeh |
| ||West African Journal of Radiology. 2022; 29(1): 50 |
|[Pubmed] | [DOI]|
||Main Fetal Predictors of Adverse Neonatal Outcomes in Pregnancies with Gestational Diabetes Mellitus
| ||Maria-Christina Antoniou,Leah Gilbert,Justine Gross,Jean-Benoît Rossel,Céline Julie Fischer Fumeaux,Yvan Vial,Jardena Jacqueline Puder |
| ||Journal of Clinical Medicine. 2020; 9(8): 2409 |
|[Pubmed] | [DOI]|
||Correlation of Ultrasonographic Estimation of Fetal Weight with Actual Birth Weight as Seen in a Private Specialist Hospital in South East Nigeria
| ||Chisolum Ogechukwu Okafor,Charles Ikechukwu Okafor,Ikechukwu Innocent Mbachu,Izuchukwu Christian Obionwu,Michael Echeta Aronu |
| ||International Journal of Reproductive Medicine. 2019; 2019: 1 |
|[Pubmed] | [DOI]|