Volume 8, Issue 1 (Continuous publishing 2022)                   Iran J Neurosurg 2022, 8(1): 0-0 | Back to browse issues page


XML Print


Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:

Jafroudi M, Rezaei S, Reihanian Z, Yousefzadeh‑Chabok S. Sensitivity, Specificity, and Cut-off Point of the Mini-Mental State Examination in Patients With Mild Traumatic Brain Injury. Iran J Neurosurg 2022; 8 (1) : 25
URL: http://irjns.org/article-1-327-en.html
1- MA student in General Psychology, Department of Psychology, Faculty of Literature and Humanities, University of Guilan, Rasht, Iran
2- PhD. in Psychology, Department of Psychology, Faculty of Literature and Humanities, University of Guilan, Rasht, Iran , Rezaei_Psy@hotmail.com
3- Department of Neurosurgery, School of Medicine, Guilan University of Medical Sciences, Rasht, Iran
4- Guilan Road Trauma Research Center, Guilan University of Medical Sciences, Rasht, Iran
Full Text [PDF 966 kb]   (400 Downloads)     |   Abstract (HTML)  (1147 Views)
Full Text:   (466 Views)
1. Introduction
Traumatic brain injury (TBI) is one of the most important health concerns and cognitive problems worldwide and is considered the leading cause of mortality and disability in people under 40 years of age [1]. TBI is estimated to annually affect about 69 million cases and impose a heavy burden on patients and their families [2, 3]. Moreover, this disorder is considered one of the five main causes of death and the main cause of disability in young people in Iran [4].
According to the current diagnostic protocols, patients with mild TBI (mTBI) constitute the highest proportion of patients with TBI at 80%-90% [5]. However, only a small number of mTBI patients have relevant or suspicious pathological signs, and approximately 50% of them have cognitive problems that take longer than 1 month or even up to 1 year to be diagnosed. Therefore, a large number of these patients receive no medical intervention [6] and due to the impossibility of detecting minor changes in the structure and function of the brain, their low cognitive performance is attributed to problems existing before the injury [7]. Hence, diagnosis can be one of the most challenging and valuable aspects of clinical neurologic care for these patients [1].
Therefore, by emphasizing the understanding of subtle differences caused by mTBI, completing a clinical evaluation, the impact of TBI on cognition, the importance of assessing cognitive disorders related to TBI, and the necessity to use cognitive screening tools that lead to facilitating optimal medical decision-making, facilitate individualized, and targeted therapeutic intervention, has globally attracted the attention of researchers in this field in the last two decades [8, 910].
Mini-mental status examination (MMSE) is one of the most common tools for assessing the severity and progress of various cognitive impairments [11]. Due to its translatability to other languages, high reliability, and easy use in clinical and educational settings have been considered [12]. Briefly, this test evaluates several cognitive domains, including attention, calculation, recall, language, orientation, and short-term memory [11]. Moreover, the total time required to implement it is 5-10 minutes [11], which has made it an efficient, fast, and standardized screening tool for grading patients [13]. Although the MMSE is one of the most up-to-date and common tools for rapid cognitive assessment [12], the variable time required to perform it in different groups [14] and the interaction of age and education level [15] limit its use, especially in the initial screening of cognitive impairments in society.
Numerous clinical tests are used to confirm the presence or absence of disease or to proceed with the diagnosis process. Ideally, such tests can correctly identify all patients with this disease (sensitivity) and similarly identify all disease-free people (specificity) [12]. Different studies with different cut-off points have reported the sensitivity and specificity of this test to be 97%-13% and 100%-60%, respectively [16, 17, 18].
In this regard, little evidence has supported the usefulness of MMSE in the assessment of cognitive deficits. To date, no study has conclusively proven the clinical utility of MMSE in diagnosing cognitive impairment in mTBI patients. Now the question arises whether this tool can be used to estimate mTBI patients and provide a specific cut-off point for the cognitive deficits of these patients. Therefore, the present study aimed to use MMSE for rapid assessment of cognitive status in mTBI patients and to determine its sensitivity and specificity.

2. Methods and Materials/Patients
The statistical population of this study included all mTBI patients in Rasht City, the capital of Guilan Province in the north of Iran, who were injured in the 1st half of 2022. In this cross-sectional-analytical, the consecutive sampling method was utilized to select the samples. In estimating the sensitivity and specificity of the MMSE test, the F test family in G*Power version 3.1.9.6 was used to determine the required sample size [19]. The internal mechanisms of discriminant analysis and one-way multivariate analysis of variance (test of general effects) are the same. Therefore, the total sample size was 158 participants, of whom 79 had mTBI and were admitted to the trauma, neurosurgery, and ICU departments of Poursina hospital in Rasht City in the 1st half of 2022 and referred to the same hospital, as well as the Velayat specialized clinic for rehabilitation and re-visit (case group). The control group included 79 normal healthy individuals who were matched with the patients in terms of age and job status that were selected from patients’ companions and their families. This study was approved by the Biomedical Research Ethics Committee of Guilan University (Code: IR.GUILAN.REC.1400.038).
The inclusion criteria included an age range of 18-65 years, a Glasgow Coma scale (GCS) score of 13-15, any memory loss for events immediately before or after the accident for <24 hour, loss of consciousness (LOC) for <30 minutes, and changes in mental status at the time of the accident (confusion, bewilderment, etc.). The exclusion criteria included any serious mental/neurological disorders before TBI (e.g. schizophrenia, dementia, epilepsy, and Parkinson’s based on clinical interviews with patients and their companions), clinical manifestations appeared >48 hours after the initial trauma (according to medical records), multiple and major traumas (fractured knee or chest, ruptured spleen, etc.), being unable to respond, and being unwilling to participate for any reason. After selecting the samples, the reasons and methods of conducting the study were explained to the patients and their families or companions. Then they were assured that their information will remain confidential and their non-participation will not affect the treatment process. After obtaining informed consent from the patients or their families and collecting demographic information, the mental status examination questionnaire was completed by mTBI patients during the interview.

Study tools
Neurological Assessment Questionnaire: This questionnaire includes the consciousness level of the patient since entering the hospital using the Glasgow Coma scale (GCS), Glasgow outcome scale (GOS), the type of skull fracture according to the radiographic images of the skull, hemispheres damage, the location of brain injury, type of local or diffuse brain damage according to computerized tomography (CT)-scan, and the presence of physical trauma with TBI.
Researcher-Made Questionnaire Related to Demographic and Hospital Information: This questionnaire includes information about age, gender, marital status, level of education, cause of TBI, job position before and after TBI, and length of hospitalization, which was completed by patients at the time of admission.
Mini-Mental State Examination (MMSE): MMSE test is a paper‐and‐pencil questionnaire with five cognitive items of temporal and spatial orientation, processing speed, attention and calculation, recall, and verbal memory with a total score of 30, which can be completed in 5-10 minutes. Scores of 0-10, 11-26, and 27-30 indicate severe, moderate and mild, and no cognitive impairment, respectively [20]. Based on Cronbach’s alpha coefficient, the reliability of this test in patients with traumatic brain injury has been reported as 0.74 [21]. Also, Seyyedian et al. [22] showed with a confidence interval of 95% that MMSE can distinguish the cognitive performance of two groups of patients with dementia and normal individuals, and based on Cronbach’s alpha coefficient, they reported its internal reliability of 0.81.

Glasgow Coma Scale: Glasgow Coma scale is used to assess the level of consciousness, verbal response, and motor response. The patients’ overall score on this scale is calculated between 3 and 15. On the other hand, GCS scores of <8, 9-12, and >12 indicate severe, moderate, and mild traumatic injuries, respectively. Teasdale [23] reported favorable reliability for the Glasgow Coma scale. Also, in the Iranian sample of TBI patients, internal consistency based on Cronbach’s alpha coefficient for this criterion was reported to be 0.82 [24].

Data analysis
In this study, descriptive statistics indicators such as frequency, frequency percentage, Mean±SD, were used to describe the data. In addition, the output of the discriminant analysis technique was used to determine the sensitivity and specificity, and cut-off point of the questionnaire. SPSS software version 26 was also used for statistical processing.

3. Results
Out of 158 participants in the present study, 79 were mTBI patients and 79 were normal individuals matched in terms of age and job status. Table 1 shows the demographic information of the two groups.

Also, Table 2 summarizes the frequency and frequency percentage of background, clinical, and neuroimaging information of mTBI patients.

Table 3 shows the Mean±SD of the total score of the MMSE subscales in the two groups at two times (with an interval of 2-3 weeks after the trauma).

The results of the Student’s t-test showed a significant difference in the scores of MMSE subscales (P<0.05) except for the Processing Speed subscale in the 1st evaluation time (P=0.157). The cognitive performance of the control group was much better than the case group.
Discriminant analysis was performed to determine the sensitivity and specificity of MMSE in differentiating mTBI patients from normal individuals in terms of cognitive status, and its results are shown in Table 4.

Among the 79 patients, after the test in the 1st round, 34 real patients (true positive) and 45 falsely healthy (false negative) were diagnosed. Also, in the 2nd round, 46 participants were diagnosed as real patients (true positive) and 33 participants were diagnosed as falsely healthy (false negative). Therefore, as shown in Table 4, the sensitivity of MMSE in the 1st and 2nd rounds was determined as 0.43 and 0.58, respectively. In addition, among normal individuals, after performing the test in the 1st round, 15 false patients (false positive) and 64 normal participants (true negative) were diagnosed. Also, in the 2nd test, among the healthy group, 24 participants (false positive) and 55 participants (true negative) were diagnosed as false patients and real healthy, respectively. Therefore, as shown in Table 4, the specificity of MMSE in the 1st and 2nd tests was 0.80 and 0.69, respectively. Also, the overall classification accuracy for this test was calculated as 62% and 63.9% in the 1st and 2nd rounds, respectively. It means that 62% of the participants were correctly classified into two groups, and the rest (38%) was incorrectly classified.

Cut-off point
In the 1st round of assessments, the cut-off point of MMSE with the discriminant analysis was calculated as 27.13, and obtaining a score between 27/28 and below in the MMSE test indicated that mTBI patients with possible cognitive impairment could be distinguished from normal participants without mTBI. Also, in the 2nd round of the MMSE cut-off point was calculated as 27.61 with discriminant analysis, and obtaining a score between 27 and 28 or below in the MMSE test indicated that mTBI patients with possible cognitive impairment could be distinguished from normal participants without mTBI. According to the findings obtained from the MMSE cut-off point at two times, the optimal cut-off point of this test for distinguishing patients with mTBI from normal participants was 27 to 28 in terms of cognitive status. 

4. Discussion
Today, with improved levels of clinical treatment, more TBI patients can survive. However, their residual functional disorders seriously affect their prognosis and functional independence and impose a heavy burden on patients and their families [3]. Compared to the normal group, mTBI patients showed poorer performance in general cognitive ability, attention, processing speed, naming, short-term memory, and executive functions. The results from this study are consistent with previous studies that have reported significant cognitive deficits in mTBI patients, mainly related to episodic memory [25, 26]. In addition, during the 11-month follow-up, mTBI patients showed poorer performance in attention, memory, language, and executive functions [26]. These studies support the findings of the present study by providing evidence of impairment in several cognitive domains in mTBI patients.
Cognitive disorders are one of the leading causes of TBI-related disabilities that have detrimental effects on rehabilitation outcomes [9]. Despite the apparent conflicts and limitations in its accuracy and capability [27], the MMSE has been globally considered one of the most widely used cognitive screening tests for more than 40 years [12]. Most cognitive tests are influenced by age and education, and MMSE is no exception to these conditions [15]. So that patients with higher education levels may be more familiar with the tasks in it and thus show less deterioration in cognitive performance levels. Another significant limitation of this test is the time required to complete it. Since the MMSE is relatively easy to complete and takes about 5-10 minutes to complete [11], it can help clinicians to diagnose the presence or absence of a problem. However, while healthy individuals without cognitive impairment can complete it in 5-8 minutes, it often takes over 15 minutes in patients with cognitive impairment [14].
The results of this study introduce a cut-off point of 27 to 28 with 95% confidence level to distinguish mTBI patients with possible cognitive impairment from normal subjects without mTBI. According to this finding, previous studies have shown the range of scores of 27-30, 26-21, 20-11, and 0-10 for healthy and normal subjects, and people with mild, moderate, and severe cognitive defects, respectively [20]. More recent research has reported the MMSE cut-off point for identifying mild cognitive impairment in TBI patients to be 28.5 [28], which is almost consistent with the findings of the present study.
According to the results of sensitivity and specificity in this study, it is recommended that the MMSE test cannot be used as an alternative to a comprehensive neuropsychological assessment with a diagnostic purpose. Consistent with the present study, previous studies have shown that MMSE has low sensitivity in diagnosing mild cognitive impairment [17, 18]. In a study, the sensitivity of MMSE in diagnosing mild cognitive impairment with a cut-off point of 24 was about 0.6, but the specificity was >0.96 [27]. Also, in the study conducted by Tsai et al. [29] on patients with mild cognitive impairment, the sensitivity of the MMSE test at cut-off points of 24 and 20 was 0.88 and 0.79, and the specificity was 0.74 and 0.08, respectively.
On the other hand, patients attending clinics are often those who complain of memory and are sometimes referred from primary health care centers. Therefore, a comprehensive neuropsychological assessment provides more insight into the deficits that occur in general and specific cognitive functions [30]. Since MMSE has high specificity and low sensitivity to identify mild cognitive disorders [16], diagnosis of cognitive deficits is not recommended, especially in low-prevalence diseases, in which tests with high sensitivity and low specificity are more desirable to prevent the misdiagnosis of patients or healthy cases.

5. Conclusion
A score of 27/28 and below can indicate mTBI patients with possible cognitive impairment. The sensitivity and specificity results of this tool are significantly different from the optimal diagnostic values (90%), which may cause a substantial classification error. Nevertheless, the MMSE is somehow useful in excluding definite cases of cognitive impairment and free of cognitive impairment in screening possible cases of mild cognitive impairment. By using the MMSE to eliminate the need for a broader neuropsychological evaluation, physicians can speed up the clinical evaluation process to diagnose cognitive deficits.

Ethical Considerations
Compliance with ethical guidelines

This study was approved by the Biomedical Research Ethics Committee of Guilan University (Code: IR.GUILAN.REC.1400.038).

Funding
This research did not receive any grant from funding agencies in the public, commercial, or non-profit sectors. 

Authors' contributions
Conception and design: Maryam Jafroudi and Sajjad Rezaei; Data Collection: Maryam Jafroudi, Zoheir Reihanian and Shahrokh Yousefzadeh‑Chabok; Data analysis and interpretation, drafting and revising the article and final approval: All authors.

Conflict of interest
The authors declared no conflict of interest. 

Acknowledgements
The authors would like to offer their gratitude to all participants who helped us by filling out the questionnaires as well as the personnel of Poursina Hospital and Velayat specialized clinic.


References
  1. Abou El Fadl MH, O'Phelan KH. Management of traumatic brain injury: An update. Neurosurgery Clinics of North America. 2018; 29(2):213-21. [DOI:10.1016/j.nec.2017.11.002] [PMID]
  2. Herrero Babiloni A, Exposto FG, Bouferguene Y, Costa Y, Lavigne GJ, Arbour C. Temporomandibular disorders in traumatic brain injury patients: A chronic pain condition requiring further attention. Pain Medicine. 2020; 21(12):3260-2. [DOI:10.1093/pm/pnaa234] [PMID]
  3. Mckee AC, Daneshvar DH. The neuropathology of traumatic brain injury. Handbook of Clinical Neurology. 2015; 127:45-66. [DOI:10.1016/B978-0-444-52892-6.00004-0] [PMID] [PMCID]
  4. Mozafari M, Mehrinejad SA. [Compare performance of patients (MTBI), in complex stroop, emphasizing the passing of one year of mild traumatic brain injury with healthy people (Persian)]. Medical Journal of Mashhad University of Medical Sciences. 2020; 63(3):2254-67. [DOI:10.22038/MJMS.2020.16378]
  5. Levin HS, Diaz-Arrastia RR. Diagnosis, prognosis, and clinical management of mild traumatic brain injury. The Lancet Neurology. 2015; 14(5):506-17. [DOI:10.1016/S1474-4422(15)00002-2] [PMID]
  6. Dikmen S, Machamer J, Temkin N. Mild traumatic brain injury: Longitudinal study of cognition, functional status, and post-traumatic symptoms. Journal of Neurotrauma. 2017; 34(8):1524-30. [DOI:10.1089/neu.2016.4618] [PMID] [PMCID]
  7. Stenberg J, Håberg AK, Follestad T, Olsen A, Iverson GL, Terry DP, et al. Cognitive reserve moderates cognitive outcome after mild traumatic brain injury. Archives of Physical Medicine and Rehabilitation. 2020; 101(1):72-80. [DOI:10.1016/j.apmr.2019.08.477] [PMID]
  8. Dikmen SS, Corrigan JD, Levin HS, Machamer J, Stiers W, Weisskopf MG. Cognitive outcome following traumatic brain injury. Journal of Head Trauma Rehabilitation. 2009; 24(6):430-8. [DOI:10.1097/HTR.0b013e3181c133e9] [PMID]
  9. Vissoci JRN, de Oliveira LP, Gafaar T, Haglund MM, Mvungi M, Mmbaga BT, et al. Cross-cultural adaptation and psychometric properties of the MMSE and MoCA questionnaires in Tanzanian Swahili for a traumatic brain injury population. BMC Neurology. 2019; 19(1):57. [DOI:10.1186/s12883-019-1283-9] [PMID] [PMCID]
  10. Thomas RE, Alves J, Vaska Mlis MM, Magalhaes R. Therapy and rehabilitation of mild brain injury/concussion: Systematic review. Restorative Neurology and Neuroscience. 2017; 35(6):643-66. [DOI:10.3233/RNN-170761] [PMID]
  11. Folstein MF, Folstein SE, Mchugh PR. Mini-mental state: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research. 1975; 12(3):189-98. [DOI:10.1016/0022-3956(75)90026-6] [PMID]
  12. Zhuang L, Yang Y, Gao J. Cognitive assessment tools for mild cognitive impairment screening. Journal of Neurology. 2021; 268(5):1615-22. [DOI:10.1007/s00415-019-09506-7] [PMID]
  13. Cordell CB, Borson S, Boustani M, Chodosh J, Reuben D, Verghese J, et al. Alzheimer’s Association recommendations for operationalizing the detection of cognitive impairment during the medicare annual wellness visit in a primary care setting. Alzheimers & Dementia. 2013; 9(2):141-50. [DOI:10.1016/j.jalz.2012.09.011] [PMID]
  14. Brodaty H, Connors MH, Loy C, Teixeira-Pinto A, Stocks N, Gunn J, et al. Screening for dementia in primary care: A comparison of the GPCOG and the MMSE. Dementia and Geriatric Cognitive Disorders. 2016; 42(5-6):323-30. [DOI:10.1159/000450992] [PMID]
  15. Borda MG, Reyes-Ortiz C, Pérez-Zepeda MU, Patino-Hernandez D, Gómez-Arteaga C, Cano-Gutiérrez CA. Educational level and its association with the domains of the Montreal cognitive assessment test. Aging & Mental Health. 2019; 23(10):1300-6. [DOI:10.1080/13607863.2018.1488940] [PMID]
  1. Tsoi KK, Chan JY, Hirai HW, Wong SY, Kwok TC. Cognitive tests to detect dementia: A systematic review and meta-analysis. JAMA Internal Medicine. 2015; 175(9):1450-8. [DOI:10.1001/jamainternmed.2015.2152] [PMID]
  2. Pinto TCC, Machado L, Bulgacov TM, Rodrigues-Júnior AL, Costa MLG, Ximenes RCC, et al. Is the Montreal cognitive assessment (MoCA) screening superior to the mini-mental state examination (MMSE) in the detection of mild cognitive impairment (MCI) and alzheimer’s disease (AD) in the elderly? International Psychogeriatrics. 2019; 31(4):491-504. [DOI:10.1017/S1041610218001370] [PMID]
  3. Sabe L, Jason L, Juejati M, Leiguarda R, Starkstein S. Sensitivity and specificity of the mini-mental state exam in the diagnosis of dementia. Behavioural Neurology. 1993; 6(4):207-10. [DOI:10.1155/1993/947175] [PMID]
  4. Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods. 2007; 39(2):175-91. [DOI:10.3758/BF03193146] [PMID]
  5. Salami M, Alinaghipour A, Daneshvar R, Hamidi GA, Agahi A, Soheili M, et al. Adapted MMSE and TYM cognitive tests: How much powerful in screening for alzheimer’s disease in Iranian people. Aging and Mental Health. 2020; 24(6):1010-7. [DOI:10.1080/13607863.2019.1584786] [PMID]
  6. Weeks DL, Ambrose SB, Tindall AG. The utility of the modified mini-mental state examination in inpatient rehabilitation for traumatic brain injury: Preliminary findings. Brain Injury. 2020; 34(7):881-8. [DOI:10.1080/02699052.2020.1761564] [PMID]
  7. Seyedian M, Falah M, Nourouzian M, Nejat S, Delavar A, Ghasemzadeh HA. [Validity of the Farsi version of mini-mental state examination (Persian)]. Journal of Medical Council of Iran. 2008; 25(4):408-14. [Link]
  8. Teasdale G, Jennett B. Assessment of coma and impaired conscousness. A practical scale. The Lancet. 1974; 2(7872):81-4. [DOI:10.1016/s0140-6736(74)91639-0] [PMID]
  9. Momenyan S, Mousavi SM, Dadkhahtehrani T, Sarvi F, Heidarifar R, Kabiri F, et al. Predictive validity and inter-rater reliability of the Persian version of full outline of unresponsiveness among unconscious patients with traumatic brain injury in an intensive care unit. Neurocritical Care. 2017; 27(2):229-36. [DOI:10.1007/s12028-016-0324-0] [PMID]
  10. Sharbafshaaer M. Impacts of cognitive impairment for different levels and causes of traumatic brain injury, and education status in TBI patients. Dementia & Neuropsychologia. 2018; 12(4):415-20. [DOI:10.1590/1980-57642018dn12-040012] [PMID] [PMCID]
  11. Veeramuthu V, Narayanan V, Kuo TL, Delano-Wood L, Chinna K, Bondi MW, et al. Diffusion tensor imaging parameters in mild traumatic brain injury and its correlation with early neuropsychological impairment: A longitudinal study. Journal of Neurotrauma. 2015; 32(19):1497-509. [DOI:10.1089/neu.2014.3750] [PMID] [PMCID]
  12. Arevalo-Rodriguez I, Smailagic N, Roqué I Figuls M, Ciapponi A, Sanchez-Perez E, Giannakou A, et al. Mini-mental state examination (MMSE) for the detection of alzheimer’s disease and other dementias in people with mild cognitive impairment (MCI). Cochrane Database of Systematic Reviews. 2015; 2015(3):CD010783. [DOI:10.1002/14651858.CD010783.pub2] [PMID]
  13. Zhang Y, Yao Q, Chen C, Wu Y, Zhang Y, Wang Y, et al. [Montreal cognitive assessment for cognitive detection in brain trauma patients with normal (Chinese)]. 2015. Chinese Journal of Trauma. 2015; 31(7):604-07. [Link]
  14. Tsai JC, Chen CW, Chu H, Yang HL, Chung MH, Liao YM, et al. Comparing the sensitivity, specificity, and predictive values of the montreal cognitive assessment and mini-mental state examination when screening people for mild cognitive impairment and dementia in Chinese population. Archives of Psychiatric Nursing. 2016; 30(4):486-91. [DOI:10.1016/j.apnu.2016.01.015] [PMID]
  15. Xu X, Chong E, Hilal S, Ikram MK, Venketasubramanian N, Chen C. Beyond screening: Can the mini-mental state examination be used as an exclusion tool in a memory clinic? Diagnostics. 2015; 5(4):475-86. [DOI:10.3390/diagnostics5040475] [PMID] [PMCID]
Type of Study: Research | Subject: Neuroscience

Add your comments about this article : Your username or Email:
CAPTCHA

Send email to the article author


Rights and Permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

© 2024 CC BY-NC 4.0 | Iranian Journal of Neurosurgery

Designed & Developed by: Yektaweb