The escalating number of higher education institutions globally has heightened the demand for credible education policies and quality assurance mechanisms. The establishment of organizations for quality assurance providers and accreditors has become widespread to meet this demand. The Myanmar Medical Council Accreditation Committee (MMCAC) was established in 2016 to ensure the quality and standard of medical practice in Myanmar. Defence Services Medical Academy (DSMA), one of Myanmar’s medical universities, transitioned to an outcome-based integrated program in line with the World Federation for Medical Education (WFME) Basic Medical Education Standards. To evaluate the effectiveness of DSMA’s internal quality assurance system and its progression towards a quality culture, this study explores faculty perceptions and practices regarding the internal quality assurance process. An explanatory sequential mixed method design was adopted, comprising quantitative surveys followed by qualitative in-depth interviews. Pre- and post-test surveys were administered to DSMA faculty members before and after an IQA training workshop. The surveys assessed knowledge, attitudes, and practices related to the internal quality assurance system. Qualitative data was collected through in-depth interviews with selected faculty members to delve deeper into their experiences and perceptions regarding the IQA process. Quantitative analysis revealed an improvement in faculty awareness and attitudes towards the IQA system post-training. However, challenges such as confusion about the functional place of the QA unit and concerns about disturbing academic freedom persisted. Qualitative findings highlighted varying levels of experience and awareness among faculty members, with unanimous recognition of the need to strengthen the IQA framework by adhering to international guidelines and fostering a culture of continuous improvement. Faculty attitudes towards the IQA process varied, with some viewing it as an extra burden and others recognizing its necessity for document organization and quality control. Faculty involvement in the IQA process varied, with departmental leadership playing a crucial role in promoting participation. While progress has been made in raising awareness and improving attitudes towards the IQA system at DSMA, challenges remain, indicating the need for ongoing efforts in awareness-building and perception management. Structural improvements, regular training programs, and ongoing evaluation are essential to strengthening the IQA framework and fostering a quality culture at DSMA. The successful implementation of quality assurance program depends on teamwork amongst leadership, academics, and all stakeholders.
Published in | Higher Education Research (Volume 9, Issue 3) |
DOI | 10.11648/j.her.20240903.13 |
Page(s) | 57-69 |
Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
Copyright |
Copyright © The Author(s), 2024. Published by Science Publishing Group |
Internal Quality Assurance, Quality Culture, Medical Education, Defence Services Medical Academy, Myanmar, WFME Standards
Variables | Faculty Respondents (%) | ||
---|---|---|---|
Before workshop | After workshop | ||
Designation | Professor | 45 | 39 |
Associate Professor | 19 | 10 | |
Lecturer | 13 | 24 | |
Assistant Lecturer | 23 | 27 | |
Teaching experience | ≤ 5 years | 54 | 39 |
5-10 years | 25 | 30 | |
≥ 10 years | 21 | 31 |
No. | Questions | Faculty Respondents (%) | |
---|---|---|---|
Before workshop | After workshop | ||
1 | When did DSMA start introducing a quality assurance system? | 28.6 | 49.3** |
2 | Does DSMA have an IQA policy statement in the MBBS Program? | 91.1 | 100* |
3 | Who is the most responsible person or persons for building a quality culture within DSMA? | 84.8 | 95.5* |
4 | Why did DSMA introduce a quality assurance system? | 90.2 | 26.9 |
5 | What kind of structure is placed to support the internal quality assurance processes? | 24.5 | 25.5 |
6 | DSMA QA is designed by applying a ready-made model like ISO. | 56.3 | 68.2 |
7 | Does DSMA have an internal evaluation process that provides feedback to each department? | 90.2 | 95.5 |
8 | How many times per year is an internal evaluation conducted in DSMA? | 40.2 | 55.2* |
No. | Questions | Aggregated Answer (Agreement) (%) | |
---|---|---|---|
Before workshop | After workshop | ||
1 | IQA stimulates identification of defects in teaching and learning process. | 94.6 | 94.1 |
2 | IQA helps staff members to apply their everyday academic life. | 81.2 | 86.6 |
3 | IQA enables the development of educational programs and curricula. | 91.1 | 94.1 |
4 | IQA stimulates staff members’ professional development. | 85.7 | 89.6 |
5 | IQA enables staff members to make their personal contribution to the quality of education. | 88.4 | 93.8 |
6 | IQA encourages teamwork and collaboration among staff members. | 91.9 | 92.6 |
7 | IQA can disturb an individual's academic freedom. | 37.0 | 31.0** |
8 | IQA empowers students by considering their opinions. | 83.0 | 91.0 |
9 | In DSMA, formal QA processes are done on regular basis. | 73 | 83.5 |
10 | DSMA has developed clear learning outcomes for the undergraduate program. | 90.2 | 91 |
11 | DSMA’s learning outcomes for the undergraduate program are publicly available (for example via website). | 53.7 | 52.3 |
12 | In DSMA, curriculum design processes are done by the Curriculum Review Committee. | 86.5 | 86.6 |
13 | DSMA assessment methods and criteria applied are publicly available (for example, via the website). | 40.9 | 40.3 |
14 | The students are informed by the Year coordinator concerning assessment methods & criteria applied at the beginning of the Year. | 81.2 | 85.1 |
15 | Teaching staff are evaluated using student feedback forms. | 79.5 | 82.0 |
16 | Learning resources are regularly offered, monitored, and improved. | 74.1 | 88.0 |
17 | There is a process for monitoring individual students' progression via the students’ logbook. | 80.3 | 83.1 |
18 | The results of the students’ feedback are followed up by discussions in the meetings attended by staff members. | 73.3 | 83.5 |
19 | The results of the students' feedback are informed to them, and actions are taken based on their feedback. | 68.2 | 74.6 |
No. | Questions | Aggregated Answer (Agreement) (%) | |
---|---|---|---|
Before workshop | After workshop | ||
1 | I often have negative attitudes about IQA. | 20.5 | 17.9 |
2 | I think IQA is the job of institutional administrators only. | 86.6 | 86.6 |
3 | Implementation of IQA makes me uncomfortable environment for academic activities. | 83.9 | 83.6 |
4 | I am doubtful about the work of IQA and its outcomes. | 18.8 | 18.0 |
5 | Implementation of IQA contributes to the increased workload. | 63.1 | 49.3 |
6 | I get nervous that I am not able to handle changes introduced by IQA. | 33.0 | 25.8 |
7 | IQA stimulates identification of defects in teaching and learning process. | 75.9 | 75.3 |
8 | Implementation of IQA contributes to administrative burden. | 51.8 | 31.8 |
9 | I think that overall, the current process of IQA in DSMA is effective. | 82.2 | 80.3 |
10 | I think that the implementation of IQA can enhance the quality culture in DSMA. | 97.0 | 97.3 |
No. | Questions | Aggregated Answer (Agreement) (%) | |
---|---|---|---|
Before workshop | After workshop | ||
1 | I support the implementation of changes offered by IQA. | 91.1 | 89.4 |
2 | I have been involved in some discussions about IQA changes. | 73.2 | 71.2 |
3 | I am trying to encourage my colleagues to adopt IQA changes. | 80.4 | 87.3 |
4 | I will work longer hours to successfully implement IQA changes. | 65.8 | 70.8 |
5 | I have been involved in the process of IQA at my department. | 80.3 | 87.9 |
6 | I have been involved in the process of IQA at my institution. | 82.9 | 89.4 |
DSMA | Defence Services Medical Academy |
EQA | External Quality Assurance |
HEI | Higher Education Institution |
IM | International Mobility |
IQA | Internal Quality Assurance |
MMC | Myanmar Medical Council |
MMCAC | Myanmar Medical Council Accreditation Committee |
PBL | Problem-Based Learning |
QA | Quality Assurance |
QAS | Quality Assurance System |
SPSS | Statistical Package for the Social Sciences |
UAJJ | Atma Jaya Catholic University, Jakarta |
WFME | World Federation for Medical Education |
WHO | World Health Organization |
WMA | World Medical Association |
Below is the link to the supplementary material:
[1] | Islam GMN. Journey towards QAA (Quality Assurance and Accreditation) mechanism to improve quality education of HELs (Higher Education Institutions) in Bangladesh-issues, challenges and prospects. |
[2] | Weisz G, Nannestad B. The World Health Organization and the global standardization of medical training, a history. Glob Health. 2021, 17(1): 1–13. |
[3] | Myanmar Medical Council. Standards for Accreditation Basic Medical Education Programme in Myanmar, |
[4] | Myanmar Medical Council. Guideline for institutions applying for accreditation, |
[5] | Tackett S, Grant J, Mmari K. Designing an evaluation framework for WFME basic standards for medical education. Med Teach. 2016, 38(3): 291–296. |
[6] | MacCarrick G. A practical guide to using the World Federation for Medical Education (WFME) standards. WFME 1: mission and objectives. Ir J Med Sci. 2010, 179: 483–487. |
[7] | Bernhard A. Quality assurance in an international higher education area. Springer, 2011. |
[8] | Daromes FE, Ng S. Embedding core value into the internal quality assurance systems in higher education. Procedia-Soc Behav Sci. 2015, 211: 660–664. |
[9] | Nenadal J. Comprehensive quality assessment of Czech higher education institutions. Int J Qual Serv Sci. 2015, 7(2/3): 138–151. |
[10] | Tat’yana ML, Kasimovskaya NA, Petrova VN, et al. The internal system for quality assessment of education results at a medical university. Electron J Gen Med; 15. |
[11] | BENY MM, Akbar M, Madhakomala R. Evaluation of Internal Quality Assurance Implementation at Atma Jaya Catholic University. Int J Educ Res Rev. 2022, 7(3): 133–142. |
[12] | Yuzkiv H, Slipchuk V, Batechko N, et al. Internal Quality Assurance of the Education Program at Higher Educational Institutions. |
[13] | Loukkola T, Zhang T. Examining quality culture: Part 1-Quality assurance processes in higher education institutions. Brussels: European University Association. 2010 Dec 10. |
[14] | Shurgaia M. Academics coping with quality: a study of attitudes towards quality assurance in Georgian higher education. Journal of Research and Innovation in Higher Education. 2015 Jun 30, 1(1): 114-41. |
[15] | Rahnuma N. Evolution of quality culture in an HEI: critical insights from university staff in Bangladesh. Educ Assess Eval Account. 2020, 32(1): 53–81. |
[16] | Islam GMN, Ali MI, Islam MZ. Quality assurance and accreditation mechanisms of higher education institutions: policy issues and challenges in Bangladesh. Eur J Educ Stud. |
[17] | Cardoso S, Rosa MJ, Videira P, et al. Internal quality assurance: A new culture or added bureaucracy? Assess Eval High Educ. 2019, 44(2): 249–262. |
[18] | Tavares O, Sin C, Videira P. Actors and factors behind the development of internal quality assurance systems. IATED. 2017, pp. 8402–8409. |
[19] | Vukasovic M. Institutionalisation of internal quality assurance: focusing on institutional work and the significance of disciplinary differences. Qual High Educ. 2014, 20(1): 44–63. |
[20] | Martin M. Internal quality assurance: enhancing higher education quality and graduate employability. |
[21] | Pham NTT. Faculty engagement in internal quality assurance of academic programs: A literature review. Vietnam J Educ. 2022, 10–19. |
APA Style
Than, M. M., Aung, Y. P., Soe, A. P. P., Soe, Y. N., Htike, H., et al. (2024). Evaluation of Internal Quality Assurance System in Defence Services Medical Academy: Moving Toward Quality Culture. Higher Education Research, 9(3), 57-69. https://doi.org/10.11648/j.her.20240903.13
ACS Style
Than, M. M.; Aung, Y. P.; Soe, A. P. P.; Soe, Y. N.; Htike, H., et al. Evaluation of Internal Quality Assurance System in Defence Services Medical Academy: Moving Toward Quality Culture. High. Educ. Res. 2024, 9(3), 57-69. doi: 10.11648/j.her.20240903.13
AMA Style
Than MM, Aung YP, Soe APP, Soe YN, Htike H, et al. Evaluation of Internal Quality Assurance System in Defence Services Medical Academy: Moving Toward Quality Culture. High Educ Res. 2024;9(3):57-69. doi: 10.11648/j.her.20240903.13
@article{10.11648/j.her.20240903.13, author = {Mo Mo Than and Ye Phyo Aung and Aung Paing Paing Soe and Yan Naing Soe and Hein Htike and Khine Kyaw Oo and Tun Tun Naing and Tayzar Hein and Zaw Phyo and Si Thu Tun and Marlar Than and Titi Savitri Prihatiningsih}, title = {Evaluation of Internal Quality Assurance System in Defence Services Medical Academy: Moving Toward Quality Culture }, journal = {Higher Education Research}, volume = {9}, number = {3}, pages = {57-69}, doi = {10.11648/j.her.20240903.13}, url = {https://doi.org/10.11648/j.her.20240903.13}, eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.her.20240903.13}, abstract = {The escalating number of higher education institutions globally has heightened the demand for credible education policies and quality assurance mechanisms. The establishment of organizations for quality assurance providers and accreditors has become widespread to meet this demand. The Myanmar Medical Council Accreditation Committee (MMCAC) was established in 2016 to ensure the quality and standard of medical practice in Myanmar. Defence Services Medical Academy (DSMA), one of Myanmar’s medical universities, transitioned to an outcome-based integrated program in line with the World Federation for Medical Education (WFME) Basic Medical Education Standards. To evaluate the effectiveness of DSMA’s internal quality assurance system and its progression towards a quality culture, this study explores faculty perceptions and practices regarding the internal quality assurance process. An explanatory sequential mixed method design was adopted, comprising quantitative surveys followed by qualitative in-depth interviews. Pre- and post-test surveys were administered to DSMA faculty members before and after an IQA training workshop. The surveys assessed knowledge, attitudes, and practices related to the internal quality assurance system. Qualitative data was collected through in-depth interviews with selected faculty members to delve deeper into their experiences and perceptions regarding the IQA process. Quantitative analysis revealed an improvement in faculty awareness and attitudes towards the IQA system post-training. However, challenges such as confusion about the functional place of the QA unit and concerns about disturbing academic freedom persisted. Qualitative findings highlighted varying levels of experience and awareness among faculty members, with unanimous recognition of the need to strengthen the IQA framework by adhering to international guidelines and fostering a culture of continuous improvement. Faculty attitudes towards the IQA process varied, with some viewing it as an extra burden and others recognizing its necessity for document organization and quality control. Faculty involvement in the IQA process varied, with departmental leadership playing a crucial role in promoting participation. While progress has been made in raising awareness and improving attitudes towards the IQA system at DSMA, challenges remain, indicating the need for ongoing efforts in awareness-building and perception management. Structural improvements, regular training programs, and ongoing evaluation are essential to strengthening the IQA framework and fostering a quality culture at DSMA. The successful implementation of quality assurance program depends on teamwork amongst leadership, academics, and all stakeholders. }, year = {2024} }
TY - JOUR T1 - Evaluation of Internal Quality Assurance System in Defence Services Medical Academy: Moving Toward Quality Culture AU - Mo Mo Than AU - Ye Phyo Aung AU - Aung Paing Paing Soe AU - Yan Naing Soe AU - Hein Htike AU - Khine Kyaw Oo AU - Tun Tun Naing AU - Tayzar Hein AU - Zaw Phyo AU - Si Thu Tun AU - Marlar Than AU - Titi Savitri Prihatiningsih Y1 - 2024/06/06 PY - 2024 N1 - https://doi.org/10.11648/j.her.20240903.13 DO - 10.11648/j.her.20240903.13 T2 - Higher Education Research JF - Higher Education Research JO - Higher Education Research SP - 57 EP - 69 PB - Science Publishing Group SN - 2578-935X UR - https://doi.org/10.11648/j.her.20240903.13 AB - The escalating number of higher education institutions globally has heightened the demand for credible education policies and quality assurance mechanisms. The establishment of organizations for quality assurance providers and accreditors has become widespread to meet this demand. The Myanmar Medical Council Accreditation Committee (MMCAC) was established in 2016 to ensure the quality and standard of medical practice in Myanmar. Defence Services Medical Academy (DSMA), one of Myanmar’s medical universities, transitioned to an outcome-based integrated program in line with the World Federation for Medical Education (WFME) Basic Medical Education Standards. To evaluate the effectiveness of DSMA’s internal quality assurance system and its progression towards a quality culture, this study explores faculty perceptions and practices regarding the internal quality assurance process. An explanatory sequential mixed method design was adopted, comprising quantitative surveys followed by qualitative in-depth interviews. Pre- and post-test surveys were administered to DSMA faculty members before and after an IQA training workshop. The surveys assessed knowledge, attitudes, and practices related to the internal quality assurance system. Qualitative data was collected through in-depth interviews with selected faculty members to delve deeper into their experiences and perceptions regarding the IQA process. Quantitative analysis revealed an improvement in faculty awareness and attitudes towards the IQA system post-training. However, challenges such as confusion about the functional place of the QA unit and concerns about disturbing academic freedom persisted. Qualitative findings highlighted varying levels of experience and awareness among faculty members, with unanimous recognition of the need to strengthen the IQA framework by adhering to international guidelines and fostering a culture of continuous improvement. Faculty attitudes towards the IQA process varied, with some viewing it as an extra burden and others recognizing its necessity for document organization and quality control. Faculty involvement in the IQA process varied, with departmental leadership playing a crucial role in promoting participation. While progress has been made in raising awareness and improving attitudes towards the IQA system at DSMA, challenges remain, indicating the need for ongoing efforts in awareness-building and perception management. Structural improvements, regular training programs, and ongoing evaluation are essential to strengthening the IQA framework and fostering a quality culture at DSMA. The successful implementation of quality assurance program depends on teamwork amongst leadership, academics, and all stakeholders. VL - 9 IS - 3 ER -