Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan

Muhammad Noman Rashid; Ali Muhammad Soomro; Aftab Hussain Abro; Syeda Beenish Noman

doi:doi:10.11648/j.aap.20170201.12

| Peer-Reviewed

Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan

Muhammad Noman Rashid, Ali Muhammad Soomro, Aftab Hussain Abro, Syeda Beenish Noman

Published in Advances in Applied Physiology (Volume 2, Issue 1)

Received: 17 April 2017 Accepted: 16 May 2017 Published: 28 August 2017

Views: Downloads:

Download PDF

Share This Article

Twitter
Linked In
Facebook

Abstract

Background Formative practice quizzes have become common resources for self-evaluation and focused reviews of course content in the medical curriculum. In the current study two separate studies were conducted to (1) compare the effects of a single or multiple voluntary practice quizzes on subsequent summative examinations and (2) examine when students are most likely to use practice quizzes relative to the summative examinations. Material and Methods In the first study, providing a single online practice quiz followed by instructor feedback had no effect on examination average grades compared to the previous year or student performances on similar questions. However, there were significant correlations between student performance on each practice quiz and each summative examination (r 50.42 and r 50.24). When students were provided multiple practice quizzes with feedback (second study). Results there was a weak correlation between the frequency of use and performance on each summative examination (r 50.17 and r 50.07). The frequency with which students accessed the practice quizzes was greatest the day before each examination. In both studies, there was a decline in the level of student utilization of practice quizzes overtime. Conclusion we concluded that practice quizzes provide some predictive value for performances on summative examinations. Second, making practice quizzes available for longer periods prior to summative examinations does not promote the use of the quizzes as a study strategy because students appear to use them mostly to assess knowledge one to two days prior to examinations.

Published in	Advances in Applied Physiology (Volume 2, Issue 1)
DOI	10.11648/j.aap.20170201.12
Page(s)	10-17
Creative Commons	This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright	Copyright © The Author(s), 2017. Published by Science Publishing Group

Keywords

Formative Assessment, Physiology Education, Practice Tests, Examinations, Summative Assessment, Study Tools, Online Examination

References

[1]	Burns ER. 2010. “Anatomizing” reversed: Use of examination questions that foster use of higher order learning skills by students. Anat Sci Educ 3:330–334.
[2]	Butler DL, Winne PH. 1995. Feedback and self-regulated learning: A theoretical synthesis. Rev Educ Res 65:245–281.
[3]	Carpenter SK, Kelly JW. 2012. Tests enhance retention and transfer of spatial learning. Psychon Bull Rev 19:443–448.
[4]	Carrillo-de-la-Pe~na MT, Baille`s E, Caseras X, Mart_ınez A, Ortet G, P_erez J. 2009. Formative assessment and academic achievement in pre-graduate students of health sciences. Adv Health Sci Educ Theory Pract 14:61–67.
[5]	Cook DA, Thompson WG, Thomas KG, Thomas MR, Pankratz VS. 2006. Impact of self-assessment questions and learning styles in web-based learning.
[6]	A randomized, controlled, crossover trial. Acad Med 81:231–238.
[7]	Dobson JL. 2008. The use of formative online quizzes to enhance class preparation and scores on summative exams. Adv Physiol Educ 32:297–302.
[8]	Donnon T, Paolucci EO, Violato C. 2007. The predictive validity of the MCAT for medical school performance and medical board licensing examinations: A meta-analysis of the published research. Acad Med 82:100–106.
[9]	Evans C. 2013. Making sense of assessment feedback in higher education. Rev Educ Res 83:70–120.
[10]	Gandy RA, Herial NA, Khuder SA, Metting PJ. 2008. Use of curricular and extracurricular assessments to predict performance on the United States Medical Licensing Examination (USMLE) Step 1: A multi-year study. Learn Assist Rev 13:27–35.
[11]	Hamdy H, Prasad K, Anderson MB, Scherpbier A, Williams R, Zwierstra R, Cuddihy H. 2006. BEME systematic review: Predictive values of measurements obtained in medical schools and future performance in medical practice. Med Teach 28:103–116.
[12]	Hattie J, Timperley H. 2007. The power of feedback. Rev Educ Res 77:81–112. Holtman MC, Swanson DB, Ripkey DR, Case SM. 2001. Using basic science subject tests to identify students at risk for failing Step 1. Acad Med 76: S48–S51.
[13]	Hoyt A, McNulty JA, Gruener G, Chandrasekhar A, Espiritu B, Ensminger D, Price R Jr, Naheedy R. 2010. An audience response system may influence student performance on anatomy examination questions. Anat Sci Educ 3:295–299.
[14]	Johnson GM. 2006. Optional online quizzes: College student use and relationship to achievement. Can J Learn Tech 32:61.
[15]	Karpicke JD, Blunt JR. 2011. Retrieval practice produces more learning than elaborative studying with concept mapping. Science 331:772–775.
[16]	Kibble J. 2007. Use of unsupervised online quizzes as formative assessment in a medical physiology course: Effects of incentives on student participation and performance. Adv Physiol Educ 31:253–260.
[17]	Kibble JD. 2011. Voluntary participation in online formative quizzes is a sensitive predictor of student success. Adv Physiol Educ 35:95–96.
[18]	Kibble JD, Johnson TR, Khalil MK, Nelson LD, Riggs GH, Borrero JL, Payer AF. 2011. Insights gained from the analysis of performance and participation in online formative assessment. Teach Learn Med 23:125–129.
[19]	Krasne S, Wimmers PF, Relan A, Drake TA. 2006. Differential effects of two types of formative assessment in predicting performance of first-year medical students. Adv Health Sci Educ Theory Pract 11:155–171.
[20]	Kromann CB, Jensen ML, Ringsted C. 2009. The effect of testing on skills learning. Med Educ 43:21–27.
[21]	Kulik JA, Kulik CC, Bangert RL. 1984. Effects of practice on aptitude and achievement test scores. Educ Res J 21:435–447.
[22]	Larsen DP, Butler AC, Roediger HL III. 2008. Test-enhanced learning in medical education. Med Educ 42:959–966.
[23]	LCME. 2010. Liaison Committee on Medical Education. Functions and Structure of a Medical School: Standards for Accreditation of Medical Education Programs Leading to the M. D. Degree. June, 2010, Washington, DC: Liaison Committee on Medical Education. 28 p.
[24]	Leaf DE, Leo J, Smith PR, Yee H, Stern A, Rosenthal PB, Cahill-Gallant EB.
[25]	Pillinger MH. 2009. SOMOSAT: Utility of a web-based self-assessment tool in undergraduate medical education. Med Teach 31: e211–e219.
[26]	Logan JM, Thompson AJ, Marshak DW. 2011. Testing to enhance retention in human anatomy. Anat Sci Educ 4:243–248.
[27]	McNulty JA, Halama J, Espiritu B. 2004. Evaluation of computer-aided instruction in the medical gross anatomy curriculum. Clin Anat 17:73–78.
[28]	McNulty JA, Sonntag B, Sinacore J. 2007. Test-taking behaviors on a multiplechoice exam are associated with performance on the exam and with learning style. Med Sci Educ 17:52–57.
[29]	McNulty J, Chandrasekhar A, Hoyt A, Gruener G, Espiritu B, Price R. 2011. Computer-based testing in the medical curriculum: A decade of experiences at one school. J Educ Comput Res 45:287–295.
[30]	McNulty JA, Ensminger DC, Hoyt AE, Chandrasekhar AJ, Gruener G, Espiritu B. 2012. Study strategies are associated with performances in basic science courses in the medical curriculum. J Educ Learn 1:1–11.
[31]	Olson BL, McDonald JL. 2004. Influence of online formative assessment upon student learning in biomedical science courses. J Dent Educ 68:656–659.
[32]	Palmer EJ, Devitt PG. 2008. Limitations of student-driven formative assessment in a clinical clerkship. A randomised controlled trial. BMC Med Educ 8: 29.
[33]	Peterson C, Tucker RP. 2005. Medical gross anatomy as a predictor of performance on USMLE step 1. Anat Rec 283B: 5–8.
[34]	Poole P, Shulruf B, Rudland J, Wilkinson T. 2012. Comparison of UMAT scores and GPA in prediction of performance in medical school: A national study. Med Educ 46:163–171.
[35]	Pyc MA, Rawson KA. 2010. Why testing improves memory: Mediator effectiveness hypothesis. Science 330:335.
[36]	Roediger HL, Karpicke JD. 2006. Test-enhanced learning: Taking memory tests improves long-term retention. Psychol Sci 17:249–255.
[37]	Roediger HL, Agarwal PK, McDaniel MA, McDermott KB. 2011. Testenhanced learning in the classroom: Long-term improvements from quizzing. J Exp Psychol Appl 17:382–395.
[38]	Ripkey DR, Swanson DB, Case SM. 1998. School-to-school differences in Step 1 performance as a function of curriculum type and use of Step 1 in promotion/ graduation requirements. Acad Med 73: S16–S18.
[39]	Smythe G, Hughes D. 2008. Self-directed learning in gross human anatomy: Assessment outcomes and student perceptions. Anat Sci Educ 1:145–153.
[40]	Streips UN. 2007. Quizzes are for learning not just evaluation. Med Sci Educ 17: s7–s8.
[41]	Urtel MG, Bahamonde RE, Mikesky AE, Udry EM, Vessely JS. 2006. On-line quizzing and its effect on student engagement and academic performance. J. Scholarsh Teach Learn 6:84–92.
[42]	Velan GM, Jones P, McNeil HP, Kumar RK. 2008. Integrated online formative assessments in the biomedical sciences for medical students: Benefits for learning. BMC Med Educ 8:52.
[43]	Wissman KT, Rawson KA, Pyc MA. 2011. The interim test effect: Testing prior material can facilitate the learning of new material. Psychon Bull Rev 18: 1140–1147.
[44]	Wood TJ. 2009. The effect of reused questions on repeat examinees. Adv Health Sci Educ Theory Pract 14: 465–473.

Cite This Article

Plain Text BibTeX RIS

APA Style

Muhammad Noman Rashid, Ali Muhammad Soomro, Aftab Hussain Abro, Syeda Beenish Noman. (2017). Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan. Advances in Applied Physiology, 2(1), 10-17. https://doi.org/10.11648/j.aap.20170201.12

Copy | Download

ACS Style

Muhammad Noman Rashid; Ali Muhammad Soomro; Aftab Hussain Abro; Syeda Beenish Noman. Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan. Adv. Appl. Physiol. 2017, 2(1), 10-17. doi: 10.11648/j.aap.20170201.12

Copy | Download

AMA Style

Muhammad Noman Rashid, Ali Muhammad Soomro, Aftab Hussain Abro, Syeda Beenish Noman. Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan. Adv Appl Physiol. 2017;2(1):10-17. doi: 10.11648/j.aap.20170201.12

Copy | Download

@article{10.11648/j.aap.20170201.12,
  author = {Muhammad Noman Rashid and Ali Muhammad Soomro and Aftab Hussain Abro and Syeda Beenish Noman},
  title = {Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan},
  journal = {Advances in Applied Physiology},
  volume = {2},
  number = {1},
  pages = {10-17},
  doi = {10.11648/j.aap.20170201.12},
  url = {https://doi.org/10.11648/j.aap.20170201.12},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.aap.20170201.12},
  abstract = {Background Formative practice quizzes have become common resources for self-evaluation and focused reviews of course content in the medical curriculum. In the current study two separate studies were conducted to (1) compare the effects of a single or multiple voluntary practice quizzes on subsequent summative examinations and (2) examine when students are most likely to use practice quizzes relative to the summative examinations. Material and Methods In the first study, providing a single online practice quiz followed by instructor feedback had no effect on examination average grades compared to the previous year or student performances on similar questions. However, there were significant correlations between student performance on each practice quiz and each summative examination (r 50.42 and r 50.24). When students were provided multiple practice quizzes with feedback (second study). Results there was a weak correlation between the frequency of use and performance on each summative examination (r 50.17 and r 50.07). The frequency with which students accessed the practice quizzes was greatest the day before each examination. In both studies, there was a decline in the level of student utilization of practice quizzes overtime. Conclusion we concluded that practice quizzes provide some predictive value for performances on summative examinations. Second, making practice quizzes available for longer periods prior to summative examinations does not promote the use of the quizzes as a study strategy because students appear to use them mostly to assess knowledge one to two days prior to examinations.},
 year = {2017}
}

Copy | Download

TY  - JOUR
T1  - Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan
AU  - Muhammad Noman Rashid
AU  - Ali Muhammad Soomro
AU  - Aftab Hussain Abro
AU  - Syeda Beenish Noman
Y1  - 2017/08/28
PY  - 2017
N1  - https://doi.org/10.11648/j.aap.20170201.12
DO  - 10.11648/j.aap.20170201.12
T2  - Advances in Applied Physiology
JF  - Advances in Applied Physiology
JO  - Advances in Applied Physiology
SP  - 10
EP  - 17
PB  - Science Publishing Group
SN  - 2471-9714
UR  - https://doi.org/10.11648/j.aap.20170201.12
AB  - Background Formative practice quizzes have become common resources for self-evaluation and focused reviews of course content in the medical curriculum. In the current study two separate studies were conducted to (1) compare the effects of a single or multiple voluntary practice quizzes on subsequent summative examinations and (2) examine when students are most likely to use practice quizzes relative to the summative examinations. Material and Methods In the first study, providing a single online practice quiz followed by instructor feedback had no effect on examination average grades compared to the previous year or student performances on similar questions. However, there were significant correlations between student performance on each practice quiz and each summative examination (r 50.42 and r 50.24). When students were provided multiple practice quizzes with feedback (second study). Results there was a weak correlation between the frequency of use and performance on each summative examination (r 50.17 and r 50.07). The frequency with which students accessed the practice quizzes was greatest the day before each examination. In both studies, there was a decline in the level of student utilization of practice quizzes overtime. Conclusion we concluded that practice quizzes provide some predictive value for performances on summative examinations. Second, making practice quizzes available for longer periods prior to summative examinations does not promote the use of the quizzes as a study strategy because students appear to use them mostly to assess knowledge one to two days prior to examinations.
VL  - 2
IS  - 1
ER  -

Copy | Download

Author Information

Muhammad Noman Rashid

Department of Physiology, Research and Ethics Department Shaheed Mohtarma Benazir Bhutto Medical College, Karachi, Pakistan
Ali Muhammad Soomro

Department of Physiology, University of Sindh, Jamshoro, Pakistan
Aftab Hussain Abro

Department of Community Health Sciences, Shaheed Mohtarma Benazir Bhutto Medical College, Karachi, Pakistan
Syeda Beenish Noman

Department of Obstetrics and Gynecology, Aga University Hospital, Karachi, Pakistan

Download PDF

Sections

Plain Text BibTeX RIS

APA Style

Muhammad Noman Rashid, Ali Muhammad Soomro, Aftab Hussain Abro, Syeda Beenish Noman. (2017). Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan. Advances in Applied Physiology, 2(1), 10-17. https://doi.org/10.11648/j.aap.20170201.12

Copy | Download

ACS Style

Muhammad Noman Rashid; Ali Muhammad Soomro; Aftab Hussain Abro; Syeda Beenish Noman. Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan. Adv. Appl. Physiol. 2017, 2(1), 10-17. doi: 10.11648/j.aap.20170201.12

Copy | Download

AMA Style

Muhammad Noman Rashid, Ali Muhammad Soomro, Aftab Hussain Abro, Syeda Beenish Noman. Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan. Adv Appl Physiol. 2017;2(1):10-17. doi: 10.11648/j.aap.20170201.12

Copy | Download

@article{10.11648/j.aap.20170201.12,
  author = {Muhammad Noman Rashid and Ali Muhammad Soomro and Aftab Hussain Abro and Syeda Beenish Noman},
  title = {Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan},
  journal = {Advances in Applied Physiology},
  volume = {2},
  number = {1},
  pages = {10-17},
  doi = {10.11648/j.aap.20170201.12},
  url = {https://doi.org/10.11648/j.aap.20170201.12},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.aap.20170201.12},
  abstract = {Background Formative practice quizzes have become common resources for self-evaluation and focused reviews of course content in the medical curriculum. In the current study two separate studies were conducted to (1) compare the effects of a single or multiple voluntary practice quizzes on subsequent summative examinations and (2) examine when students are most likely to use practice quizzes relative to the summative examinations. Material and Methods In the first study, providing a single online practice quiz followed by instructor feedback had no effect on examination average grades compared to the previous year or student performances on similar questions. However, there were significant correlations between student performance on each practice quiz and each summative examination (r 50.42 and r 50.24). When students were provided multiple practice quizzes with feedback (second study). Results there was a weak correlation between the frequency of use and performance on each summative examination (r 50.17 and r 50.07). The frequency with which students accessed the practice quizzes was greatest the day before each examination. In both studies, there was a decline in the level of student utilization of practice quizzes overtime. Conclusion we concluded that practice quizzes provide some predictive value for performances on summative examinations. Second, making practice quizzes available for longer periods prior to summative examinations does not promote the use of the quizzes as a study strategy because students appear to use them mostly to assess knowledge one to two days prior to examinations.},
 year = {2017}
}

Copy | Download

TY  - JOUR
T1  - Medical Students Academic Performance Assessment in Physiology Courses Using Formative and Summative Quizzes at SMBB Medical College Karachi, Pakistan
AU  - Muhammad Noman Rashid
AU  - Ali Muhammad Soomro
AU  - Aftab Hussain Abro
AU  - Syeda Beenish Noman
Y1  - 2017/08/28
PY  - 2017
N1  - https://doi.org/10.11648/j.aap.20170201.12
DO  - 10.11648/j.aap.20170201.12
T2  - Advances in Applied Physiology
JF  - Advances in Applied Physiology
JO  - Advances in Applied Physiology
SP  - 10
EP  - 17
PB  - Science Publishing Group
SN  - 2471-9714
UR  - https://doi.org/10.11648/j.aap.20170201.12
AB  - Background Formative practice quizzes have become common resources for self-evaluation and focused reviews of course content in the medical curriculum. In the current study two separate studies were conducted to (1) compare the effects of a single or multiple voluntary practice quizzes on subsequent summative examinations and (2) examine when students are most likely to use practice quizzes relative to the summative examinations. Material and Methods In the first study, providing a single online practice quiz followed by instructor feedback had no effect on examination average grades compared to the previous year or student performances on similar questions. However, there were significant correlations between student performance on each practice quiz and each summative examination (r 50.42 and r 50.24). When students were provided multiple practice quizzes with feedback (second study). Results there was a weak correlation between the frequency of use and performance on each summative examination (r 50.17 and r 50.07). The frequency with which students accessed the practice quizzes was greatest the day before each examination. In both studies, there was a decline in the level of student utilization of practice quizzes overtime. Conclusion we concluded that practice quizzes provide some predictive value for performances on summative examinations. Second, making practice quizzes available for longer periods prior to summative examinations does not promote the use of the quizzes as a study strategy because students appear to use them mostly to assess knowledge one to two days prior to examinations.
VL  - 2
IS  - 1
ER  -

Copy | Download