University of Virginia School of
Systems Community Leadership Meeting
September 12, 2012
Medical Education Building, Simulation Center Conference Room G165, 4:00 p.m.
Ait-Daoud Tiourirne (MBB), Behm (GI), Bray
(Endo-Repro), Bryant (CPD & MSI), Clark (HemOnc), Cohen (MBB),
Dalkin (Endo-Repro), Dent (CV), Douvas (HemOnc), Durieux
(C2S), Gay (Pul), Innes (HemOnc), Kalantari (Ren),
Lorenz (MIS), Lowson (Pul), McCollum(MSI),
McDaniel (CPD), Marks (CPD), Moyer (Pul), Nathan (MBB),
Nunez, Noramly(MCM), Pearson (MIS), Rosner (Ren), Russell
(MSI), Shah (GI), Waggoner-Fountain(MCM), Worden (MBB);
also Alexander, Bradley, Caelleigh, Canterbury,
Casola, Graham, Jackson, Knight, Nadkarni, Rogers, Roy,
Tomlin, White, Yoon
Co-chairs: Bart Nathan, Selina Noramly
Peds and surgery in systems: System leaders were encouraged to review their curriculum to make sure that pediatric and surgery content is covered as well as adult and medicine content.
Melanie McCollum asked how to determine if learning objectives related to surgical specialties are appropriate for first and second year medical students. It was suggested that a general internist/pathologist be asked to review the materials if there is a concern that specialty-related questions may be too specific/advanced for pre-clerkship students.
Attendance: The MCM system leaders were asked to provide feedback concerning attendance quizzes. Linda Waggoner-Fountain reported that selected students remind their classmates to take the quiz at the beginning of each session; these reminders reportedly occur about 60% of the time. There were a couple instances when the reminder came at an inappropriate time interrupting speakers, but the reminders have not been an issue more recently. Students have been vocal about their dislike of the attendance quizzes. Selina Noramly stated that certain students who fail to complete the online attendance quiz are routinely participating in class. Students are feeling angst over possibly receiving concern cards due to forgetting to log in and take the attendance quizzes.
Some suggestions to improve attendance taking were discussed:
A) Phone app—Faculty in other settings at UVA are using apps. This option could pose technical problems based on the variety of phones the students use.
B) Daily online quiz—This suggestion was made at the last
town hall meeting. Create 1 attendance quiz per day that remains open for a longer window of time. Students report which sessions they attended after the fact. The hope is that if students only have to take 1 attendance quiz per day, compliance will increase thereby improving the overall attendance data collected.
C) Keep current attendance quizzes open for a longer period of time—This option would allow the current process to remain in place, but provide more time to log in and record attendance.
Exam length: The exam length guidelines previously sent out by Dr. Innes were included in the system leaders’ agenda. These guidelines should be reinforced.
Selina asked about a possible exception for an assessment in MCM that has been allotted extra time in the past per the request of an instructor who includes questions requiring calculations. Bart Nathan suggested that the Assessment Review Committee (ARC) that reviewed the specific items would be the best entity to decide if extra time is warranted. There was a general consensus among the group; the MCM System Leaders will consult with the ARC.
Faculty evaluation system: Did not discuss this item—will review next meeting.
Assessment metadata: A handout detailing assessment metadata was given (see attached). This prompted a discussion concerning why students are unable to see the entire summative including feedback for all questions. Students do not understand why they are able to see all information on formatives but only the answers missed on summatives. High-performing students feel like they are penalized as they are not able to access as much information as their classmates who get multiple questions wrong. Students want to have as many questions to use to prepare for USMLE exams.
Dr. Innes offered a logical explanation: formative assessments are just that, formative, and meant to be used to develop knowledge and understanding of the materials, thus all information is available to the students. Summative assessments are evaluative and meant to demonstrate what has been mastered. Allowing full, yearlong access to the summative questions is cause for concern for some as many of the questions will be used again in future summatives. Others ask why restrict access to the questions if students have already had access to them?
During the discussion, rumors surfaced of students taking screen shots of each question as they take assessments. It was clearly stated that taking screen shots is an honor code violation. If a student knows of a classmate doing this, they are obligated to report it or will be in violation of the honor code themselves.
No consensus was reached regarding allowing access to all summative questions and feedback. It was suggested that the Curriculum Committee should decide this issue.
TBL: TBL criteria from the Curriculum Committee minutes was included in the agenda. The criteria will be discussed at a future meeting.
Next meeting: The next meeting will be Wednesday, October 10, 2012.