Florida QM Initiative
Here are some of our most frequently asked questions
Question 1: As the Lead System Subscription Institution, what kind of access does FLVC have to affiliated institution’s QM course review data and how will FLVC utilize and disclose the data?
As the Lead System Subscription Institution, FLVC has access to all affiliated QM course reviews and the associated data. FLVC is responsible for providing QM system level reports. However, please note FLVC will only use aggregated QM data for reporting purposes. For example, “Florida Colleges”, “Florida Universities”, and “All of Florida’s public higher education institutions”. The QM Coordinators at the affiliated institutions are responsible for generating institutional QM reports. Affiliated intuitions can only access the QM course reviews and the associated data for their own institution.
Question 2: Who is the System Lead QM Coordinator designated by FLVC?
FLVC has designated Tom Tu as the System Lead QM Coordinator. Tom has been a QM Certified Peer Reviewer since 2008. Tom has been integrating QM standards and rubric in designing online and hybrid courses in higher education since that time, and many of the online courses he has designed and taught have passed the external QM review and been officially recognized by Quality Matters. Please feel free to contact Tom for any questions regarding Florida Quality Matters System per the contact information listed below.
Question 3: Do affiliated institutions still need to have their own institution QM Coordinator?
Yes, each institution must still have a qualified QM Coordinator.
Question 4: After joining the FL QM System, will the affiliated institution maintain control over the QM course review submission process?
Yes. The affiliated institutions retain full control to manage their own QM course review submission process. FLVC does NOT manage the QM course review submission process for individual affiliated institutions.
About the QM Rubric and Standards
1. How do I know what the QM Standards are looking for?
The Quality Matters Standards include statements or explanations called “annotations” that describe in detail what the standard is looking for. Course Peer Review teams use the annotations that are part of each standard to help decide about whether or not a standard is met. Faculty course developers can use the annotations to guide them to create course components that meet Quality Matters standards.
2. How does QM use the Rubric to score a course as having met standards? I want to make sure my course “passes”.
First, it’s important to point out that the QM process doesn’t involve pass/fail judgments. Instead, the process relies on the team members providing specific guidance based on evidence in the course for the course developer on what might be done to modify the course in order that it will eventually meet standards. There is a clear recognition throughout the process that there are many ways to meet each standard and that no course is perfect. For QM reviewed courses, the goal is to meet an 85% threshold in order to be certified as a quality course. The Quality Matters process is designed to ensure that courses undergoing review will eventually meet expectations at or above the 85% threshold.
3. Can I post a copy of the QM Rubric on our college resource page for faculty to access it?
You are able to post a digital version of the Quality Matters Annotated Rubric on a college Intranet or LMS site that is not public. You should include a notice that says, “This Rubric and any other Quality Matters materials are copyrighted by Quality Matters. They may be used only by faculty/staff of affiliate subscriber institutions within the statewide Quality Matters subscription in Florida. The digital copy of the Rubric is provided for personal reference purposes only and may not be printed and/or distributed. Individuals wishing a print copy should contact their campus Quality Matters Institution Representative.
About Course Reviews
1. Where can I learn more about how the Course Review Process works?
You can read more about the Course Review Process on Quality Matters website: https://www.qualitymatters.org/qm-membership/faqs/how-course-review-works
2. The process involves other faculty looking at my course to make recommendations. Are there requirements for confidentiality?
Certified Peer Reviewers are expected to maintain strict confidentiality about the courses they review. They are required to sign a Memorandum of Understanding (MOU) with Quality Matters annually that includes a statement about this specifically.
3. Who are the members of a course review team?
The review is carried out by a team of three certified peer reviewers. On the team, one must be a Master Reviewer and one must be a SME (subject matter expert). Team members can fulfill more than one role. The faculty member is on the team in a consultative role.
4. What are the eligibility requirements to become a course peer reviewer?
In order to be a Certified Peer Reviewer, one must have met the following criteria:
- Successful completion of Applying the Quality Matters Rubric Workshop
- Successful completion of the Peer Reviewer Course
- Have current online teaching experience (within the last 18 months)
- Must have a signed application and MOU on file with QMFC
In order to become a Certified Master Reviewer, one must have met the following criteria in addition to meeting all of the Peer Reviewer criteria:
- Must have served on a minimum of two official QM reviews
- Successful completion of the Master Reviewer Course
- Must re-certify annually through completion of a Master Reviewer Re-certification course
About Roles & Responsibilities
1. What’s the difference between a Campus QM Coordinator and a System Lead QM Coordinator?
The System Lead QM Coordinator serves as the single point of contact and communication gatekeeper for the entire system; manages the subscription in all areas – policies, procedures, financial issues, contract issues, etc.; advises all system parties about QM and ensures affiliates adhere to contract terms to include intellectual property and copyright issues; and, consults with affiliates for acquisition and implementation of professional development and course reviews. Only the System Lead QM Coordinator can arrange for training for the entire statewide system.
The Campus QM Coordinator serves as the single point of contact and communication gatekeeper for the institution; manages the subscription in accordance with the system subscriber in all areas – policies, procedures, financial issues, contract issues, etc.; advises the institution about QM and adheres to contract terms to include intellectual property and copyright issues; and, coordinates with the System Lead QM Coordinator for acquisition and implementation of trainings and course reviews.
2. What’s the difference between a Peer Reviewer and a Master Reviewer?
Peer Reviewers are experienced online faculty members who have completed the QM Peer Review Certification course. The Master Reviewer is an experienced Peer Reviewer who has completed additional training. The Master Reviewer has additional responsibilities during an official QM Review, including serving as the team chair during an official QM review. They are responsible for facilitating the review, all team communications and serve as the authoritative guide on matters related to application of the QM Rubric and process.
3. What’s the difference between a System Subscription & an Affiliate Subscription to Quality Matters?
Florida Virtual Campus has a System Subscription with Quality Matter. Each of the State University System of Florida and the Florida College System institutions has been offered the opportunity to become an affiliate subscriber under this System subscription. As part of this affiliate subscription, institutions have identified a campus QM Coordinator to help coordinate the campus QM activities.
About Professional Development
1. What workshops and courses are offered by QM?
Quality Matters offers Implementation Workshops and Courses that include the Applying the Quality Matters Rubric (APPQMR) Workshop, Peer Reviewer Certification (PRC) Course, Master Reviewer Certification (MRC) Course and QM Coordinator Training (QMCT).
QM also provides Course-focused Workshops, including Designing Your Online Course, Improve Your Online Course, Designing Your Blended Course and Standards-focused Workshops which include Design that Welcomes Your Students, Creating a Foundation with Learning Objectives, Choosing and Using Media Effectively, and Addressing Accessibility. QM Alignment Standards Workshops include Connecting Learning Objectives and Assessments, Link Instructional Materials and Learner Engagement. QM also now offers one workshop focused on Teaching Online, its Teaching Online-An Introduction to Online Delivery. More details are available at: https://www.qualitymatters.org/professional-development/workshops
2. What is the difference, if any, between the APPQMR 2-week online workshop and the APPQMR 1-day on-site, f2f workshop?
If you’re trying to decide whether the online or F2F workshop is best for you:
Two-Week Online APPQMR – This asynchronous workshop is delivered over the course of two weeks by two QM-certified facilitators. In this workshop participants will: (a) Read short lesson materials related to the QM rubric and review process, (b) Take a few short, 10-question quizzes on the material, (c) Apply the QM rubric to a sample online course, (d) Participate in forum discussions related to each of the 8 General Standards, and (e) Apply the QM rubric to a design scenario. It provides an excellent opportunity for faculty to individually consider how the rubric applies to each standard in course development and how the review process works in a course review, exchange ideas and perspectives on course design with colleagues, and gain personal experience applying the rubric.
One-Day On-Site (F2F) APPQMR – This workshop is delivered by one QM-certified facilitator over the course of six hours. In this workshop participants will: (a) Learn about the QM rubric and review process through presentation materials and activities provided by one QM-certified workshop facilitator, (b)Take one quiz on material presented, (c) Collaboratively apply the QM rubric to a sample online course, and (d) Apply the QM rubric to a design scenario. It provides an excellent opportunity for faculty to gain a general, introductory understanding of the QM rubric and how it might be applied in course development and in the course review process and exchange ideas and perspectives on course design with colleagues.
3. How should I decide whether to take the online or on-site workshop?
The APPQMR online workshop is recommended for faculty who intend to use the rubric to design their own courses, may submit a course for a QM course review in the future, or may decide to become a peer reviewer at some point in the future. This workshop provides an opportunity to look carefully at a sample course and make personal decisions about whether or not the standards are met, share your findings and reasons for your decisions with colleagues through the discussion threads, receive new ideas and perspectives from colleagues and write recommendations for improvement over the course of the two-week period. You can work at your own pace but will want to work and post along with colleagues to gain the most benefit from the course.
The APPQMR face-to-face workshop is appropriate for faculty who are interested in learning about the rubric and review process from a more “overview” perspective. Due to the limited time period, course material is presented by a facilitator and while there is time to for some discussion, due to time-constraints there is limited opportunity to individually practice applying the standards to a sample course.
4. When are the workshops offered?
A complete schedule for QM professional development workshops for the next six months is available online on QM website: https://www.qualitymatters.org/professional-development/schedule
5. How do I register for QM professional development workshops and courses?
Faculty and staff at the affiliated institutions need to contact the QM Coordinators on their campuses to register for QM professional development workshops and courses. Contact Your Campus QM Coordinator (link to a Google Doc. Excel file to be created by Tom).