Home

About WFA
  What’s New at WFA
  The Forward Award Process
  Baldrige/WFA Criteria for Performance Excellence
  WFA Calendar
  Annual Excellence at Work Conference
  Friends of Forward
  Links
  Job Opportunities in Quality
  Benchmarking Opportunities
  Program Committee
  Frequently Asked Questions
  Contact Us

Past Award Recipients

Board of Examiners
  Call for Examiners
  Application Materials
  Panel of Judges

Learning Opportunities & Services
  Resources & Materials
  Wisconsin Fast Forward
  Baldrige Express
  Consultant Clearinghouse

 

Examiner Information

Board of Examiners

The Wisconsin Forward Award evaluation process is carried out by our Board of Examiners.  Board members are volunteer experts from business, government, education and other disciplines across Wisconsin who are experienced in performance management and quality assessment processes. 

Examiners work in teams assigned to each application and conduct all phases of the evaluation. There are Team Leaders (Examiners with advanced understanding of the WFA/Baldrige Criteria, well-developed project management and team skills, who have the responsibility for leading the Examiner team and producing the feedback report) and Examiner team members (with beginning to advanced understanding of the Criteria and their application). Each team also has one or two Team Leader back-ups with well-developed Criteria and/or team process skills.

The Panel of Judges serves as a technical resource to the Examiner teams throughout the evaluation process and ensure calibration in scoring and application of the Criteria across Examiner teams. 

To see key dates for the 2008 Board of Examiners, click here.

For some information on the 2009 Board of Examiners, read our Call for Examiners.


EXAMINER TOOLBOX

Quick Guide of Currently Available Materials

If you need material or tools that you don't find on this list, let us know, and we will make it available to you or let you know when it will be posted here. Additional documents and resources will be added to this list as they become available.

Baldrige Criteria for Performance Excellence (2007)
Case Studies
Common Quality Indicators for Health Care Organizations
Consensus Review Flowchart
Consensus Workbook (2008)
Disclosure of Conflict of Interest (2008)
Examiner Biography Form (2008)
Expected Results Matrix (2008)
Expense Guidelines and Volunteer Reimbursement Form (2008)
Feedback report template (2008)
Guidance for Effective Comment Writing
How to Use the WFA Depot
Independent Evaluation Worksheets (2008)
Key Themes Worksheet (2008)
The Poindexter-Burns Inventory
Red/Yellow/Green Consensus Tool
Results Terminology Calibration (Few-Some-Many-Most)
Scoring Bands and Recognition Levels (2007)
Scoring Calibration Guides by Dr. Mark Blazey (2007)
Scoring Matrix, a.k.a. the Bessemer Matrix (2008)
Selected Slides from Examiner Training (2008)
Site Visit Agenda (Sample)
Site Visit Manual for Examiner Teams (2008)
Site Visit Scorebook (2008)
Site Visit Strategy Worksheets (2008)

Tools for Independent Evaluations

2008 Independent Evaluation Worksheets
These worksheets are our new format for observations that you make during independent review, which will eventually serve as the raw materials for your team's comments at consensus. Let us and/or your Team Leader know if you have any questions about how to use them.

Expected Results Matrix
Examiners can use this document out of the box or adapt it to their own tastes to track significant results to look for in Category 7 and elsewhere. The expected results matrix is not a WFA deliverable, but your Team Leader may require you to use it.

The Poindexter-Burns Inventory
An optional tool to help track the correspondence between Criteria Items and core values, key factors, key themes, and expected results.


Consensus Related Documents

Consensus Item Workbooks
Use this workbook to draft and revise your comments during comment development and working towards your consensus meeting. This workbook includes one comment worksheet and two scoring grids—one for process Items and the other for results (Category 7). Cut, copy, and paste to create the configuration of comment worksheets and corresponding scoring grids that you need.

Key Themes Worksheet
This worksheet captures broader feedback from the Examiner team which becomes the Executive Summary in the final feedback report. Key themes address a central requirement of the Criteria, are common to more than one Category (cross-cutting), are especially significant in light of the applicant organization's key factors, and/or address a Core Value of the Criteria.

Guidance for Effective Comment Writing
This document includes comment guidelines, descriptions of A/D/L/I and Le/T/C/Li, and examples of improving written comments for process and results Items.

Consensus Process Flowchart
A flowchart showing all the steps Examiners will take between the end of independent review and the end of the consensus process.

The Bessemer Matrix
A spreadsheet that tracks an Examiner team's score from independent evaluation to final review by the Panel of Judges. Each Team Leader should complete upload this spreadsheet to the WFA Depot after consensus review and site visit review.

Red/Yellow/Green Consensus System
This handout is designed to be folded and secured as a three-sided sign. During discussion on above-the-line/below-the-line comments or scoring, each Examiner displays the side representing his or her level of agreement with the Category Leader's current proposed comments or score. Team members who disagree with the current team consensus have specific responsibilities to suggest alternative solutions.

Site Visit Documents and Tools

Site Visit Manual for Examiner Teams
A manual with information and tips for preparing for and conducting a site visit as a Team Leader or a member of an Examiner site visit team. Another guide is available to help applicant organizations prepare for 2008 site visits.

Sample Site Visit Agenda
This sample agenda is also part of the Site Visit Manual.

Site Visit Strategy Worksheets
In a change in process for 2008, site visit teams will not complete site visit issue (SVI) worksheets, but rather will plan their approach to addressing SVIs through site visit strategy worksheets for both process and results Items.

Site Visit Scorebooks
This document, including worksheets for key factors, key themes, the highest ranking official interview, process Items, and results Items, is the deliverable product after the site visit..

Site Visit Interview Tips
An supplementary guide with general and specific suggestions to conducting successful formal and walkaround site visit interviews. This document is heavily indebted to feedback provided by a Baldrige Judge and is also included as part of the site visit guides for Team Leaders and Examiners.


Miscellaneous Documents and Tools

Baldrige Criteria for Performance Excellence
The 2007 Criteria can be downloaded for Business, Education, or Health Care.

Scoring Calibration Guides
These scoring calibration guides were designed by Dr. Mark Blazey for the Business/Nonprofit, Education, and Health Care Criteria.

Results Terminology Calibration
(Few-Some-Many-Most)

You can download visual references to the standard definitions of few (5% to 15%), some (16% to 30%), many (31% to 50%), most (51% to 80%), and nearly all (80% to less than 100%) for purposes of results Item scoring in PowerPoint (.ppt) or Word (.doc) format.

Selected Slides from Examiner Training
From Mark Blazey's Examiner training slides, you can download his Criteria models in color, summaries of the Criteria Items, color-coded strength and OFI comments, or all three in one file (.ppt)

How to Use the WFA Depot
Documentation (written on January 24, 2008) detailing how you can use the WFA Depot to share and provide feedback on documents related to your team's feedback. This document is being continuously improved based on your feedback and questions, so please let us know if you don't find what you need.

Examiner Biography Form
This form tells your Team Leader about your experience related to the skills you’ll be employing as a WFA Examiner, and it will be shared with your other team members during the comment development and virtual consensus phase of review. A sample biography is also provided.

Disclosure of Conflict of Interest
All Examiners are required to return a disclosure of organizational relationships to the WFA office in order to ensure no conflict of interest (or the appearance thereof) on Examiner teams. You can download the disclosure form here.

Expense-Related Documents
Reimbursement guidelines and a reimbursement form for expenses incurred during the review process. Please be sure to read the guidelines and ask for clarification if necessary before incurring expenses to make sure WFA is able to cover them.

WFA Scoring Bands and Relationship to Recognition Levels
An overall description of each scoring band, the corresponding point ranges, and the correspondence to the WFA recognition levels of Commitment (band 1), Proficiency (bands 2 and 3), Mastery (bands 4 and 5), and Excellence (bands 6, 7, and 8).

Feedback Report Template
This document serves as a template for Examiner teams' final feedback.

Peer and Team Review Forms
Updated forms and instructions for 2008 will be posted by March 10.

Common Quality Indicators for Healthcare Organizations
Teams reviewing health care organizations can expect specific results to be reported. Agencies such as the Institute of Medicine (IOM), the Institute for Healthcare Improvement (IHI), and the Centers for Medicare & Medicaid Services (CMS) have derived lists of critical quality measures that are fairly standard in the industry. IHI's 100,000 Lives Program has been adopted by over 3100 hospitals nationwide and features significant alignment with core measures of other improvement organizations. A list of measures and other aligned items of the 100,000 Lives campaign is available here.

IHI's latest initiative is called the 5 Million Lives Campaign, which runs from December 2006 to December 2008. The initiative includes a total of twelve initiatives, six of which have just been introduced in new campaign. Because of the timing of the WFA application cycle, the new initiatives are unlikely to be reflected in hospital applications until our 2008 cycle.

The Joint Commission on Accreditation of Healthcare Organizations (JCAHO) is an independent not-for-profit organization that evaluates and accredits nearly 15,000 health care organizations and programs throughout the country. JCAHO accreditation is critical for a variety of reasons, including compliance with Medicare and Medicaid regulations. The organization publishes a yearly list of national patient safety goals for hospitals that can be found here, and there's a good chance that hospitals will use these measures in their benchmarking processes. Regulatory requirements for all hospitals participating in either JCAHO or Medicare can be found here.


WFA's Board of Examiners comes from a variety of organizations, large and small, from every sector of Wisconsin's economy. We thank the following organizations for their support of the 2008 Board of Examiners:

Agnesian HealthCare, Inc.
American Society for Quality
ArtWorks for Milwaukee, Inc.
Bay Area Medical Center
Buchel & Associates – Strategies Unlimited
Cardinal Glass Industries
Care Wisconsin
Children's Hospital of Wisconsin
Columbus Community Hospital
Community Credit Union
Community Memorial Hospital
CSM Consulting Solutions, Inc.
CUNA Mutual Group
DemoSoph Enterprises
Des Moines University
Eaton Corporation
Edstrom Industries
Elmbrook School District
Evergreen Retirement Community
Franciscan Skemp Healthcare
Group Health Cooperative
Gundersen Lutheran Medical Center
Interstate Blood Bank
Kohl's Department Stores
Madison Area Technical College
Madison Metropolitan Sewerage District
MAQIN
Meriter Health Services, Inc.

Mile Bluff Medical Center
Milwaukee County Emergency Medical Services
Minnesota Council for Quality
Mount Mary College
Muskego-Norway School District
Northwestern Mutual Life Insurance Company
Physicians Plus Insurance Corporation
Promega Corporation
Quality Alliance Business Consultants, LLC
Quality Education Associates (QEA)
Richland Center Foundry Company
Rockwell Automation
Runzheimer International
Sacred Heart Hospital
Saint Michael's Hospital
School District of Elmbrook
St. Clare Hospital & Health Services
St. Clare Meadows Care Center
StatOrg Services, LLC
U.S. Bank
Unilever North American Ice Cream
University of Wisconsin–Madison
Waukesha Memorial Hospital
Western Technical College
Wheaton Franciscan Healthcare - All Saints
Wheaton Franciscan Healthcare - St. Joseph
William S. Middleton Memorial Veterans Hospital
Wisconsin Department of Commerce


Past Case Studies

WFA uses the current Baldrige National Quality Program case study, published annually in late spring, as part of our Examiner preparation course. The case studies represent fictional, and typically high-performing, organizations.

2006 Case Study Materials:
2006 Health Care Criteria for Performance Excellence
• Arroyo Fresco Community Health Center Executive Summary
• Arroyo Fresco Community Health Center Application Materials
• Arroyo Fresco Community Health Center Model Scorebook
• Arroyo Fresco Community Health Center Model Feedback Report

The Arroyo Fresco Community Health Center case study has also been rewritten to reflect 2007 Criteria revisions.

2005 Case Study Materials:
2005 Criteria for Performance Excellence
• Landmark Dining, Inc. Executive Summary
• Landmark Dining, Inc. Application Materials
• Landmark Dining, Inc. Model Scorebook
• Landmark Dining Inc. Model Feedback Report
2005 Prework Assignment for New Examiners
2005 Prework Assignment for Returning Examiners

2004 Case Study Materials:
2004 Education Criteria for Performance Excellence
• Sandy Hill School District Executive Summary
• Sandy Hill School District Application Materials
• Sandy Hill School District Model Scorebook
• Sandy Hill School District Model Feedback Report

• 2004 Examiner Prework Assignment
      Sample Review Notes – Item 3

2003 Case Study Materials:
2003 Criteria for Performance Excellence
• GeoOrb Polymers, North America Executive Summary
• GeoOrb Polymers, North America Application Materials
• GeoOrb Polymers, North America Model Scorebook
• GeoOrb Polymers, North America Model Feedback Report

2002 Case Study Materials:
2002 Health Care Criteria for Performance Excellence
• CapStar Health System Executive Summary
• CapStar Health System Application Materials
• CapStar Health System Model Scorebook
• CapStar Health System Model Feedback Report

2001 Case Study Materials:
2001 Criteria for Performance Excellence
• TriView National Bank Executive Summary
• TriView National Bank Application Materials
• TriView National Bank Model Scorebook
• TriView National Bank Model Feedback Report

© 2005 Wisconsin Forward Award. Site by Tingalls Dzyn, LLC. Comments / errors: webmaster