APASP Scoring Rubrics

ADMINISTRATIVE SERVICES

The purpose of the scoring rubric is to assure a high level of inter-rater reliability. Task Force members will rate units on the following criteria using a 9-point scale, where higher numbers signify better performance. The Task Force will consider the stage of development of new programs (those with three or fewer years of centralized data) when evaluating their performance.

CRITERION 1,2,3: MINIMAL/LIMITED 4,5,6: MODERATE 7,8,9: EXCEPTIONAL/SIGNIFICANT

Importance to UM

20%

The unit does not provide a service that is essential to UM.

The unit provides important but non-essential services that enhance UM's mission, vision, and values.

The unit provides essential services that contribute to UM's mission, vision, and values.

External/Internal Demand

25%

Internal AND external demand for the unit's services has greatly diminished over time, and there is little or no collaboration with other units.

Internal OR external demand are stable, or if decreasing there is effort to increase collaboration with other units.

There is strong and growing internal AND external demand for unit services and active efforts to increase collaboration with other units.

Quality

25%

Internal assessments indicate services do not meet users' needs and are below published benchmarks. Personnel development and university engagement lacking.

Services meet users' needs and published benchmarks. Personnel development and engagement with university meet expectations.

Services exceed user's expectations and published benchmarks. High level of personnel development and university engagement.

Efficiency

15%

There is a multi-year pattern of expenses exceeding total revenue/allocation with minimal effort to improve efficiency within the unit.

Expenses equal revenue/ allocation for more than one year and there has been some effort at improving efficiency.

Revenue/allocation has exceeded expenses over the full time period evaluated and there is ongoing effort to improve efficiency in the unit.

Opportunity Analysis

15%

There is limited potential for growth, collaboration, or restructuring of the unit. The unit's services do not contribute to the UM Strategic Vision.

There is some potential for expansion of services with implementation of best practices or if proposed restructuring, re-alignment, or redesign are done. The unit contributes to the UM Strategic Vision.

There is strong potential for expansion of services. Best practices are implemented and active consideration of restructuring and realignment presents new opportunities to expand services. The unit strongly contributes to the UM Strategic Vision.

ACADEMIC PROGRAMS

The purpose of the scoring rubric is to assure a high level of inter-rater reliability.  Task Force members will rate programs on the following criteria using a 9-point scale, where higher numbers signify better performance. The Task Force will consider the stage of development of new programs (those with three or fewer years of centralized data) when evaluating their performance.

CRITERION

1,2,3: Minimal/Limited

4,5,6: Moderate

7,8,9: Exceptional/Significant

 

Alignment

20%

 

 

The program is not well-aligned with UM’s mission, vision, or values, and provides minimal contribution to important social, economic, or cultural objectives.

 

 

The program is aligned with some aspects of UM’s mission, vision, and values, and contributes to some social, economic, or cultural objectives.

 

The program is exemplary of UM’s mission, vision, and values, and provides significant contributions to social, economic, or cultural objectives.

 

Internal

Demand

15%

 

 

The program has minimal interdependence or collaboration with other programs at UM. Reductions in size or scope would have limited impact on the University.

 

The program engages in some collaborations and interdisciplinary activities that enhance student and faculty performance. Program reductions would have an impact on other programs.

 

The program has a high level of collaborative and interdisciplinary activity. Reductions would significantly impact other programs.

 

Productivity

20%

 

 

The program demonstrates limited productivity relative to its mission and resource constraints.

 

 

The program meets its mission and demonstrates adequate productivity relative to its resource constraints.

 

The program excels in its mission. It is unusually productive in multiple areas of its mission relative to current resources.

 

Quality

20%

 

 

The program has limited evidence of quality in student and faculty outcomes.

 

The program’s faculty and students are performing at an adequate level of quality.

 

The program demonstrates exceptional quality, with strong student outcomes and evidence of excellence and external recognition across the faculty.

 

 

 

 

Efficiency

10%

 

 

The program is a draw on University resources and demonstrates little effort to improve efficiency. The expense of the program is difficult to justify.

 

The program demonstrates alignment of  expenses and productivity. The program has undertaken efforts to improve efficiency and/or generate revenue. The expense of the program is justifiable.

 

The program is highly efficient in its use of University resources and shows substantial efforts to increase efficiency and/or generate revenue. The expense of the program is more than justified.

 

 

Opportunity Analysis

15%

 

The program offers minimal opportunities that would enhance UM.

 

The program offers some opportunities to enhance UM.

 

The program offers significant, innovative opportunities to enhance UM.