Performance Management and Evaluation E-Book

• Herausgeber: John Wiley & Sons
• Kategorie: Bildung
• Serie: J-B PE Single Issue (Program) Evaluation
• Sprache: Englisch

Seitenzahl: 224

Veröffentlichungsjahr: 2013

Beschreibung

This issue focuses on connections between performance management and evaluation, a contentious topic at the moment. It does so by placing evaluation and monitoring under the overarching concept of performance management, and then by investigating five complementarities between performance monitoring and measurement on the one hand, and evaluation on the other. These complementarities are: * Sequential * Informational * Organizational * Methodical * Hierarchical. Several case studies discuss the uses and complementarities of evaluation and performance management in contexts including national and local governments and the work of government, philanthropic foundations, and a direct-service nonprofit agency. These cases illustrate the advantages and pitfalls in utilizing evaluative approaches within the context of performance management. This is the 137th volume of the Jossey-Bass quarterly report series New Directions for Evaluation, an official publication of the American Evaluation Association.

Leseprobe

Contents

Statement of the Editor-in-Chief

Editors’ Notes

Chapter 1: Performance Management and Evaluation: Exploring Complementarities

Addressing Two Critiques of Performance Management as a Means of Knowledge Production

What Is Performance Management?

Chapter 2: Sorting the Relationships Among Performance Measurement, Program Evaluation, and Performance Management

An Abbreviated History of Program Evaluation and Performance Measurement in the United States

The Relationship Between Program Evaluation and Performance Measurement

Advantages and Disadvantages of Each Process

Complementary Elements Between Program Evaluation and Performance Measurement

Desirable Improvements

Some Reflections on the Interrelationship Between Performance Management, Measurement, and Program Evaluation

Chapter 3: Transforming Silo-Steering Into a Performance Governance System: The Case of the Finnish Central Government

Emergence and Structure of the Finnish Performance-Management System

Toward Evidence-Based Performance Governance

Conclusion

Chapter 4: Rethinking the Relationship Among Monitoring, Evaluation, and Results-Based Management: Observations From Canada

Evolution of Monitoring and Evaluation in Canada

Organization and Institutional Arrangements for M&E in the Canadian System

Roles and Responsibilities of the Key Actors

Organization of M&E in Government Departments

The National Audit Office in the M&E System

Finding the Right Balance Between the Learning and Accountability

Complementarity Between Monitoring and Evaluation—Moving From Theory to Reality

How Has E Supported M?

How Does M Support E?

Rethinking the Relationship Among M, E, and RBM

Limits to Complementarity?

Chapter 5: Performance Management and Evaluation in the Danish Public Employment Service

The Danish Public Employment System

The Governance of the Public Employment System

Access to Data: Building a Common Data Platform and Monitoring System

Dialogue With Stakeholders Based on Data

The Use of Evaluations to Create Evidence

Achieving Complementarities—Challenges and Solutions

Sequential Complementarity

Organizational Complementarity

Methodical Complementarity

Hierarchical Complementarity

Conclusion: Lessons for Complementarity?

Chapter 6: The Emergence of Performance Measurement as a Complement to Evaluation Among U.S. Foundations

Performance Measurement Gains Ground

Promising Approaches and Limitations

Concluding Themes

Chapter 7: Citizen-Driven Performance Measurement: Opportunities for Evaluator Collaboration in Support of the New Governance

Citizen-Driven Performance Measurement

Evaluator Contributions to Performance Measurement

Final Reflections

Chapter 8: Performance Management and Evaluation in Norwegian Local Government: Complementary or Competing Tools of Management?

Complementarities and Alternatives to Evaluation

Performance Management and Evaluation in Norwegian Local Government

Some Final Reflections on Competition and Complementarity

Chapter 9: Managing for Results in the U.S. Not-for-Profit Sector: Applying Complementary Approaches of Knowledge Production at the Center for Employment Opportunities

In an Era of Scarcity

About the Center of Employment Opportunities

Converging Evaluation and Monitoring When Managing for Results

Chapter 10: Challenges to and Forms of Complementarity Between Performance Management and Evaluation

Contexts for Performance Management

Challenges to Performance Management

Types of Complementarity

Evaluators at a Crossroads

Index

Performance Management and Evaluation

Steffen Bohni Nielsen, David E. K. Hunter (eds.)

New Directions for Evaluation, no. 137

Paul R. Brandon, Editor-in-Chief

Copyright ©2013 Wiley Periodicals, Inc., A Wiley Company, and the American Evaluation Association. All rights reserved. No part of this publication may be reproduced in any form or by any means, except as permitted under sections 107 and 108 of the 1976 United States Copyright Act, without either the prior written permission of the publisher or authorization through the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923; [phone]; fax [phone]. The copyright notice appearing at the bottom of the first page of a chapter in this journal indicates the copyright holder’s consent that copies may be made for personal or internal use, or for personal or internal use of specific clients, on the condition that the copier pay for copying beyond that permitted by law. This consent does not extend to other kinds of copying, such as copying for general distribution, for advertising or promotional purposes, for creating collective works, or for resale. Such permission requests and other permission inquiries should be addressed to the Permissions Department, c/o John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030; [phone], fax [phone], www.wiley.com/go/permissions.

Microfilm copies of issues and articles are available in 16mm and 35mm, as well as microfiche in 105mm, through University Microfilms Inc., 300 North Zeeb Road, Ann Arbor, MI 48106-1346.

New Directions for Evaluation is indexed in Education Research Complete (EBSCO Publishing), ERIC: Education Resources Information Center (CSC), Higher Education Abstracts (Claremont Graduate University), SCOPUS (Elsevier), Social Services Abstracts (ProQuest), Sociological Abstracts (ProQuest), and Worldwide Political Science Abstracts (ProQuest).

New Directions for Evaluation (ISSN 1097-6736, electronic ISSN 1534-875X) is part of The Jossey-Bass Education Series and is published quarterly by Wiley Subscription Services, Inc., A Wiley Company, at Jossey-Bass, One Montgomery Street, Suite 1200, San Francisco, CA 94104-4594.

Subscriptions for individuals cost $89 for U.S./Canada/Mexico; $113 international. For institutions, $313 U.S.; $353 Canada/Mexico; $387 international. Electronic only: $89 for individuals all regions; $313 for institutions all regions. Print and electronic: $98 for individuals in the U.S., Canada, and Mexico; $122 for individuals for the rest of the world; $363 for institutions in the U.S.; $403 for institutions in Canada and Mexico; $437 for institutions for the rest of the world.

Editorial correspondence should be addressed to the Editor-in-Chief, Paul R. Brandon, University of Hawai‘i at Mānoa, 1776 University Avenue, Castle Memorial Hall Rm 118, Honolulu, HI 96822-2463.

www.josseybass.com

New Directions for Evaluation

Sponsored by the American Evaluation Association

Editor-in-Chief

Paul R. Brandon

University of Hawai‘i at Mānoa

Editorial Advisory Board

Anna Ah Sam

University of Hawai‘i at Mānoa

Michael Bamberger

Independent consultant

Gail Barrington

Barrington Research Group, Inc.

Fred Carden

International Development Research Centre

Thomas Chapel

Centers for Disease Control and Prevention

Leslie Cooksy

Sierra Health Foundation

Fiona Cram

Katoa Ltd.

Peter Dahler-Larsen

University of Southern Denmark

E. Jane Davidson

Real Evaluation Ltd.

Stewart Donaldson

Claremont Graduate University

Jody Fitzpatrick

University of Colorado Denver

Jennifer Greene

University of Illinois at Urbana-Champaign

Melvin Hall

Northern Arizona University

Gary Henry

Vanderbilt University

Rodney Hopson

Duquesne University

George Julnes

University of Baltimore

Jean King

University of Minnesota

Saville Kushner

University of Auckland

Robert Lahey

REL Solutions Inc.

Miri Levin-Rozalis

Ben Gurion University of the Negev and Davidson Institute at the Weizmann Institute of Science

Laura Leviton

Robert Wood Johnson Foundation

Melvin Mark

Pennsylvania State University

Sandra Mathison

University of British Columbia

Robin Lin Miller

Michigan State University

Michael Morris

University of New Haven

Debra Rog

Westat and the Rockville Institute

Patricia Rogers

Royal Melbourne Institute of Technology

Mary Ann Scheirer

Scheirer Consulting

Robert Schwarz

University of Toronto

Lyn Shulha

Queen’s University

Nick L. Smith

Syracuse University

Sanjeev Sridharan

University of Toronto

Monica Stitt-Bergh

University of Hawai‘i at Mānoa

Editorial Policy and Procedures

New Directions for Evaluation, a quarterly sourcebook, is an official publication of the American Evaluation Association. The journal publishes works on all aspects of evaluation, with an emphasis on presenting timely and thoughtful reflections on leading-edge issues of evaluation theory, practice, methods, the profession, and the organizational, cultural, and societal context within which evaluation occurs. Each issue of the journal is devoted to a single topic, with contributions solicited, organized, reviewed, and edited by one or more guest editors.

The editor-in-chief is seeking proposals for journal issues from around the globe about topics new to the journal (although topics discussed in the past can be revisited). A diversity of perspectives and creative bridges between evaluation and other disciplines, as well as chapters reporting original empirical research on evaluation, are encouraged. A wide range of topics and substantive domains is appropriate for publication, including evaluative endeavors other than program evaluation; however, the proposed topic must be of interest to a broad evaluation audience. For examples of the types of topics that have been successfully proposed, go to http://www.josseybass.com/WileyCDA/Section/id-155510.html.

Journal issues may take any of several forms. Typically they are presented as a series of related chapters, but they might also be presented as a debate; an account, with critique and commentary, of an exemplary evaluation; a feature-length article followed by brief critical commentaries; or perhaps another form proposed by guest editors.

Submitted proposals must follow the format found via the Association’s website at http://www.eval.org/Publications/NDE.asp. Proposals are sent to members of the journal’s Editorial Advisory Board and to relevant substantive experts for single-blind peer review. The process may result in acceptance, a recommendation to revise and resubmit, or rejection. The journal does not consider or publish unsolicited single manuscripts.

Before submitting proposals, all parties are asked to contact the editor-in-chief, who is committed to working constructively with potential guest editors to help them develop acceptable proposals. For additional information about the journal, see the “Statement of the Editor-in-Chief” in the Spring 2013 issue (No. 137).

Paul R. Brandon, Editor-in-Chief

University of Hawai‘i at Mānoa

College of Education

1776 University Avenue

Castle Memorial Hall, Rm. 118

Honolulu, HI 96822–2463

e-mail: [email protected]

Statement of the Editor-in-Chief

With this issue, Sandra Mathison’s long and able tenure as New Directions for Evaluation (NDE) Editor-in-Chief (EIC) ends and my tenure begins. I am honored to have been selected to fill the EIC role and humbled to follow 11 distinguished predecessors. The EIC role changed hands after a year of transition in which I shadowed Sandra electronically, oversaw the journal’s adoption of the ScholarOne electronic submission system for both proposals and final manuscripts, and gradually took responsibility for proposal and manuscript review and submission. Lois-ellin Datta and Brad Cousins have agreed to serve as associate editors (in largely consultative roles), and 33 esteemed colleagues from several countries have agreed to serve as Editorial Advisory Board members.

I have four aspirations for my period as EIC. First, I will seek to encourage evaluation practitioners, methodologists, and theorists from around the globe to consider submitting proposals. Evaluation is a global enterprise, as manifested by the substantial number of professional organizations that have been born in recent years; as a publication of the American Evaluation Association, NDE has an obligation to encourage the wide participation of our colleagues around the world to contribute to the discussion of new trends in evaluation. Second, the journal is actively recruiting issues on topics that have not been covered recently or at all. NDE’s focus is program evaluation, but topics about broader conceptualizations of evaluation will be considered, as well. Furthermore, the journal is about topics useful for evaluation, not simply topics occurring in evaluation. Third, it is hoped that more issues will report original empirical research on evaluation. Empirical research has been growing in recent years in our sister journal the American Journal of Evaluation, among other respected evaluation publications; more of it should be seen within the pages of NDE. When feasible and appropriate, guest editors will be asked to work with their chapter authors to ensure that they describe the methods for gathering, analyzing, and reporting the information that is presented. For chapters in which original findings are reported, this will mean including traditional accounts of data collection, analysis, and summarization; for essay-like chapters or reflective narratives, this will mean including at least some information about how the authors’ accounts were prepared and presented. Proposals with empirical evidence beyond personal reflection are preferred, within reason and taking into consideration what evidence feasibly can be provided. Finally, guest editors are encouraged to keep the first word in the journal’s title in mind. NDE is a source for presenting timely discussions of leading-edge issues. The journal has served well its purposes as a compendium of evaluation sourcebooks and a venue for consolidating the results of scholarship about new or emerging evaluation topics. The profession and discipline of program evaluation might be past the heyday of the development of major new approaches to evaluation, but many variations, innovations, and responses to technology and context make for opportunities to contribute to the knowledge base.

I look forward to working with guest editors in continuing to inform our colleagues around the globe about timely topics of evaluation theory, methods, practice, and the evaluation profession and discipline. I am available at all times to discuss possible issue topics and the steps in proposal review and manuscript preparation. The details of the process of submitting full proposals are available at http://www.eval.org/Publications/NDE.asp.

Paul R. Brandon, PhD

Professor of Education

Curriculum Research & Development Group

College of Education

University of Hawai‘i at Mānoa

Honolulu