The ABCs of Evaluation E-Book

John Boulmetis

• Herausgeber: John Wiley & Sons
• Kategorie: Fachliteratur
• Serie: Research Methods for the Social Sciences
• Sprache: Englisch

Seitenzahl: 362

Veröffentlichungsjahr: 2014

Beschreibung

The ABCs of Evaluation: Timeless Techniques for Program and Project Managers, 3rd Edition

Thoroughly revised and updated, this third edition of the bestselling book offers an introduction to program evaluation including information on stakeholder relationships, program design, data collection and analysis, reporting results, and other important steps. This edition expands coverage of evaluation models and logic models. Written for any program type or setting, The ABCs of Evaluation shows how to select participants for the evaluation and how to deal with multiple goals and objectives—including those of the organization, the staff, and the client. All references and pedagogical features including learning objectives, key terms, and questions for discussion have been updated.

Leseprobe

CONTENTS

Cover

Title Page

Copyright

Preface

Demonstrating Success

Overview

Using This Book

The Authors

Chapter 1: What is Evalution?

Common Denominators

Two Definitions of Evaluation

Evaluating Efficiency, Effectiveness, and Impact

Evaluating Alternatives

Identifying Areas to Improve

Other Levels

Formal Reasons to Evaluate

Practical Application

Formative and Summative Evaluations

Putting It All Together

Key Words and Concepts

Questions and Exercises

Further Reading

Chapter 2: Why Evaluate?

Grants and Grantsmanship

Benefits

Limitations

Considerations

Putting It All Together

Key Words and Concepts

Questions and Exercise

Further Reading

Chapter 3: Decision Making: Whom to Involve, How, and Why?

Program and Project Cycles

Evaluation and Monitoring

Program Planning Cycle and Evaluation

Putting It All Together

Key Words and Concepts

Questions and Exercises

Further Reading

Chapter 4: Starting Point: The Evaluator's Program Description

What an Evaluator's Program Description Can Do

Developing an Evaluator's Program Description

Putting It All Together

Key Words and Concepts

Questions and Exercises

Further Reading

Chapter 5: Choosing an Evaluation Model

More Than One Way to Evaluate

Four Evaluation Models

Other Models

Choosing the Right Model

Evaluation Design Format

Other Considerations

Putting It All Together

Key Words and Concepts

Questions and Exercise

Further Reading

Chapter 6: Data Sources

Starting Point

Qualitative and Quantitative Data Sources

Four Levels of Data

Nature of Data Collection

Existing Data

Newly Collected Data

Putting It All Together

Key Words and Concepts

Questions and Exercise

Further Reading

Chapter 7: Data Analysis

Data Analysis

Data

Terms

Levels of Data

Putting It All Together

Key Words and Concepts

Questions and Exercise

Further Reading

Software for Personal Computers

Chapter 8: Is It Evaluation or Is It Research?

Determining Evaluation or Research from Intent

Determining Evaluation or Research from Design

Qualitative and Quantitative Characteristics

Sampling

Sampling and Surveys

Putting It All Together

Key Words and Concepts

Questions and Exercise

Further Reading

Chapter 9: Writing the Evaluation Report

Communicating Your Findings

Evaluation Reports

The Report Outline

Putting It All Together

Key Words and Concepts

Questions and Exercise

Further Reading

Chapter 10: Evaluation as a Business

Is There a Market for Program Evaluation?

How Do You Find the Business?

Proactive Resources

Reactive Resources

Emergency Resources

How Do You Negotiate a Contract?

Keeping the Business Alive

Putting It All Together

Key Words and Concepts

Further Reading

A: More On Data Analysis

Analyses for Each Level

Significance Testing

Statistical and Practical Significance

B: Sample Evaluation Report

C: Sample Evaluation Contract

Evaluation of the XYZ Training Project

References

Index

End User License Agreement

List of Tables

Table 1.1

Table 3.1

Table 4.1

Table 5.1

Table 7.1

Table 7.2

Table 7.3

Table 7.4

Table 9.1

Table 1

Table 2

Table 3

List of Illustrations

Exhibit 1.1

Exhibit 1.2

Exhibit 2.1

Figure 3.1

Figure 4.1

Exhibit 4.1

Exhibit 4.2

Exhibit 4.3

Exhibit 4.4

Exhibit 4.5

Figure 6.1

Figure 6.2

Figure A.1

Figure A.2

Figure A.3

Figure A.4

Guide

Cover

Table of Contents

Begin Reading

Chapter 1

Pages

i

ii

vii

viii

ix

x

xi

xii

xiii

xiv

xv

xvi

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

The ABCs of Evaluation

Timeless Techniques for Program and Project Managers

Third Edition

John Boulmetis

Phyllis Dutwin

Copyright © 2011 by John Wiley & Sons, Inc. All rights reserved.

Published by Jossey-Bass

A Wiley Imprint

989 Market Street, San Francisco, CA 94103-1741—www.josseybass.com

No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400, fax [phone], or on the Web at www.copyright.com. Requests to the publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, 201-748-6011, fax [phone], or online at www.wiley.com/go/permissions.

Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives or written sales materials. The advice and strategies contained herein may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages. Readers should be aware that Internet Web sites offered as citations and/or sources for further information may have changed or disappeared between the time this was written and when it is read.

Jossey-Bass books and products are available through most bookstores. To contact Jossey-Bass directly call our Customer Care Department within the U.S. at 800-956-7739, outside the U.S. at 317-572-3986, or fax [phone].

Wiley also publishes its books in a variety of electronic formats and by print-on-demand. Not all content that is available in standard print versions of this book may appear or be packaged in all book formats. If you have purchased a version of this book that did not include media that is referenced by or accompanies a standard print version, you may request this media by visiting http://booksupport.wiley.com. For more information about Wiley products, visit us at www.wiley.com.

Library of Congress Cataloging-in-Publication Data

Boulmetis, John.

The ABCs of evaluation : timeless techniques for program and project managers / John Boulmetis, Phyllis Dutwin.—3rd ed.

p. cm.—(Research methods for the social sciences ; 46)

Includes bibliographical references and index.

ISBN 978-0-470-87354-0 (pbk.); 978-1-118-10364-7 (ebk.); 978-1-118-10365-4 (ebk.); 978-1-118-10366-1 (ebk.)

1. Management—Evaluation. I. Dutwin, Phyllis. II. Title.

HD31.B633 2011

658.4′032—dc23

2011021314

Preface

Evaluation is a task that every program and project manager will face at one time or another: you may manage the funding process for an organization, or direct a self-study that requires evaluation, or write a grant proposal that includes an evaluation segment. Occasions vary, but they are inevitable.

Still, endorsing evaluation is a lot like endorsing regular visits to the dentist. People are quick to endorse both activities, but when it comes to doing either one, most people are very uncomfortable. will reduce your discomfort by doing two things: First, the book will demystify the process of designing and conducting an evaluation by helping you understand the components of an evaluation design. Second, and more important, the book's aim is to convince you that you play an integral part in any evaluation process, and therefore you are a beneficiary of the results.