Designing and Conducting Survey Research E-Book

Louis M. Rea

• Herausgeber: John Wiley & Sons
• Kategorie: Fachliteratur
• Sprache: Englisch

Seitenzahl: 497

Veröffentlichungsjahr: 2014

Beschreibung

The industry standard guide, updated with new ideas and SPSS analysis techniques Designing and Conducting Survey Research: A Comprehensive Guide Fourth Edition is the industry standard resource that covers all major components of the survey process, updated to include new data analysis techniques and SPSS procedures with sample data sets online. The book offers practical, actionable guidance on constructing the instrument, administrating the process, and analyzing and reporting the results, providing extensive examples and worksheets that demonstrate the appropriate use of survey and data techniques. By clarifying complex statistical concepts and modern analysis methods, this guide enables readers to conduct a survey research project from initial focus concept to the final report. Public and nonprofit managers with survey research responsibilities need to stay up-to-date on the latest methods, techniques, and best practices for optimal data collection, analysis, and reporting. Designing and Conducting Survey Research is a complete resource, answering the "what", "why", and "how" every step of the way, and providing the latest information about technological advancements in data analysis. The updated fourth edition contains step-by-step SPSS data entry and analysis procedures, as well as SPSS examples throughout the text, using real data sets from real-world studies. Other new information includes topics like: * Nonresponse error/bias * Ethical concerns and special populations * Cell phone samples in telephone surveys * Subsample screening and complex skip patterns The fourth edition also contains new information on the growing importance of focus groups, and places a special emphasis on data quality including size and variability. Those who employ survey research methods will find that Designing and Conducting Survey Research contains all the information needed to better design, conduct, and analyze a more effective survey.

Leseprobe

Contents

Figures, Tables, Exhibits, and Worksheets

Preface

The Authors

Part One: Developing and Administering Questionnaires

Chapter 1: An Overview of the Sample Survey Process

Gathering Information through Research

Advantages of Sample Survey Research

Types of Sample Survey Research

Stages of the Survey Research Process

Monitoring and Supervision of the Interview Process

Ethical Considerations in Survey Research

Conclusion

Chapter 2: Designing Effective Questionnaires: Basic Guidelines

Introducing the Study

Sequence of Questions

Question Format: Open-Ended or Closed-Ended

Questionnaire Length

Editing the Completed Questionnaire

Chapter 3: Developing Survey Questions

Guidelines for Phrasing Questions

Levels of Measurement

Formatting of Questions

Chapter 4: Using Focus Groups in the Survey Research Process

Uses of Focus Groups

Planning Focus Groups

Recruiting Focus Group Participants

Implementing the Focus Group Sessions

Part Two: Ensuring Scientific Accuracy

Chapter 5: Descriptive Statistics: Measures of Central Tendency and Dispersion

Measures of Central Tendency

Measures of Dispersion

The Normal Distribution

Selecting the Most Appropriate Measure of Central Tendency for Describing Survey Data

Scaled Frequency Distributions

Chapter 6: The Theoretical Basis of Sampling

Properties of the Normal Distribution

The Standardized Z Score

The Theoretical Basis of Sampling

Generalizing from a Single Sample

Chapter 7: Confidence Intervals and Basic Hypothesis Testing

Confidence Intervals

Confidence Intervals Expressed as Proportions

Hypothesis Testing

Chapter 8: Determining the Sample Size

Determinants of Sampling Accuracy

Determination of Sample Size for Variables Expressed in Terms of Proportions

Determination of Sample Size for Interval Scale Variables

Determination of Sample Size When Both Proportional and Interval Scale Variables Are Present

Chapter 9: Selecting and Obtaining a Representative Sample

Probability Sampling

Identification of the Sampling Frame

Establishing a Representative Working Population

Examples of Sampling Frames

Weighting Disproportionate Samples

Nonresponse Bias

Nonprobability Sampling

Part Three: Presenting and Analyzing Survey Results

Chapter 10: Analyzing Cross-Tabulated Data

Cross-Tabulated Contingency Tables

The Chi-Square Test of Significance

Cramér’s

V

and Phi (Φ)

Additional Chi-Square Considerations

Gamma (γ)

Testing the Statistical Significance of Gamma

Chapter 11: Testing the Difference between Means

Independent Samples

t

Test

Paired Samples

t

Test

Difference of Proportions Test

Analysis of Variance

Post Hoc Tests: A Multiple Comparison of Means

Spuriousness

Chapter 12: Regression and Correlation

Simple Linear Regression

Testing the Significance of the Regression Line

Calculation of Sum of Squares

Calculation of Variances and

F

Ratio

Coefficient of Determination (

r

2

)

Pearson’s r Correlation

Dummy Variables

Choosing among Tests of Significance and Measures of Association

Chapter 13: Preparing an Effective Final Report

Report Format

Specific Considerations for Formally Reporting Survey Results

Resource A: Table of Areas of a Standard Normal Distribution

Resource B: Glossary

Bibliography

Index

End User License Agreement

List of Illustrations

Figure 5.1. The Normal Curve

Figure 5.2. Distribution with Positive Skew

Figure 5.3. Distribution with Negative Skew

Figure 5.4. Histogram

Figure 6.1. Area under the Normal Curve

Figure 6.2. Proportionate Areas under the Normal Curve for Military Weights

Figure 6.3. Standardized Proportionate Areas under the Normal Curve: An Example

Figure 6.4. Distribution of Sample Means

Figure 6.5. Hypothetical Normal Distributions for Sample Means Compared to Raw Data

Figure 6.6. Properties of Normal Curves Applied to Hypothetical Distribution of Sample Mean Weights

Figure 7.1. Dual-Direction Research Question (Two-Tail Test at 95 Percent Confidence Level)

Figure 7.2. Single-Direction Research Question (One-Tail Test at 95 Percent Confidence Level)

Figure 8.1. Determining Sample Size

Figure 11.1. ANOVA Table for Public Works Employees

Figure 12.1. Rehabilitation Subsidy/Property Value Increase Analysis

Figure 12.2. Scatter Plot and Regression Line

Figure 12.3. Violent Crimes and Population

Figure 12.4. Prior Convictions and Sentence Length

Figure 12.5. ANOVA Table for Regression Line of Subsidy and Value Increases

Figure 13.1. Favor or Oppose Building Seawater Desalination Facilities

Figure 13.2. Rating of Police Response to Emergency and Nonemergency Calls

Figure 13.3. Mean Satisfaction Ratings for Various Features of Bus Service

Figure 13.4. Frequency of Sprinkler Adjustment by Households with an Automatically Controlled Sprinkler System

List of Tables

Table 2.1. Ways in Which City Government Can Serve Community Needs

Table 5.1. Political Leaning

Table 5.2. Rating of Local Library Facilities

Table 5.3. Number of Children per Household in Mt. Pilot, South Dakota

Table 5.4. Consultants’ Hourly Fees Paid by Cities in Pennsylvania

Table 5.5. Travel Time to Work in Jersey City, New Jersey

Table 5.6. Police Nonemergency Response Times

Table 5.7. Willingness to Spend for Street and Highway Beautification

Table 5.8. Impression of Effect on Montgomery City Government on Business

Table 6.1. Distribution of 100 Hypothetical Sample Mean Weights

Table 8.1. Minimum Sample Sizes for Variables Expressed as Proportions

Table 8.2. Minimum Sample Sizes for Selected Small Populations

Table 9.1. Proportionate Sample Representation for a Hypothetical Ethnic Distribution

Table 9.2. Population of Davis Planning Areas

Table 9.3. Outdoor Recreation Facilities Used Most Often by Davis Residents, by Planning Area

Table 10.1. Number of Years as a Customer of the Richmond Water District

Table 10.2. Number of Years as a Customer of the Richmond Water District, by Area of Residence

Table 10.3. Number of Years as a Customer of the Richmond Water District, by Area of Residence: Male Respondents

Table 10.4. Opinion Concerning Capital Punishment by Political Party

Table 10.5. Value of Physical Therapy, by Age of Respondent

Table 10.6. Political Orientation of Teachers in the Santa Rosa School District, by Gender

Table 10.7. Educational Level, by Socioeconomic Status

Table 10.8. Most Frequently Used Mode of Transportation to Work, by Subarea

Table 11.1. Promotional Examination Score, by Department Affiliation

Table 13.1. Statistically Significant Differences for Various Potential Uses of Recycled Water

Exhibit 2.1. Mail-Out Introduction

Exhibit 2.2. Telephone Introduction

Exhibit 2.3. In-Person Introduction

Exhibit 2.4. Series of Questions Demonstrating Sensitizing of Respondents

Exhibit 2.5. Filter or Screening Questions

Exhibit 2.6. Screening Used to Disqualify Respondents

Exhibit 4.1. Sample Focus Group Confirmation E-Mail

Exhibit 4.2. Structured Format for a Focus Group Discussion

Exhibit 5.1. Salaries of Employees of a Small, Private Business

Exhibit 7.1. Values of Calculated

Z

Scores to Determine Significance (according to Research Hypothesis Direction)

Exhibit 7.2. Critical Values of the

t

Distribution

Exhibit 9.1. Sample Sizes and Weights for the City of Davis Planning Areas

Exhibit 9.2. Sample Sizes and Weights for Stratified Sample for Table 9.1

Exhibit 10.1. Critical Values of the Chi-Square Distribution

Exhibit 10.2. Interpretation of Calculated Cramér’s

V

, Phi, and Lambda Measures of Association

Exhibit 10.3. Interpretation of Calculated Gamma

Exhibit 11.1. Table of

F

-Statistics,

P

= .05

Exhibit 11.2. Table of

F

-Statistics,

P

= .01

Exhibit 11.3. Studentized Range (

q

) Distribution

Exhibit 12.1. Choosing the Appropriate Statistical Test or Measure

Exhibit 13.1. Example of a Cover Page

Pages

ii

iii

iv

xi

xii

xiii

xiv

xv

xvi

xvii

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

160

161

162

163

164

165

166

167

168

169

170

171

172

173

174

175

176

177

178

179

180

181

182

183

184

185

186

187

188

189

190

191

192

193

194

195

196

197

198

199

200

201

202

203

204

205

206

207

208

209

210

211

212

213

214

215

216

217

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

241

242

243

244

245

246

247

248

249

250

251

252

253

254

255

256

257

258

259

260

261

262

263

264

265

266

267

268

269

270

271

272

273

274

275

276

277

278

279

280

281

282

283

284

285

286

287

288

289

290

291

292

293

294

295

296

297

298

299

300

301

302

303

304

305

306

307

308

309

310

311

312

313

314

315

316

317

318

319

320

321

322

323

324

325

326

327

328

329

330

331

332

Guide

Cover

Table of Contents

Begin Reading

Reprints of “IBM SPSS Statistics software (SPSS)” courtesy of International Business Machines Corporation, © International Business Machines Corporation. SPSS Inc. was acquired by IBM in October, 2009. IBM, the IBM logo, ibm.com, and SPSS are trademarks or registered trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at “IBM Copyright and trademark information” at www.ibm.com/legal/copytrades.html.

DESIGNING AND CONDUCTING SURVEY RESEARCH

A Comprehensive Guide

Fourth Edition

Louis M. Rea

Richard A. Parker

Cover design by C. Wallace

Cover Images: Fiber Optic Cables © iStock.com/kynny, Businesss Night Life © iStock.com/-aniaostudio-

Copyright © 2014 by John Wiley & Sons, Inc. All rights reserved.

Published by Jossey-Bass

A Wiley Brand

One Montgomery Street, Suite 1200, San Francisco, CA 94104-4594—www.josseybass.com

No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400, fax [phone], or on the Web at www.copyright.com. Requests to the publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, 201-748-6011, fax [phone], or online at www.wiley.com/go/permissions.

Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives or written sales materials. The advice and strategies contained herein may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages. Readers should be aware that Internet Web sites offered as citations and/or sources for further information may have changed or disappeared between the time this was written and when it is read.

Jossey-Bass books and products are available through most bookstores. To contact Jossey-Bass directly call our Customer Care Department within the U.S. at 800-956-7739, outside the U.S. at 317-572-3986, or fax [phone].

Wiley publishes in a variety of print and electronic formats and by print-on-demand. Some material included with standard print versions of this book may not be included in e-books or in print-on-demand. If this book refers to media such as a CD or DVD that is not included in the version you purchased, you may download this material at http://booksupport.wiley.com. For more information about Wiley products, visit www.wiley.com.

Library of Congress Cataloging-in-Publication Data

Library of Congress Cataloging-in-Publication Data has been applied for and is on file with the Library of Congress.

ISBN 978-1-118-76703-0 (pbk); ISBN 978-1-118-76702-3 (ebk); ISBN 978-1-118-76700-9 (ebk)

FIGURES, TABLES, EXHIBITS, AND WORKSHEETS

Figures

5.1

The Normal Curve

5.2

Distribution with Positive Skew

5.3

Distribution with Negative Skew

5.4

Histogram

6.1

Area under the Normal Curve

6.2

Proportionate Areas under the Normal Curve for Military Weights

6.3

Standardized Proportionate Areas under the Normal Curve: An Example

6.4

Distribution of Sample Means

6.5

Hypothetical Normal Distributions for Sample Means Compared to Raw Data

6.6

Properties of Normal Curves Applied to Hypothetical Distribution of Sample Mean Weights

7.1

Dual-Direction Research Question (Two-Tail Test at 95 Percent Confidence Level)

7.2

Single-Direction Research Question (One-Tail Test at 95 Percent Confidence Level)

8.1

Determining Sample Size

11.1

ANOVA Table for Public Works Employees

12.1

Rehabilitation Subsidy/Property Value Increase Analysis

12.2

Scatter Plot and Regression Line

12.3

Violent Crimes and Population

12.4

Prior Convictions and Sentence Length

12.5

ANOVA Table for Regression Line of Subsidy and Value Increases

13.1

Favor or Oppose Building Seawater Desalination Facilities

13.2

Rating of Police Response to Emergency and Nonemergency Calls

13.3

Mean Satisfaction Ratings for Various Features of Bus Service

13.4

Frequency of Sprinkler Adjustment by Households with an Automatically Controlled Sprinkler System

Tables

2.1

Ways in Which City Government Can Serve Community Needs

5.1

Political Leaning

5.2

Rating of Local Library Facilities

5.3

Number of Children per Household in Mt. Pilot, South Dakota

5.4

Consultants’ Hourly Fees Paid by Cities in Pennsylvania

5.5

Travel Time to Work in Jersey City, New Jersey

5.6

Police Nonemergency Response Times

5.7

Willingness to Spend for Street and Highway Beautification

5.8

Impression of Effect on Montgomery City Government on Business

6.1

Distribution of 100 Hypothetical Sample Mean Weights

8.1

Minimum Sample Sizes for Variables Expressed as Proportions

8.2

Minimum Sample Sizes for Selected Small Populations

9.1

Proportionate Sample Representation for a Hypothetical Ethnic Distribution

9.2

Population of Davis Planning Areas

9.3

Outdoor Recreation Facilities Used Most Often by Davis Residents, by Planning Area

10.1

Number of Years as a Customer of the Richmond Water District

10.2

Number of Years as a Customer of the Richmond Water District, by Area of Residence

10.3

Number of Years as a Customer of the Richmond Water District, by Area of Residence: Male Respondents

10.4

Opinion Concerning Capital Punishment by Political Party

10.5

Value of Physical Therapy, by Age of Respondent

10.6

Political Orientation of Teachers in the Santa Rosa School District, by Gender

10.7

Educational Level, by Socioeconomic Status

10.8

Most Frequently Used Mode of Transportation to Work, by Subarea

11.1

Promotional Examination Score, by Department Affiliation

13.1

Statistically Significant Differences for Various Potential Uses of Recycled Water

Exhibits

2.1

Mail-Out Introduction

2.2

Telephone Introduction

2.3

In-Person Introduction

2.4

Series of Questions Demonstrating Sensitizing of Respondents

2.5

Filter or Screening Questions

2.6

Screening Used to Disqualify Respondents

4.1

Sample Focus Group Confirmation E-Mail

4.2

Structured Format for a Focus Group Discussion

5.1

Salaries of Employees of a Small, Private Business

7.1

Values of Calculated

Z

Scores to Determine Significance (according to Research Hypothesis Direction)

7.2

Critical Values of the

t

Distribution

9.1

Sample Sizes and Weights for the City of Davis Planning Areas

9.2

Sample Sizes and Weights for Stratified Sample for Table 9.1

10.1

Critical Values of the Chi-Square Distribution

10.2

Interpretation of Calculated Cramér’s

V

, Phi, and Lambda Measures of Association

10.3

Interpretation of Calculated Gamma

11.1

Table of

F

-Statistics,

P

= .05

11.2

Table of

F

-Statistics,

P

= .01

11.3

Studentized Range (

q

) Distribution

12.1

Choosing the Appropriate Statistical Test or Measure

13.1

Example of a Cover Page

Worksheets

5.1

Determination of Median

5.2

Calculation of Mean Number of Children, Mt. Pilot, South Dakota

5.3

Calculation of Mean Travel Time to Work in Jersey City, New Jersey

5.4

Calculation of Standard Deviation for Individual Case Data

5.5

Calculation of Standard Deviation for a Frequency Distribution with Single-Value Categories

5.6

Calculation of Standard Deviations for Table 5.6

9.1

Calculation of Weighted Citywide Total for Outdoor Recreation Facilities Used Most Often

10.1

Chi-Square Matrix (

n

= 500)

11.1

Public Works Employees’ Earnings

12.1

Calculation of Regression Line

12.2

Residual Sum of Squares

PREFACE

The sample survey research industry can expect to continue its rapid expansion in the years ahead. As we move through the twenty-first century, myriad technological and analytical innovations have firmly entrenched the probability sample as an indispensable part of life. The growing population and associated socioeconomic complexities, the strengthening of capitalism as a worldwide economic system, and the concurrent forces of democracy surfacing with strength around the globe guarantee the continued significance of sample survey research as a means of gathering data and understanding the interests, concerns, and behavior of people everywhere.

There is a shortage of well-focused, easily understood, yet theoretically and methodologically sound treatments of the sample survey process. Existing texts are generally highly technical and can be appreciated and used only by experts, or they are overly descriptive and not conducive to the successful implementation of a sample survey research project. Furthermore, sample survey research is frequently treated as a relatively small component of broader books that focus on quantitative methods; this treatment is often insufficiently detailed to serve practitioners in their professional capacities.