Graph Analysis and Visualization E-Book

Richard Brath

• Herausgeber: John Wiley & Sons
• Kategorie: Wissenschaft und neue Technologien
• Sprache: Englisch

Seitenzahl: 571

Veröffentlichungsjahr: 2015

Beschreibung

Wring more out of the data with a scientific approach to analysis

Graph Analysis and Visualization brings graph theory out of the lab and into the real world. Using sophisticated methods and tools that span analysis functions, this guide shows you how to exploit graph and network analytic techniques to enable the discovery of new business insights and opportunities. Published in full color, the book describes the process of creating powerful visualizations using a rich and engaging set of examples from sports, finance, marketing, security, social media, and more. You will find practical guidance toward pattern identification and using various data sources, including Big Data, plus clear instruction on the use of software and programming. The companion website offers data sets, full code examples in Python, and links to all the tools covered in the book.

Science has already reaped the benefit of network and graph theory, which has powered breakthroughs in physics, economics, genetics, and more. This book brings those proven techniques into the world of business, finance, strategy, and design, helping extract more information from data and better communicate the results to decision-makers.

• Study graphical examples of networks using clear and insightful visualizations
• Analyze specifically-curated, easy-to-use data sets from various industries
• Learn the software tools and programming languages that extract insights from data
• Code examples using the popular Python programming language

There is a tremendous body of scientific work on network and graph theory, but very little of it directly applies to analyst functions outside of the core sciences – until now. Written for those seeking empirically based, systematic analysis methods and powerful tools that apply outside the lab, Graph Analysis and Visualization is a thorough, authoritative resource.

Leseprobe

CONTENTS

Titlepage

Copyright

Dedication

About the Authors

About the Technical Editors

Introduction

Who This Book Is For

How This Book Is Structured

Materials for Download

What You Need to TRY THE EXAMPLES

Caveats

Conventions

Part 1: Overview

Chapter 1: Why Graphs?

Visualization in Business

Graphs in Business

Graphs Today

Summary

Chapter 2: A Graph for Every Problem

Relationships

Hierarchies

Communities

Flows

Spatial Networks

Summary

Part 2: Process and Tools

Chapter 3: Data—Collect, Clean, and Connect

Know the Objective

Collect: Identify Data

Clean: Fix the Data

Connect: Organize Graph Data

Putting It All Together

Summary

Chapter 4: Stats and Layout

Basic Graph Statistics

Layouts

Putting It All Together

Summary

Chapter 5: Visual Attributes

Essential Visual Attributes

Key Node Attributes

Key Edge Attributes

Combining Basic Attributes

Bundles, Shapes, Images, and More

Putting It All Together

Summary

Chapter 6: Explore and Explain

Explore, Explain, and Export

Essential Exploratory Interactions

More Interactive Exploration

Explain

Putting It All Together

Summary

Chapter 7: Point-and-Click Graph Tools

Excel

NodeXL

Gephi

Cytoscape

yEd

Summary

Chapter 8: Lightweight Programming

Python

JavaScript and Graph Visualization

Summary

Part 3: Visual Analysis of Graphs

Chapter 9: Relationships

Links and Relationships

E-mail Relationships

Actors and Movies

Links Turned into Nodes

Summary

Chapter 10: Hierarchies

Organizational Charts

Trees and Graphs

Drawing a Hierarchy

Decision Trees

Website Trees and Effectiveness

Summary

Chapter 11: Communities

What Defines a Community?

Graph Clustering

Cliques and Other Groups

Summary

Chapter 12: Flows

Sankey Diagrams

Constructing a Sankey Diagram

Community Layouts with Flow

Chord Diagrams

Constructing a Chord Diagram

Behavioral Factor Tree

Summary

Chapter 13: Spatial Networks

Schematic Layout

Small World Grouping

Link Rose Summaries

Route Patterns

Summary

Part 4: Advanced Techniques

Chapter 14: Big Data

Graph Databases

Graph Query Languages

Analyzing Neighborhoods

Plotting Network Activity

Community Visualization

Summary

Chapter 15: Dynamic Graphs

Graph Changes

Transaction Graphs

Summary

Chapter 16: Design

Nodes

Links

Color

Summary

Glossary

End-User License Agreement

List of Tables

Table P1-1

Table P2-1

Table P2-2

Table 4-1

Table 4-2

Table 4-3

Table 5-1

Table 5-2

Table 6-1

Table P3-1

Table P4-1

Table 16-1

List of Illustrations

Figure 1-1

Figure 1-2

Figure 1-3

Figure 1-4

Figure 1-5

Figure 1-6

Figure 1-7

Figure 1-8

Figure 1-9

Figure 1-10

Figure 1-11

Figure 1-12

Figure 1-13

Figure 1-14

Figure 1-15

Figure 2-1

Figure 2-2

Figure 2-3

Figure 2-4

Figure 2-5

Figure 2-6

Figure 2-7

Figure 2-8

Figure 2-9

Figure 2-10

Figure 2-11

Figure 2-12

Figure 2-13

Figure 2-14

Figure 2-15

Figure 2-16

Figure 2-17

Figure 2-18

Figure 2-19

Figure P2-1

Figure 3-1

Figure 3-2

Figure 3-3

Figure 3-4

Figure 4-1

Figure 4-2

Figure 4-3

Figure 4-4

Figure 4-5

Figure 4-6

Figure 4-7

Figure 4-8

Figure 4-9

Figure 4-10

Figure 4-11

Figure 4-12

Figure 4-13

Figure 4-14

Figure 4-15

Figure 4-16

Figure 4-17

Figure 4-18

Figure 4-19

Figure 4-20

Figure 4-21

Figure 4-22

Figure 4-23

Figure 4-24

Figure 4-25

Figure 4-26

Figure 5-1

Figure 5-2

Figure 5-3

Figure 5-4

Figure 5-5

Figure 5-6

Figure 5-7

Figure 5-8

Figure 5-9

Figure 5-10

Figure 5-11

Figure 5-12

Figure 5-13

Figure 5-14

Figure 5-15

Figure 5-16

Figure 5-17

Figure 5-18

Figure 5-19

Figure 5-20

Figure 5-21

Figure 5-22

Figure 5-23

Figure 5-24

Figure 5-25

Figure 5-26

Figure 5-27

Figure 5-28

Figure 5-29

Figure 6-1

Figure 6-2

Figure 6-3

Figure 6-4

Figure 6-5

Figure 6-6

Figure 6-7

Figure 6-8

Figure 6-9

Figure 6-10

Figure 6-11

Figure 6-12

Figure 6-13

Figure 6-14

Figure 6-15

Figure 6-16

Figure 6-17

Figure 7-1

Figure 7-2

Figure 7-3

Figure 7-4

Figure 7-5

Figure 7-6

Figure 7-7

Figure 7-8

Figure 7-9

Figure 7-10

Figure 7-11

Figure 7-12

Figure 7-13

Figure 7-14

Figure 7-15

Figure 7-16

Figure 7-17

Figure 7-18

Figure 7-19

Figure 7-20

Figure 7-21

Figure 7-22

Figure 7-23

Figure 7-24

Figure 7-25

Figure 7-26

Figure 7-27

Figure 7-28

Figure 7-29

Figure 8-1

Figure 8-2

Figure 8-3

Figure 8-4

Figure 8-5

Figure 8-6

Figure 8-7

Figure 8-8

Figure 8-9

Figure 8-10

Figure 8-11

Figure 8-12

Figure 8-13

Figure 8-14

Figure 9-1

Figure 9-2

Figure 9-3

Figure 9-4

Figure 9-5

Figure 9-6

Figure 9-7

Figure 9-8

Figure 9-9

Figure 9-10

Figure 9-11

Figure 9-12

Figure 9-13

Figure 10-1

Figure 10-2

Figure 10-3

Figure 10-4

Figure 10-5

Figure 10-6

Figure 10-7

Figure 10-8

Figure 10-9

Figure 10-10

Figure 10-11

Figure 10-12

Figure 10-13

Figure 10-14

Figure 10-15

Figure 11-1

Figure 11-2

Figure 11-3

Figure 11-4

Figure 11-5

Figure 11-6

Figure 11-7

Figure 11-8

Figure 11-9

Figure 11-10

Figure 11-11

Figure 11-12

Figure 11-13

Figure 11-14

Figure 11-15

Figure 11-16

Figure 11-17

Figure 11-18

Figure 11-19

Figure 12-1

Figure 12-2

Figure 12-3

Figure 12-4

Figure 12-5

Figure 12-6

Figure 12-7

Figure 12-8

Figure 12-9

Figure 12-10

Figure 12-11

Figure 13-1

Figure 13-2

Figure 13-3

Figure 13-4

Figure 13-5

Figure 13-6

Figure 13-7

Figure 13-8

Figure 13-9

Figure 13-10

Figure 13-11

Figure 14-1

Figure 14-2

Figure 14-3

Figure 14-4

Figure 14-5

Figure 14-6

Figure 14-7

Figure 14-8

Figure 14-9

Figure 14-10

Figure 14-11

Figure 15-1

Figure 15-2

Figure 15-3

Figure 15-4

Figure 15-5

Figure 15-6

Figure 15-7

Figure 15-8

Figure 15-9

Figure 15-10

Figure 15-11

Figure 15-12

Figure 15-13

Figure 15-14

Figure 15-15

Figure 15-16

Figure 15-17

Figure 16-1

Figure 16-2

Figure 16-3

Figure 16-4

Figure 16-5

Figure 16-6

Figure 16-7

Figure 16-8

Figure 16-9

Figure 16-10

Guide

Cover

Title Page

Front Matter

Dedication

Introduction

Part 1: Overview

Chapter 1: Why Graphs?

Start Reading

Chapter 2: A Graph for Every Problem

Part 2: Process and Tools

Chapter 3: Data—Collect, Clean, and Connect

Chapter 4: Stats and Layout

Chapter 5: Visual Attributes

Chapter 6: Explore and Explain

Chapter 7: Point-and-Click Graph Tools

Chapter 8: Lightweight Programming

Part 3: Visual Analysis of Graphs

Chapter 9: Relationships

Chapter 10: Hierarchies

Chapter 11: Communities

Chapter 12: Flows

Chapter 13: Spatial Networks

Part 4: Advanced Techniques

Chapter 14: Big Data

Chapter 15: Dynamic Graphs

Chapter 16: Design

Glossary

End-User License Agreement

Pages

iii

iv

v

vii

ix

xvii

xviii

xix

xx

xxi

xxii

1

2

3

4

5

6

7

9

12

14

15

18

19

20

23

24

25

26

27

28

29

30

31

32

34

35

36

38

39

40

41

42

44

45

51

52

53

55

56

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

87

88

89

92

93

94

95

96

97

98

99

101

102

103

104

105

106

107

108

109

111

113

114

115

116

117

118

121

122

123

125

126

127

128

129

130

131

132

134

136

142

143

144

145

146

147

148

151

152

153

155

157

158

159

160

161

163

165

166

167

169

170

172

173

174

175

176

178

179

180

181

182

183

184

185

186

187

188

189

190

193

195

196

198

200

201

203

204

205

206

208

209

210

211

212

213

214

215

216

218

219

220

221

222

223

224

225

226

227

228

229

230

231

232

233

234

235

236

237

238

239

240

242

243

245

246

248

249

250

251

252

253

254

255

256

258

261

262

263

264

265

266

267

268

269

270

271

273

274

275

276

277

278

280

282

284

286

287

288

292

293

295

297

298

300

303

304

306

307

309

310

311

312

314

315

317

318

319

320

321

324

325

326

328

329

330

334

335

337

338

339

341

342

343

344

345

346

347

349

351

353

354

355

356

357

358

359

360

361

362

363

364

366

367

368

369

370

371

372

373

374

375

376

377

378

379

381

382

383

385

386

387

389

390

391

393

394

395

396

397

398

399

400

401

402

403

404

405

406

407

409

410

411

412

414

416

417

418

419

420

421

423

424

425

426

427

428

429

430

431

432

433

434

435

436

437

438

439

440

441

442

443

444

445

446

447

448

449

450

451

453

454

456

457

458

459

461

462

463

464

465

466

469

470

471

472

473

474

475

476

477

478

480

481

482

483

484

485

486

487

489

490

492

493

495

496

497

498

499

500

Graph Analysis and Visualization

Discovering Business Opportunity in Linked Data

Richard Brath

David Jonker

Copyright

Graph Analysis and Visualization: Discovering Business Opportunity in Linked Data

Published byJohn Wiley & Sons, Inc.10475 Crosspoint BoulevardIndianapolis, IN 46256www.wiley.com

Copyright © 2015 by John Wiley & Sons, Inc., Indianapolis, Indiana

Published simultaneously in Canada

ISBN: 978-1-118-84584-4

ISBN: 978-1-118-84569-1 (ebk)

ISBN: 978-1-118-84587-5 (ebk)

Manufactured in the United States of America

10 9 8 7 6 5 4 3 2 1

No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923, [phone], fax [phone]. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, [phone], fax [phone], or online at http://www.wiley.com/go/permissions.

Limit of Liability/Disclaimer of Warranty: The publisher and the author make no representations or warranties with respect to the accuracy or completeness of the contents of this work and specifically disclaim all warranties, including without limitation warranties of fitness for a particular purpose. No warranty may be created or extended by sales or promotional materials. The advice and strategies contained herein may not be suitable for every situation. This work is sold with the understanding that the publisher is not engaged in rendering legal, accounting, or other professional services. If professional assistance is required, the services of a competent professional person should be sought. Neither the publisher nor the author shall be liable for damages arising herefrom. The fact that an organization or Web site is referred to in this work as a citation and/or a potential source of further information does not mean that the author or the publisher endorses the information the organization or website may provide or recommendations it may make. Further, readers should be aware that Internet websites listed in this work may have changed or disappeared between when this work was written and when it is read.

For general information on our other products and services please contact our Customer Care Department within the United States at [phone], outside the United States at [phone] or fax [phone].

Wiley publishes in a variety of print and electronic formats and by print-on-demand. Some material included with standard print versions of this book may not be included in e-books or in print-on-demand. If this book refers to media such as a CD or DVD that is not included in the version you purchased, you may download this material at http://booksupport.wiley.com. For more information about Wiley products, visit www.wiley.com.

Library of Congress Control Number: 2014951021

Trademarks: Wiley and the Wiley logo are trademarks or registered trademarks of John Wiley & Sons, Inc. and/or its affiliates, in the United States and other countries, and may not be used without written permission. All other trademarks are the property of their respective owners. John Wiley & Sons, Inc. is not associated with any product or vendor mentioned in this book.

Dedication

To Bayla, Abe, and Hana, who provide endless support for all my endeavors.

—Richard Brath

To Heather, Micah, Avril, and Naomi for their love and sacrifice in the making of this book. To Chris White for his vision and support in striving to put better tools in the hands of those who need them most.

—David Jonker

About the Authors

Richard Brath is actively involved in the research, design, and development of data visualization and visual analytics for both research and commercial applications. His solutions range from rich interactive visualizations for mobile devices to large multi-touch, multi-screen installations, and web-based analytical visualizations for business applications. Brath’s visualizations are used by hundreds of thousands of people every day in applications as diverse as trading, professional sports, and broadcast television.

David Jonker is a co-founder and Senior Partner of Uncharted (formerly Oculus Info Inc). He is a designer and developer of visual analytics tools and platforms for web-based, distributed, and mobile use. His work over the past two decades includes visualization systems and content for the NASDAQ MarketSite real-time broadcast center in Times Square. He is currently a lead on the DARPA XDATA program. Jonker and Brath are business partners and regular presenters and publishers of work in leading industry and research forums.

About the Technical Editors

Scott Langevin is a director and research scientist at Uncharted, with more than 12 years of industry and academic experience. He holds a PhD in computer science from the University of South Carolina, and has a background in machine learning, service-oriented computing, and software engineering. Langevin’s research interests are in probabilistic graphical modeling, large-scale visual analytics, and adaptive user interfaces.

Peter MacMurchy has been a professional software developer for more than 15 years, focusing on UX, UI, and interactive data-visualization tools. He acquired a keen interest in information visualization from coursework while studying computer graphics for his master of science degree in computer science at the University of Calgary. Since then, he’s continued to develop visualization and interactive software for finance, film, energy, and other industries.

Introduction

This book is about the application of graph visualization and analysis for business. Graph applications are a unique and valuable resource for discovering actionable insights in data. In recent years, analysts inside some of the world’s most innovative companies have been intensively exploring graph-based approaches to a gain deeper understanding of the dynamics of their businesses while discovering opportunities and strategies for improvement.

As the volume, variety, and velocity of available data has grown, so has the need for techniques and technology to make sense of it all. Organizations have become acutely aware of the limitations of simple dashboard-style charts. Dashboards are good at showing metrics and trends. They can inform you when areas of business are underperforming or outperforming others, but they cannot begin to tell you why, and understanding why is key to taking effective action.