Big Data, Open Data and Data Development E-Book

Jean-Louis Monino

• Herausgeber: John Wiley & Sons
• Kategorie: Wissenschaft und neue Technologien
• Sprache: Englisch

Seitenzahl: 203

Veröffentlichungsjahr: 2016

Beschreibung

The world has become digital and technological advances have multiplied circuits with access to data, their processing and their diffusion. New technologies have now reached a certain maturity. Data are available to everyone, anywhere on the planet. The number of Internet users in 2014 was 2.9 billion or 41% of the world population. The need for knowledge is becoming apparent in order to understand this multitude of data. We must educate, inform and train the masses. The development of related technologies, such as the advent of the Internet, social networks, "cloud-computing" (digital factories), has increased the available volumes of data. Currently, each individual creates, consumes, uses digital information: more than 3.4 million e-mails are sent worldwide every second, or 107,000 billion annually with 14,600 e-mails per year per person, but more than 70% are spam. Billions of pieces of content are shared on social networks such as Facebook, more than 2.46 million every minute. We spend more than 4.8 hours a day on the Internet using a computer, and 2.1 hours using a mobile. Data, this new ethereal manna from heaven, is produced in real time. It comes in a continuous stream from a multitude of sources which are generally heterogeneous. This accumulation of data of all types (audio, video, files, photos, etc.) generates new activities, the aim of which is to analyze this enormous mass of information. It is then necessary to adapt and try new approaches, new methods, new knowledge and new ways of working, resulting in new properties and new challenges since SEO logic must be created and implemented. At company level, this mass of data is difficult to manage. Its interpretation is primarily a challenge. This impacts those who are there to "manipulate" the mass and requires a specific infrastructure for creation, storage, processing, analysis and recovery. The biggest challenge lies in "the valuing of data" available in quantity, diversity and access speed.

Leseprobe

Table of Contents

Cover

Title

Copyright

Acknowledgements

Foreword

Key Concepts

Introduction

I.1. The power of data

I.2. The rise of buzzwords related to “data” (Big, Open, Viz)

I.3. Developing a culture of openness and data sharing

1 The Big Data Revolution

1.1. Understanding the Big Data universe

1.2. What changes have occurred in data analysis?

1.3. From Big Data to Smart Data: making data warehouses intelligent

1.4. High-quality information extraction and the emergence of a new profession: data scientists

1.5. Conclusion

2 Open Data: A New Challenge

2.1. Why Open Data?

2.2. A universe of open and reusable data

2.3. Open Data and the Big Data universe

2.4. Data development and reuse

2.5. Conclusion

3 Data Development Mechanisms

3.1. How do we develop data?

3.2. Data governance: a key factor for data valorization

3.3. CI: protection and valuation of digital assets

3.4. Techniques of data analysis: data mining/text mining

3.5. Conclusion

4 Creating Value from Data Processing

4.1. Transforming the mass of data into innovation opportunities

4.2. Creation of value and analysis of open databases

4.3. Value creation of business assets in web data

4.4. Transformation of data into information or “DataViz”

4.5. Conclusion

Conclusion

Bibliography

Index

End User License Agreement

List of Tables

1 The Big Data Revolution

Table 1.1.

Data units of measurement

2 Open Data: A New Challenge

Table 2.1.

Open data in five stages

.

4 Creating Value from Data Processing

Table 4.1.

The 50 most innovative companies in 2014

List of Illustrations

Introduction

Figure I.1.

Relationship between data, information and knowledge [MON 06]

Figure I.2.

The hierarchic model: data, information, and knowledge [MON 06]

8

Figure I.3.

Web searches on “Big Data” and “Open Data” 2010–13 according to Google Trends. For a color version of the figure, see www.iste.co.uk/monino/data.zip

Example I.1.

The startup E-PROSPECTS

Example I.2.

Information processing C2i certificate security and massive processing

5

by QRCode

6

Example I.3.

Data mining and Statistica software

Example I.4.

An example from France’s Bouches-du-Rhône Administrative Department and from the city of Montpellier

Example I.5.

Netflix

Example I.6.

INSEE and sectorization

Example I.7.

A startup population tracking app

Example I.8.

Open Data in the city of Rennes

Example I.9.

Data Publica and C-RADAR

1 The Big Data Revolution

Figure 1.1.

Diversity of data sources

Figure 1.2.

The importance of data scientists

.

Example 1.1.

A sales receipts analysis by Wal-Mart

Example 1.2.

Book suggestions for Amazon customers

Example 1.3.

An ecosystem provided by Nike

Example 1.4.

The development of storage capacities

Example 1.5.

Two examples of open source data

2 Open Data: A New Challenge

Figure 2.1.

Open Data

:

history

Figure 2.2.

Open Data platform growth in France

.

Example 2.1.

Data journalism

Example 2.2.

Open Data and governance

3 Data Development Mechanisms

Figure 3.1.

A model of economic intelligence [MON 12]

Example 3.1.

Data centres or digital factories

Example 3.2.

An example of data processing for the startup “123PRESTA” in 2010. For a color version of the figure

,

see www.iste.co.uk/monino/data.zip

Example 3.3.

Forecasting of time series using neural networks

,

the turnover of large retail stores. For a color version of the figure

,

see www.iste.co.uk/monino/data.zip

Example 3.4.

Chaos

,

exponents of Hurst and Bootstrap. An example applied to the Paris Stock Exchange [MAT 05]

Example 3.5.

Short videos presenting CI

Example 3.6.

A base of e-prospects with Statistica as an example of data processing

4 Creating Value from Data Processing

Figure 4.1.

Companies actively targeting Big Data in their innovation programs (over the next 3 – 5 years)

.

Figure 4.2

Massive data processing and results visualization

Figure 4.3.

The 3 phases of opening up data. Source: [SAW 12] for the European Space Agency. For a color version of the figure, see www.iste.co.uk/monino/data.zip

Figure 4.4.

Evolution of Linked Open Data. For a color version of the figure, see www.iste.co.uk/monino/data.zip

Figure 4.5.

Web of the future Source: N. Spivack, “The Future of the Net”, 2004, available at http://novaspivack.typepad.com/nova_spivacks_weblog/2004/04/new_version_of_.html

Example 4.1.

The Google car

Example 4.2.

Smart City - Montpellier

Example 4.3.

An application on a transport company

Example 4.4.

“OpenKnowledge Foundation”

Example 4.5.

A route calculation service for people with reduced mobility

Example 4.6.

The SNCF and the reuse of data

Example 4.7.

Orange and the site “Where do you really live?”

Example 4.8.

Clouds of texts or words

Example 4.9.

Three-dimensional visualization. For a color version of the figure, see www.iste.co.uk/monino/data.zip

Example 4.10.

Bipartite e-graph

Conclusion

Figure C.1.

Data governance model in the age of data revolution developed by Monino and Sedkaoui

Guide

Cover

Table of Contents

Begin Reading

Pages

C1

iii

iv

v

vii

viii

ix

x

xi

xii

xiii

xiv

xv

xvi

xvii

xix

xx

xxi

xxii

xxiii

xxiv

xxv

xxvi

xxvii

xxviii

xxix

xxx

xxxi

xxxii

xxxiii

xxxiv

xxxv

xxxvi

xxxvii

xxxviii

xxxix

xl

xli

xlii

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

Smart Innovation Set

coordinated byDimitri Uzunidis

Volume 3

Big Data, Open Data and Data Development

Jean-Louis Monino

Soraya Sedkaoui

First published 2016 in Great Britain and the United States by ISTE Ltd and John Wiley & Sons, Inc.

Apart from any fair dealing for the purposes of research or private study, or criticism or review, as permitted under the Copyright, Designs and Patents Act 1988, this publication may only be reproduced, stored or transmitted, in any form or by any means, with the prior permission in writing of the publishers, or in the case of reprographic reproduction in accordance with the terms and licenses issued by the CLA. Enquiries concerning reproduction outside these terms should be sent to the publishers at the undermentioned address:

ISTE Ltd27-37 St George’s RoadLondon SW19 4EUUK

www.iste.co.uk

John Wiley & Sons, Inc.111 River StreetHoboken, NJ 07030USA

www.wiley.com

© ISTE Ltd 2016

The rights of Jean-Louis Monino and Soraya Sedkaoui to be identified as the authors of this work have been asserted by them in accordance with the Copyright, Designs and Patents Act 1988.

Library of Congress Control Number: 2016931678

British Library Cataloguing-in-Publication DataA CIP record for this book is available from the British LibraryISBN 978-1-84821-880-2