Kibana Essentials - Yuvraj Gupta - E-Book

Kibana Essentials E-Book

Yuvraj Gupta

0,0
28,99 €

-100%
Sammeln Sie Punkte in unserem Gutscheinprogramm und kaufen Sie E-Books und Hörbücher mit bis zu 100% Rabatt.

Mehr erfahren.
Beschreibung

Use the functionalities of Kibana to discover data and build attractive visualizations and dashboards for real-world scenarios
About This Book
Perform real-time data analytics and visualizations, on streaming data, using Kibana
Build beautiful visualizations and dashboards with simplicity and ease without any type of coding involved
Learn all the core concepts as well as detailed information about each component used in Kibana
Who This Book Is For
Whether you are new to the world of data analytics and data visualization or an expert, this book will provide you with the skills required to use Kibana with ease and simplicity for real-time data visualization of streaming data.
This book is intended for those professionals who are interested in learning about Kibana,its installations, and how to use it . As Kibana provides a user-friendly web page, no prior experience is required.
What You Will Learn
Understand the basic concepts of elasticsearch used in Kibana along with step by step guide to install Kibana in Windows and Ubuntu
Explore the functionality of all the components used in Kibana in detail, such as the Discover, Visualize, Dashboard,and Settings pages
Analyze data using the powerful search capabilities of elasticsearch
Understand the different types of aggregations used in Kibana for visualization
Create and build different types of amazing visualizations and dashboards easily
Create, save, share, embed, and customize the visualizations added to the dashboard
Customize and tweak the advanced settings of Kibana to ensure ease of use
In Detail
With the increasing interest in data analytics and visualization of large data around the globe, Kibana offers the best features to analyze data and create attractive visualizations and dashboards through simple-to-use web pages. The variety of visualizations provided, combined with the powerful underlying elasticsearch capabilities will help professionals improve their skills with this technology.
This book will help you quickly familiarize yourself to Kibana and will also help you to understand the core concepts of this technology to build visualizations easily.
Starting with setting up of Kibana and elasticsearch in Windows and Ubuntu, you will then use the Discover page to analyse your data intelligently. Next, you will learn to use the Visualization page to create beautiful visualizations without the need for any coding. Then, you will learn how to use the Dashboard page to create a dashboard and instantly share and embed the dashboards. You will see how to tweak the basic and advanced settings provided in Kibana to manage searches, visualizations, and dashboards. Finally, you will use Kibana to build visualizations and dashboards for real-world scenarios.
You will quickly master the functionalities and components used in Kibana to create amazing visualizations based on real-world scenarios. With ample screenshots to guide you through every step, this book will assist you in creating beautiful visualizations with ease.
Style and approach
This book is a comprehensive step-by-step guide to help you understand Kibana. It’s explained in an easy-to-follow style along with supporting images. Every chapter is explained sequentially , covering the basics of each component of Kibana and providing detailed explanations of all the functionalities of Kibana that appeal.

Das E-Book können Sie in Legimi-Apps oder einer beliebigen App lesen, die das folgende Format unterstützen:

EPUB
MOBI

Seitenzahl: 187

Veröffentlichungsjahr: 2015

Bewertungen
0,0
0
0
0
0
0
Mehr Informationen
Mehr Informationen
Legimi prüft nicht, ob Rezensionen von Nutzern stammen, die den betreffenden Titel tatsächlich gekauft oder gelesen/gehört haben. Wir entfernen aber gefälschte Rezensionen.



Table of Contents

Kibana Essentials
Credits
About the Author
Acknowledgments
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why subscribe?
Free access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the color images of this book
Errata
Piracy
Questions
1. An Introduction to Kibana
Understanding Elasticsearch
The basic concepts of Elasticsearch
Prerequisites for installing Kibana 4.1.1
Installation of Java
Installation of Java on Ubuntu 14.04
Installation of Java on Windows
Installation of Elasticsearch
Installation of Elasticsearch on Ubuntu 14.04
Installation of Elasticsearch on Windows
Installation of GIT
Installation of Kibana
Installation of Kibana on Ubuntu 14.04
Installation of Kibana on Windows
Additional information
Changing the Elasticsearch configuration
Changing the Kibana configuration
Importing a JSON file into Elasticsearch
Installation of npm
Installation of npm on Ubuntu 14.04
Installation of npm on Windows
Installing elasticdump
Installing elasticdump on Ubuntu 14.04
Installing elasticdump on Windows
Summary
2. Exploring the Discover Page
Understanding the time filter
Setting the time filter
The Auto-refresh page
Understanding the toolbar
Using the search bar
New Search
Save Search
Load Saved Search
Understanding the Fields list
View field data information
Filtering by field
Functionalities of filters
The Enable filter
The Disable filter
The Pin filter
The Unpin filter
The Invert filter
The Toggle filter
The Remove filter
Understanding document data
Add a field to document data
Remove a field from document data
View data
Sorting documents
Moving fields in document data
Summary
3. Exploring the Visualize Page
Understanding aggregations
Bucket aggregations
Date histogram
Histogram
Range
Date range
IPv4 range
Terms
Filters
Significant terms
GeoHash
Metric aggregations
Count
Sum
Average
Min
Max
Unique count
Percentile
Percentile ranks
Steps for designing visualization
Step 1 – selecting a visualization type
Step 2 – selecting search data source
Step 3 – the visualization canvas
Toolbar
New Visualization
Save Visualization
Load Saved Visualization
Share Visualization
Refresh
Aggregation designer
Preview canvas
An explanation of visualization types
Area Chart
Overlap
Percentage
Wiggle
Silhouette
Data Table
Line Chart
Log
Square root
Markdown widget
Metric
Pie Chart
Tile Map
Shaded Circle Markers
Shaded GeoHash Grid
Heatmap
Desaturate map tiles
Vertical Bar Chart
Percentage
Grouped
Summary
4. Exploring the Dashboard Page
Understanding the toolbar
The New Dashboard option
Adding visualizations
Using the search bar
The Save Dashboard option
The Load Saved Dashboard option
Sharing the saved dashboard
Understanding the dashboard canvas
Moving visualizations
Resizing visualizations
Editing visualizations
Removing visualizations
Embedding a dashboard in a web page
Understanding the debug panel
Table
Request
Response
Statistics
Summary
5. Exploring the Settings Page
Indices
Configuring an index pattern
Setting the default index pattern
Reloading the index fields list
Removing an index pattern
Managing the field properties
The field type format
Advanced
Objects
Managing saved searches, visualizations, and dashboards
Viewing a saved object
Editing a saved object
Deleting a saved object
Exporting saved objects
Importing saved objects
About
Summary
6. Real-Time Twitter Data Analysis
The installation of Logstash
The installation of Logstash on Ubuntu 14.04
The installation of Logstash on Windows
The workflow for real-time Twitter data analysis
Creating a Twitter developer account
Creating a Logstash configuration file
Creating visualizations for scenarios
Number of tweets over a period of time
Number of tweets in different languages
Number of tweets from different geographical locations
Number of tweets from Android, iPhone, iPad, and Web devices
Number of tweets in various languages using different devices
Number of tweets from various countries using different devices
The most retweeted user screen name tweeting using different devices
The most tweeted user's screen name
Popular hashtags
Twitter metrics
Summary
A. References
Chapter 1, An Introduction to Kibana
Chapter 2, Exploring the Discover Page
Chapter 3, Exploring the Visualize Page
Chapter 4, Exploring the Dashboard Page
Chapter 5, Exploring the Settings Page
Chapter 6, Real-Time Twitter Data Analysis
Index

Kibana Essentials

Kibana Essentials

Copyright © 2015 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: October 2015

Production reference: 1261015

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham B3 2PB, UK.

ISBN 978-1-78439-493-6

www.packtpub.com

Credits

Author

Yuvraj Gupta

Reviewers

Jacob Alves

Brent Ashley

David Laing

Commissioning Editor

Sarah Crofton

Acquisition Editor

Manish Nainani

Content Development Editor

Merwyn D'souza

Technical Editor

Shiny Poojary

Copy Editor

Vikrant Phadke

Project Coordinator

Neha Bhatnagar

Proofreader

Safis Editing

Indexer

Tejal Soni

Graphics

Disha Haria

Production Coordinator

Manu Joseph

Cover Work

Manu Joseph

About the Author

Yuvraj Gupta holds an undergraduate degree in computer science with a specialization in cloud computing and virtualization technology from UPES, Dehradun, India. He is currently working as a big data QA engineer. He has a keen interest in big data, data analytics, and visualization, and loves to try out new technologies.

Yuvraj is an avid gadget lover and makes it a point to stay up to date with the latest happenings in the technology domain. When he is not working, he spends his time on Facebook, Quora, and Stack Overflow, and also watches and plays sports. He can be reached at <[email protected]> or on LinkedIn at https://www.linkedin.com/in/guptayuvraj.

Acknowledgments

I had never thought of writing a technical book so soon in my life. It reminds me that opportunity knocks the door only once, and I am very lucky to have the opportunity of writing this book on the essentials of Kibana. However, ability is nothing without opportunity, and I would like to thank my acquisition editor, Manish Nainani, for scouting me and believing in a first-time author to write this book. I was lucky to have such an awesome content development editor, Merwyn D'Souza, who was very helpful and patient throughout the course of writing this book. In addition, I would like to thank the reviewers and the entire team of Packt Publishing, who were involved in producing this book. Without their support, it would never have been possible.

Special thanks to my dad, Sanjay, mom, Nisha, and brother, Adhiraj, for encouraging me and believing in me. I would also like to thank all my family members—Mamu, Massi, Massad, Taujis, Taijis, and my amazing cousins—for their blessings and guidance. A special shout out to all my friends, especially the cloud computing batch of 2015 and those who have helped me directly or indirectly in writing this book. Without everyone's support, I would have never been able to write this book.

I would also like to thank my teachers, professors, gurus, schools, and university for playing an important role in providing me with the education that has helped me gain knowledge.

Last but not least, I would like to extend my gratitude towards Elastic Inc. and Rashid for developing this awesome software with amazing features. This is a small contribution from my side to the ever-growing community of Kibana, and I hope this book helps Kibana reach greater heights.

About the Reviewers

Brent Ashley has been involved in computer technology and its surrounding communities since 1979, contributing via online forums, local and international events, papers, articles, and speeches.

As a leader and mentor in the development community, he became recognized in the early 2000s as an early pioneer in the web technologies that are now known as Ajax.

For more than 20 years, he worked as an Internet infrastructure architect and consultant, gaining extensive experience with networked asset configuration, management, monitoring, and log analysis.

Brent is the associate vice president of infrastructure architecture at ControlCase, LLC (http://www.controlcase.com/), a global innovator and leader in the provision and development of services, software products, hardware appliances, and managed solutions. The company focuses on compliance regulations and standards, including PCI DSS, ISO, SOX, HIPAA and many other regulatory environments and frameworks. Brent takes a lead role in the management and expansion of their international technology infrastructure as they continue to grow.

He was also a technical reviewer on the following books:

Foundations of Ajax, Asleson and Schutta, APress, 2005Enterprise Ajax, Johnson, White, Charland, Prentice Hall, 2007

David Laing is a long-time member of the Cloud Foundry community. He is a core contributor to BOSH and the leader of the open source Logsearch (ELK + BOSH: http://www.logsearch.io/) project, which brings log analysis to the Cloud Foundry platform using ELK. David's company, stayUp.io (http://www.stayup.io/), provides commercial support for Logsearch.

www.PacktPub.com

Support files, eBooks, discount offers, and more

For support files and downloads related to your book, please visit www.PacktPub.com.

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at <[email protected]> for more details.

At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.

https://www2.packtpub.com/books/subscription/packtlib

Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can search, access, and read Packt's entire library of books.

Why subscribe?

Fully searchable across every book published by PacktCopy and paste, print, and bookmark contentOn demand and accessible via a web browser

Free access for Packt account holders

If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view 9 entirely free books. Simply use your login credentials for immediate access.

This book is dedicated to my Nanu and Nani for motivating me and for being an inspiration to me.

Preface

As big data has been trending in the industry for a while, huge amounts of data present a bigger challenge in gaining meaningful information from raw data. In today's industry, getting insights from data and making real-time decisions based on this huge data has become even more important.

Kibana provides an easy-to-use UI to perform real-time data analysis and visualizations on streaming data. It enables you to get hidden information by exploring data in different dimensions.

Making beautiful visualizations with ease without requiring any code and empowering people without technical knowledge to gather insights have never been easier.

What this book covers

Chapter 1, An Introduction to Kibana, takes you through the basic concepts of Elasticsearch, followed by the installation of Kibana and its prerequisite software.

Chapter 2, Exploring the Discover Page, covers the functionality of various components, along with detailed explanations of the usage of each component and its options.

Chapter 3, Exploring the Visualize Page, teaches you to create different types of visualizations using aggregations to visualize data.

Chapter 4, Exploring the Dashboard Page, covers the functionality of the various components present on the Dashboard page, followed by creating and embedding dashboards.

Chapter 5, Exploring the Settings Page, demonstrates the usage and tweaking of basic and advanced settings provided in Kibana.

Chapter 6, Real-Time Twitter Data Analysis, shows you how to analyze Twitter data and create visualizations based on different scenarios. This chapter also covers the workflow for analyzing Twitter data.

Appendix, References, contains a chapterwise segregation of the links and references used in the chapters.

What you need for this book

The following pieces of software are required:

Oracle Java 1.8u20+Elasticsearch v1.4.4+A modern web browser—IE 10+, Firefox, Chrome, Safari, and so onKibana v 4.1.1Git for Windowsnpm, Node.js, and elasticsearchdump for importing data in ElasticsearchLogstash v1.5.4

All of the software mentioned in this book is free of charge and can be downloaded from the Internet.

Who this book is for

Whether you are new to the world of data analytics and data visualization, or an expert, this book will provide you with the skills required to use Kibana for real-time visualization of streaming data with ease and simplicity. This book is intended for those professionals who are interested in learning about Kibana, about its installations, and how to use it. As Kibana provides a user-friendly web page, no prior experience is required.

Conventions

In this book, you will find a number of text styles that distinguish between different kinds of information. Here are some examples of these styles and an explanation of their meaning.

Code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles are shown as follows: "Windows user can open the elasticsearch.yml file from the config folder."

A block of code is set as follows:

{ "name": "Yuvraj", "age": 22, "birthdate": "2015-07-27", "bank_balance": 10500.50, "interests": ["playing games","movies","travelling"], "movie": {"name":"Titanic","genre":"Romance","year" : 1997} }

Any command-line input or output is written as follows:

elasticdump \--bulk=true \--input="C:\Users\ygupta\Desktop\tweet.json" \--output=http://localhost:9200/

Any hyperlink is written as follows:

https://github.com/guptayuvraj/Kibana_Essentials

New terms and important words are shown in bold. Words that you see on the screen, for example, in menus or dialog boxes, appear in the text like this: "Finally, click on Create to create the index in Kibana."

Note

Warnings or important notes appear in a box like this.

Tip

Tips and tricks appear like this.

Reader feedback

Feedback from our readers is always welcome. Let us know what you think about this book—what you liked or disliked. Reader feedback is important for us as it helps us develop titles that you will really get the most out of.

To send us general feedback, simply e-mail <[email protected]>, and mention the book's title in the subject of your message.

If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, see our author guide at www.packtpub.com/authors.

Customer support

Now that you are the proud owner of a Packt book, we have a number of things to help you to get the most from your purchase.

Downloading the color images of this book

We also provide you with a PDF file that has color images of the screenshots/diagrams used in this book. The color images will help you better understand the changes in the output. You can download this file from https://www.packtpub.com/sites/default/files/downloads/4936OS_ColoredImages.pdf.

Errata

Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you find a mistake in one of our books—maybe a mistake in the text or the code—we would be grateful if you could report this to us. By doing so, you can save other readers from frustration and help us improve subsequent versions of this book. If you find any errata, please report them by visiting http://www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details of your errata. Once your errata are verified, your submission will be accepted and the errata will be uploaded to our website or added to any list of existing errata under the Errata section of that title.

To view the previously submitted errata, go to https://www.packtpub.com/books/content/support and enter the name of the book in the search field. The required information will appear under the Errata section.

Piracy

Piracy of copyrighted material on the Internet is an ongoing problem across all media. At Packt, we take the protection of our copyright and licenses very seriously. If you come across any illegal copies of our works in any form on the Internet, please provide us with the location address or website name immediately so that we can pursue a remedy.

Please contact us at <[email protected]> with a link to the suspected pirated material.

We appreciate your help in protecting our authors and our ability to bring you valuable content.

Questions

If you have a problem with any aspect of this book, you can contact us at <[email protected]>, and we will do our best to address the problem.

Chapter 1. An Introduction to Kibana

Kibana is a tool that is part of the ELK stack, which consists of Elasticsearch, Logstash, and Kibana. It is built and developed by Elastic. Kibana is a visualization platform that is built on top of Elasticsearch and leverages the functionalities of Elasticsearch.

To understand Kibana better, let's check out the following diagram:

This diagram shows that Logstash is used to push data directly into Elasticsearch. This data is not limited to log data, but can include any type of data. Elasticsearch stores data that comes as input from Logstash, and Kibana uses the data stored in Elasticsearch to provide visualizations. So, Logstash provides an input stream of data to Elasticsearch, from which Kibana accesses the data and uses it to create visualizations.

Kibana acts as an over-the-top layer of Elasticsearch, providing beautiful visualizations for data (structured or nonstructured) stored in it. Kibana is an open source analytics product used to search, view, and analyze data. It provides various types of visualizations to visualize data in the form of tables, charts, maps, histograms, and so on. It also provides a web-based interface that can easily handle a large amount of data. It helps create dashboards that are easy to create and helps query data in real time. Dashboards are nothing but an interface for underlying JSON documents. They are used for saving, templating, and exporting. They are simple to set up and use, which helps us play with data stored in Elasticsearch in minutes without requiring any coding.

Kibana is an Apache-licensed product that aims to provide a flexible interface combined with the powerful searching capabilities of Elasticsearch. It requires a web server (included in the Kibana 4 package) and any modern web browser, that is, a browser that supports industry standards and renders the web page in the same way across all browsers, to work. It connects to Elasticsearch using the REST API. It helps to visualize data in real time with the use of dashboards to provide real-time insights.

Note

In this book, we will use Kibana 4.1.1, which is the latest version of Kibana. It provides a lot of features compared to Kibana 3.

As Kibana uses the functionalities of Elasticsearch, it is easier to learn Kibana by understanding the core functionalities of Elasticsearch. In this chapter, we are going to take a look at the following topics:

The basic concepts of ElasticsearchInstallation of JavaInstallation of ElasticsearchInstallation of KibanaImporting a JSON file into Elasticsearch

Understanding Elasticsearch

Elasticsearch is a search server built on top of Lucene (licensed under Apache), which is completely written in Java. It supports distributed searches in a multitenant environment. It is a scalable search engine allowing high flexibility of adding machines easily. It provides a full-text search engine combined with a RESTful web interface and JSON documents. Elasticsearch harnesses the functionalities of Lucene Java Libraries, adding up by providing proper APIs, scalability, and flexibility on top of the Lucene full-text search library. All querying done using Elasticsearch, that is, searching text, matching text, creating indexes, and so on, is implemented by Apache Lucene.

Note

Without a setup of an Elastic shield or any other proxy mechanism, any user with access to Elasticsearch API can view all the data stored in the cluster.

The basic concepts of Elasticsearch

Let's explore some of the basic concepts of Elasticsearch:

Field: This is the smallest single unit of data stored in Elasticsearch. It is similar to a column in a traditional relational database. Every document contains key-value pairs, which are referred to as fields. Values in a field can contain a single value, such as integer [27], string ["Kibana"], or multiple values, such as array [1, 2, 3, 4, 5]. The field type is responsible for specifying which type of data can be stored in a particular field, for example, integer, string, date, and so on.Document: This is the simplest unit of information stored in Elasticsearch. It is a collection of fields. It is considered similar to a row of a table in a traditional relational database. A document can contain any type of entry, such as a document for a single restaurant, another document for a single cuisine, and yet another for a single order. Documents are in JavaScript Object Notation (JSON), which is a language-independent data interchange format. JSON contains key-value pairs. Every document that is stored in Elasticsearch is indexed. Every document contains a type and an ID. An example of a document that has JSON values is as follows:
{ "name": "Yuvraj", "age": 22, "birthdate": "2015-07-27", "bank_balance": 10500.50, "interests": ["playing games","movies","travelling"], "movie": {"name":"Titanic","genre":"Romance","year" : 1997} }

In the preceding example, we can see that the document supports JSON, having key-value pairs, which are explained as follows:

The name field is of the string typeThe age field is of the numeric typeThe birthdate field is of the date typeThe bank_balance field is of the float typeThe interests field contains an arrayThe movie field contains an object (dictionary)
Type: This is similar to a table in a traditional relational database. It contains a list of fields, which is defined for every document. A type is a logical segregation of indexes, whose interpretation/semantics entirely depends on you. For example, you have data about the world and you put all your data into an index. In this index, you can define a type for continent-wise data, another type for country-wise data, and a third type for region-wise data. Types are used with a mapping API; it specifies the type of its field. An example of type mapping is as follows:
{ "user": { "properties": { "name": { "type": "string" }, "age": { "type": "integer" }, "birthdate": { "type": "date" }, "bank_balance": { "type": "float" }, "interests": { "type": "string" }, "movie": { "properties": { "name": { "type": "string" }, "genre": { "type": "string" }, "year": { "type": "integer" } } } } } }

Now, let's take a look at the core