28,99 €
Use the functionalities of Kibana to discover data and build attractive visualizations and dashboards for real-world scenarios
About This Book
Perform real-time data analytics and visualizations, on streaming data, using Kibana
Build beautiful visualizations and dashboards with simplicity and ease without any type of coding involved
Learn all the core concepts as well as detailed information about each component used in Kibana
Who This Book Is For
Whether you are new to the world of data analytics and data visualization or an expert, this book will provide you with the skills required to use Kibana with ease and simplicity for real-time data visualization of streaming data.
This book is intended for those professionals who are interested in learning about Kibana,its installations, and how to use it . As Kibana provides a user-friendly web page, no prior experience is required.
What You Will Learn
Understand the basic concepts of elasticsearch used in Kibana along with step by step guide to install Kibana in Windows and Ubuntu
Explore the functionality of all the components used in Kibana in detail, such as the Discover, Visualize, Dashboard,and Settings pages
Analyze data using the powerful search capabilities of elasticsearch
Understand the different types of aggregations used in Kibana for visualization
Create and build different types of amazing visualizations and dashboards easily
Create, save, share, embed, and customize the visualizations added to the dashboard
Customize and tweak the advanced settings of Kibana to ensure ease of use
In Detail
With the increasing interest in data analytics and visualization of large data around the globe, Kibana offers the best features to analyze data and create attractive visualizations and dashboards through simple-to-use web pages. The variety of visualizations provided, combined with the powerful underlying elasticsearch capabilities will help professionals improve their skills with this technology.
This book will help you quickly familiarize yourself to Kibana and will also help you to understand the core concepts of this technology to build visualizations easily.
Starting with setting up of Kibana and elasticsearch in Windows and Ubuntu, you will then use the Discover page to analyse your data intelligently. Next, you will learn to use the Visualization page to create beautiful visualizations without the need for any coding. Then, you will learn how to use the Dashboard page to create a dashboard and instantly share and embed the dashboards. You will see how to tweak the basic and advanced settings provided in Kibana to manage searches, visualizations, and dashboards. Finally, you will use Kibana to build visualizations and dashboards for real-world scenarios.
You will quickly master the functionalities and components used in Kibana to create amazing visualizations based on real-world scenarios. With ample screenshots to guide you through every step, this book will assist you in creating beautiful visualizations with ease.
Style and approach
This book is a comprehensive step-by-step guide to help you understand Kibana. It’s explained in an easy-to-follow style along with supporting images. Every chapter is explained sequentially , covering the basics of each component of Kibana and providing detailed explanations of all the functionalities of Kibana that appeal.
Das E-Book können Sie in Legimi-Apps oder einer beliebigen App lesen, die das folgende Format unterstützen:
Seitenzahl: 187
Veröffentlichungsjahr: 2015
Copyright © 2015 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.
Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
First published: October 2015
Production reference: 1261015
Published by Packt Publishing Ltd.
Livery Place
35 Livery Street
Birmingham B3 2PB, UK.
ISBN 978-1-78439-493-6
www.packtpub.com
Author
Yuvraj Gupta
Reviewers
Jacob Alves
Brent Ashley
David Laing
Commissioning Editor
Sarah Crofton
Acquisition Editor
Manish Nainani
Content Development Editor
Merwyn D'souza
Technical Editor
Shiny Poojary
Copy Editor
Vikrant Phadke
Project Coordinator
Neha Bhatnagar
Proofreader
Safis Editing
Indexer
Tejal Soni
Graphics
Disha Haria
Production Coordinator
Manu Joseph
Cover Work
Manu Joseph
Yuvraj Gupta holds an undergraduate degree in computer science with a specialization in cloud computing and virtualization technology from UPES, Dehradun, India. He is currently working as a big data QA engineer. He has a keen interest in big data, data analytics, and visualization, and loves to try out new technologies.
Yuvraj is an avid gadget lover and makes it a point to stay up to date with the latest happenings in the technology domain. When he is not working, he spends his time on Facebook, Quora, and Stack Overflow, and also watches and plays sports. He can be reached at <[email protected]> or on LinkedIn at https://www.linkedin.com/in/guptayuvraj.
I had never thought of writing a technical book so soon in my life. It reminds me that opportunity knocks the door only once, and I am very lucky to have the opportunity of writing this book on the essentials of Kibana. However, ability is nothing without opportunity, and I would like to thank my acquisition editor, Manish Nainani, for scouting me and believing in a first-time author to write this book. I was lucky to have such an awesome content development editor, Merwyn D'Souza, who was very helpful and patient throughout the course of writing this book. In addition, I would like to thank the reviewers and the entire team of Packt Publishing, who were involved in producing this book. Without their support, it would never have been possible.
Special thanks to my dad, Sanjay, mom, Nisha, and brother, Adhiraj, for encouraging me and believing in me. I would also like to thank all my family members—Mamu, Massi, Massad, Taujis, Taijis, and my amazing cousins—for their blessings and guidance. A special shout out to all my friends, especially the cloud computing batch of 2015 and those who have helped me directly or indirectly in writing this book. Without everyone's support, I would have never been able to write this book.
I would also like to thank my teachers, professors, gurus, schools, and university for playing an important role in providing me with the education that has helped me gain knowledge.
Last but not least, I would like to extend my gratitude towards Elastic Inc. and Rashid for developing this awesome software with amazing features. This is a small contribution from my side to the ever-growing community of Kibana, and I hope this book helps Kibana reach greater heights.
Brent Ashley has been involved in computer technology and its surrounding communities since 1979, contributing via online forums, local and international events, papers, articles, and speeches.
As a leader and mentor in the development community, he became recognized in the early 2000s as an early pioneer in the web technologies that are now known as Ajax.
For more than 20 years, he worked as an Internet infrastructure architect and consultant, gaining extensive experience with networked asset configuration, management, monitoring, and log analysis.
Brent is the associate vice president of infrastructure architecture at ControlCase, LLC (http://www.controlcase.com/), a global innovator and leader in the provision and development of services, software products, hardware appliances, and managed solutions. The company focuses on compliance regulations and standards, including PCI DSS, ISO, SOX, HIPAA and many other regulatory environments and frameworks. Brent takes a lead role in the management and expansion of their international technology infrastructure as they continue to grow.
He was also a technical reviewer on the following books:
David Laing is a long-time member of the Cloud Foundry community. He is a core contributor to BOSH and the leader of the open source Logsearch (ELK + BOSH: http://www.logsearch.io/) project, which brings log analysis to the Cloud Foundry platform using ELK. David's company, stayUp.io (http://www.stayup.io/), provides commercial support for Logsearch.
For support files and downloads related to your book, please visit www.PacktPub.com.
Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at <[email protected]> for more details.
At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.
https://www2.packtpub.com/books/subscription/packtlib
Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can search, access, and read Packt's entire library of books.
If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view 9 entirely free books. Simply use your login credentials for immediate access.
This book is dedicated to my Nanu and Nani for motivating me and for being an inspiration to me.
As big data has been trending in the industry for a while, huge amounts of data present a bigger challenge in gaining meaningful information from raw data. In today's industry, getting insights from data and making real-time decisions based on this huge data has become even more important.
Kibana provides an easy-to-use UI to perform real-time data analysis and visualizations on streaming data. It enables you to get hidden information by exploring data in different dimensions.
Making beautiful visualizations with ease without requiring any code and empowering people without technical knowledge to gather insights have never been easier.
Chapter 1, An Introduction to Kibana, takes you through the basic concepts of Elasticsearch, followed by the installation of Kibana and its prerequisite software.
Chapter 2, Exploring the Discover Page, covers the functionality of various components, along with detailed explanations of the usage of each component and its options.
Chapter 3, Exploring the Visualize Page, teaches you to create different types of visualizations using aggregations to visualize data.
Chapter 4, Exploring the Dashboard Page, covers the functionality of the various components present on the Dashboard page, followed by creating and embedding dashboards.
Chapter 5, Exploring the Settings Page, demonstrates the usage and tweaking of basic and advanced settings provided in Kibana.
Chapter 6, Real-Time Twitter Data Analysis, shows you how to analyze Twitter data and create visualizations based on different scenarios. This chapter also covers the workflow for analyzing Twitter data.
Appendix, References, contains a chapterwise segregation of the links and references used in the chapters.
The following pieces of software are required:
All of the software mentioned in this book is free of charge and can be downloaded from the Internet.
Whether you are new to the world of data analytics and data visualization, or an expert, this book will provide you with the skills required to use Kibana for real-time visualization of streaming data with ease and simplicity. This book is intended for those professionals who are interested in learning about Kibana, about its installations, and how to use it. As Kibana provides a user-friendly web page, no prior experience is required.
In this book, you will find a number of text styles that distinguish between different kinds of information. Here are some examples of these styles and an explanation of their meaning.
Code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles are shown as follows: "Windows user can open the elasticsearch.yml file from the config folder."
A block of code is set as follows:
Any command-line input or output is written as follows:
Any hyperlink is written as follows:
https://github.com/guptayuvraj/Kibana_Essentials
New terms and important words are shown in bold. Words that you see on the screen, for example, in menus or dialog boxes, appear in the text like this: "Finally, click on Create to create the index in Kibana."
Warnings or important notes appear in a box like this.
Tips and tricks appear like this.
Feedback from our readers is always welcome. Let us know what you think about this book—what you liked or disliked. Reader feedback is important for us as it helps us develop titles that you will really get the most out of.
To send us general feedback, simply e-mail <[email protected]>, and mention the book's title in the subject of your message.
If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, see our author guide at www.packtpub.com/authors.
Now that you are the proud owner of a Packt book, we have a number of things to help you to get the most from your purchase.
We also provide you with a PDF file that has color images of the screenshots/diagrams used in this book. The color images will help you better understand the changes in the output. You can download this file from https://www.packtpub.com/sites/default/files/downloads/4936OS_ColoredImages.pdf.
Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you find a mistake in one of our books—maybe a mistake in the text or the code—we would be grateful if you could report this to us. By doing so, you can save other readers from frustration and help us improve subsequent versions of this book. If you find any errata, please report them by visiting http://www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details of your errata. Once your errata are verified, your submission will be accepted and the errata will be uploaded to our website or added to any list of existing errata under the Errata section of that title.
To view the previously submitted errata, go to https://www.packtpub.com/books/content/support and enter the name of the book in the search field. The required information will appear under the Errata section.
Piracy of copyrighted material on the Internet is an ongoing problem across all media. At Packt, we take the protection of our copyright and licenses very seriously. If you come across any illegal copies of our works in any form on the Internet, please provide us with the location address or website name immediately so that we can pursue a remedy.
Please contact us at <[email protected]> with a link to the suspected pirated material.
We appreciate your help in protecting our authors and our ability to bring you valuable content.
If you have a problem with any aspect of this book, you can contact us at <[email protected]>, and we will do our best to address the problem.
Kibana is a tool that is part of the ELK stack, which consists of Elasticsearch, Logstash, and Kibana. It is built and developed by Elastic. Kibana is a visualization platform that is built on top of Elasticsearch and leverages the functionalities of Elasticsearch.
To understand Kibana better, let's check out the following diagram:
This diagram shows that Logstash is used to push data directly into Elasticsearch. This data is not limited to log data, but can include any type of data. Elasticsearch stores data that comes as input from Logstash, and Kibana uses the data stored in Elasticsearch to provide visualizations. So, Logstash provides an input stream of data to Elasticsearch, from which Kibana accesses the data and uses it to create visualizations.
Kibana acts as an over-the-top layer of Elasticsearch, providing beautiful visualizations for data (structured or nonstructured) stored in it. Kibana is an open source analytics product used to search, view, and analyze data. It provides various types of visualizations to visualize data in the form of tables, charts, maps, histograms, and so on. It also provides a web-based interface that can easily handle a large amount of data. It helps create dashboards that are easy to create and helps query data in real time. Dashboards are nothing but an interface for underlying JSON documents. They are used for saving, templating, and exporting. They are simple to set up and use, which helps us play with data stored in Elasticsearch in minutes without requiring any coding.
Kibana is an Apache-licensed product that aims to provide a flexible interface combined with the powerful searching capabilities of Elasticsearch. It requires a web server (included in the Kibana 4 package) and any modern web browser, that is, a browser that supports industry standards and renders the web page in the same way across all browsers, to work. It connects to Elasticsearch using the REST API. It helps to visualize data in real time with the use of dashboards to provide real-time insights.
In this book, we will use Kibana 4.1.1, which is the latest version of Kibana. It provides a lot of features compared to Kibana 3.
As Kibana uses the functionalities of Elasticsearch, it is easier to learn Kibana by understanding the core functionalities of Elasticsearch. In this chapter, we are going to take a look at the following topics:
Elasticsearch is a search server built on top of Lucene (licensed under Apache), which is completely written in Java. It supports distributed searches in a multitenant environment. It is a scalable search engine allowing high flexibility of adding machines easily. It provides a full-text search engine combined with a RESTful web interface and JSON documents. Elasticsearch harnesses the functionalities of Lucene Java Libraries, adding up by providing proper APIs, scalability, and flexibility on top of the Lucene full-text search library. All querying done using Elasticsearch, that is, searching text, matching text, creating indexes, and so on, is implemented by Apache Lucene.
Without a setup of an Elastic shield or any other proxy mechanism, any user with access to Elasticsearch API can view all the data stored in the cluster.
Let's explore some of the basic concepts of Elasticsearch:
In the preceding example, we can see that the document supports JSON, having key-value pairs, which are explained as follows:
Now, let's take a look at the core