OpenStack Sahara Essentials - Omar Khedher - E-Book

OpenStack Sahara Essentials E-Book

Omar Khedher

0,0
34,79 €

-100%
Sammeln Sie Punkte in unserem Gutscheinprogramm und kaufen Sie E-Books und Hörbücher mit bis zu 100% Rabatt.

Mehr erfahren.
Beschreibung

Integrate, deploy, rapidly configure, and successfully manage your own big data-intensive clusters in the cloud using OpenStack Sahara

About This Book

  • A fast paced guide to help you utilize the benefits of Sahara in OpenStack to meet the Big Data world of Hadoop.
  • A step by step approach to simplify the complexity of Hadoop configuration, deployment and maintenance.

Who This Book Is For

This book targets data scientists, cloud developers and Devops Engineers who would like to become proficient with OpenStack Sahara. Ideally, this book is well suitable for readers who are familiars with databases, Hadoop and Spark solutions. Additionally, a basic prior knowledge of OpenStack is expected. The readers should also be familiar with different Linux boxes, distributions and virtualization technology.

What You Will Learn

  • Integrate and Install Sahara with OpenStack environment
  • Learn Sahara architecture under the hood
  • Rapidly configure and scale Hadoop clusters on top of OpenStack
  • Explore the Sahara REST API to create, deploy and manage a Hadoop cluster
  • Learn the Elastic Processing Data (EDP) facility to execute jobs in clusters from Sahara
  • Cover other Hadoop stable plugins existing supported by Sahara
  • Discover different features provided by Sahara for Hadoop provisioning and deployment
  • Learn how to troubleshoot OpenStack Sahara issues

In Detail

The Sahara project is a module that aims to simplify the building of data processing capabilities on OpenStack.

The goal of this book is to provide a focused, fast paced guide to installing, configuring, and getting started with integrating Hadoop with OpenStack, using Sahara.

The book should explain to users how to deploy their data-intensive Hadoop and Spark clusters on top of OpenStack. It will also cover how to use the Sahara REST API, how to develop applications for Elastic Data Processing on Openstack, and setting up hadoop or spark clusters on Openstack.

Style and approach

This book takes a step by step approach teaching how to integrate, deploy and manage data using OpenStack Sahara. It will teach how the OpenStack Sahara is beneficial by simplifying the complexity of Hadoop configuration, deployment and maintenance.

Sie lesen das E-Book in den Legimi-Apps auf:

Android
iOS
von Legimi
zertifizierten E-Readern

Seitenzahl: 156

Veröffentlichungsjahr: 2016

Bewertungen
0,0
0
0
0
0
0
Mehr Informationen
Mehr Informationen
Legimi prüft nicht, ob Rezensionen von Nutzern stammen, die den betreffenden Titel tatsächlich gekauft oder gelesen/gehört haben. Wir entfernen aber gefälschte Rezensionen.



Table of Contents

OpenStack Sahara Essentials
Credits
About the Author
About the Reviewer
www.PacktPub.com
eBooks, discount offers, and more
Why subscribe?
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Errata
Piracy
Questions
1. The Essence of Big Data in the Cloud
It is all about data
The dimensions of big data
The big challenge of big data
The revolution of big data
A key of big data success
Use case: Elastic MapReduce
OpenStack crossing big data
Sahara: bringing big data to the cloud
Sahara in OpenStack
The Sahara OpenStack mission
The Sahara's architecture
Summary
2. Integrating OpenStack Sahara
Preparing the test infrastructure environment
OpenStack test topology environment
OpenStack test networking layout
OpenStack test environment design
Installing OpenStack
Network requirements
System requirements
Running the RDO installation
Integrating Sahara
Installing and configuring OpenStack Sahara
Installing the Sahara user interface
Summary
3. Using OpenStack Sahara
Planning a Hadoop deployment
Assigning Hadoop nodes
Sahara provisioning plugins
Creating a Hadoop cluster
Preparing the image from Horizon
Preparing the image using CLI
Creating the Node Group Template
Creating the Node Group Template in Horizon
Creating a Node Group Template using CLI
Creating the Node Cluster Template
Creating the Node Cluster Template with Horizon
Creating the Node Cluster Template using CLI
Launching the Hadoop cluster
Launching the Hadoop cluster with Horizon
Launching the Hadoop cluster using the CLI
Summary
4. Executing Jobs with Sahara
Job glossary in Sahara
Job binaries in Sahara
Jobs in Sahara
Running jobs in Sahara
Executing jobs via Horizon
Executing jobs using the Sahara RESTful API
API authentication
Launching an EDP job
Registering a Spark image using REST API
Creating Spark node group templates
Creating a Spark cluster template
Launching the Spark cluster
Creating a job binary
Creating a Spark job template
Executing the Spark job
Extending the Spark job
Summary
5. Discovering Advanced Features with Sahara
Sahara plugins
Vanilla Apache Hadoop
Building an image for the Apache Vanilla plugin
Vanilla Apache requirements and limitations
Hortonworks Data Platform plugin
Building an image for the HDP plugin
HDP requirements and limitations
Cloudera Distribution Hadoop plugin
Building an image for the CDH plugin
CDH requirements and limitations
Apache Spark plugin
Building an image for the Spark plugin
Spark requirements and limitations
Affinity and anti-affinity
Anti-affinity in action
Boosting Elastic Data Processing performance
Defining the network
Increasing data reliability
Summary
6. Hadoop High Availability Using Sahara
HDP high-availability support
Minimum requirements for the HA Hadoop cluster in Sahara
HA Hadoop cluster templates
CDH high-availability support
Summary
7. Troubleshooting
Troubleshooting OpenStack
OpenStack debug tool
Troubleshooting SELinux
Troubleshooting identity
Troubleshooting networking
Troubleshooting data processing
Debugging Sahara
Logging Sahara
Troubleshooting missing services
Troubleshooting cluster creation
Troubleshooting user quota
Troubleshooting cluster scaling
Troubleshooting cluster access
Summary
Index

OpenStack Sahara Essentials

OpenStack Sahara Essentials

Copyright © 2016 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: April 2016

Production reference: 1200416

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham B3 2PB, UK.

ISBN 978-1-78588-596-9

www.packtpub.com

Credits

Author

Omar Khedher

Reviewer

Ami Shmueli

Acquisition Editor

Nitin Dasan

Content Development Editor

Abhishek Jadhav

Technical Editor

Nirant Carvalho

Copy Editors

Madhusudan Uchil

Jonathan Todd

Project Coordinator

Judie Jose

Proofreader

Safis Editing

Indexer

Priya Sane

Graphics

Kirk D'Penha

Production Coordinator

Shantanu N. Zagade

Cover Work

Shantanu N. Zagade

About the Author

Omar Khedher is a systems and network engineer. He worked for a few years in cloud computing environments and was involved in several private cloud projects based on OpenStack. Leveraging his skills as a system administrator in virtualisation, storage, and networking, he works as cloud system engineer for a leading advertising technology company, Fyber, based in Berlin. Currently, together with several highly skilled professional teams in the market, they collaborate to build a high scalable infrastructure based on the cloud platform.

Omar is also the author of another OpenStack book, Mastering OpenStack, Packt Publishing. He has authored also few academic publications based on new researches for the cloud performance improvement.

I would like to dedicate this book to my lovely parents, my brothers, and my dear 'schat', who have supported me remotely throughout the writing of this book. Big thanks go out to my PhD supervisor Dr. Mohamed in KSA, to my professional friend Andre Van De Water , to Belgacem in Tunisia for their guidance and critique and to my colleagues at Fyber for sharing knowledge. I extend a special thanks to Kenji Shioda for providing resources in his cloud platform to make the book labs happen. I would like to thank all the reviewers of this book for their accurate notices and precious remarks. A thank you to Abhishek Jadhav for the continued and great work on this book, which has taken a good piece of work. And with no doubt, a great thanks to the immense work provided by the OpenStack community to deliver such an amazing project, Sahara, that empowers the OpenStack journey.

About the Reviewer

Ami Shmueli has 18 years of experience in IT, System, DevOps, Automation.

He fulfilled different roles over those years as Infrastructure manager, Technical product manager, DevOps leader, and other technical and managerial roles.

He has vast experience in cloud design and architecture for telco enterprises and financial companies.

Ami has a proven experience in both R&D and infrastructure domains. Currently, Ami is involved in building high-scale on-premise clouds based on OpenStack as well as leading several application modernization projects on top of AWS, Azure, and SoftLayer.

www.PacktPub.com

eBooks, discount offers, and more

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at <[email protected]> for more details.

At www.PacktPub.com