Pentaho Data Integration Quick Start Guide - María Carina Roldán - E-Book

Pentaho Data Integration Quick Start Guide E-Book

Maria Carina Roldan

0,0
23,99 €

-100%
Sammeln Sie Punkte in unserem Gutscheinprogramm und kaufen Sie E-Books und Hörbücher mit bis zu 100% Rabatt.

Mehr erfahren.
Beschreibung

Pentaho Data Integration(PDI) is an intuitive and graphical environment packed with drag and drop design and powerful Extract-Transform-Load (ETL) capabilities. Given its power and flexibility, initial attempts to use the Pentaho Data Integration tool can be difficult or confusing. This book is the ideal solution.

This book reduces your learning curve with PDI. It provides the guidance needed to make you productive, covering the main features of Pentaho Data Integration. It demonstrates the interactive features of the graphical designer, and takes you through the main ETL capabilities that the tool offers.

By the end of the book, you will be able to use PDI for extracting, transforming, and loading the types of data you encounter on a daily basis.

Das E-Book können Sie in Legimi-Apps oder einer beliebigen App lesen, die das folgende Format unterstützen:

EPUB
MOBI

Seitenzahl: 141

Veröffentlichungsjahr: 2018

Bewertungen
0,0
0
0
0
0
0
Mehr Informationen
Mehr Informationen
Legimi prüft nicht, ob Rezensionen von Nutzern stammen, die den betreffenden Titel tatsächlich gekauft oder gelesen/gehört haben. Wir entfernen aber gefälschte Rezensionen.



Pentaho Data Integration Quick Start Guide

 

 

 

 

 

 

 

 

 

 

 

 

Create ETL processes using Pentaho

 

 

 

 

 

 

 

 

 

 

María Carina Roldán

 

 

 

 

 

 

 

 

 

 

BIRMINGHAM - MUMBAI

Pentaho Data Integration Quick Start Guide

Copyright © 2018 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

Commissioning Editor: Amey VarangaonkarAcquisition Editor: Siddharth MandalContent Development Editor: Kirk DsouzaTechnical Editor: Jinesh TopiwalaCopy Editor:Safis EditingProject Coordinator: Hardik BhindeProofreader: Safis EditingIndexer: Rekha NairGraphics: Jason MonteiroProduction Coordinator: Shantanu Zagade

First published: August 2018

Production reference: 1280818

Published by Packt Publishing Ltd. Livery Place 35 Livery Street Birmingham B3 2PB, UK.

ISBN 978-1-78934-332-8

www.packtpub.com

To my lovely kids.
                                                                                                                                                                                                                                                            – María Carina Roldán
 
mapt.io

Mapt is an online digital library that gives you full access to over 5,000 books and videos, as well as industry leading tools to help you plan your personal development and advance your career. For more information, please visit our website.

Why subscribe?

Spend less time learning and more time coding with practical eBooks and Videos from over 4,000 industry professionals

Improve your learning with Skill Plans built especially for you

Get a free eBook or video every month

Mapt is fully searchable

Copy and paste, print, and bookmark content

PacktPub.com

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.PacktPub.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at [email protected] for more details.

At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters, and receive exclusive discounts and offers on Packt books and eBooks. 

Foreword

María Carina started writing her first books for Kettle (aka Pentaho Data Integration or PDI) beginners almost 10 years ago. Since then, the Kettle project and its community have been growing quickly and certainly; since those early days, the number of possibilities with the tool have been exploding. In certain ways, the graphical user interfaces have become much better, but the sheer power of doing all sorts of complex data integration tasks can been daunting to people who are just getting started. Books like the one you're reading now are excellent in giving you a leg up.

We also need books like this one because the world of information technology is changing ever faster in directions we scarcely could have predicted a decade ago. Cloud, big data, Streaming, NoSQL, the technological evolutions seem to come faster and faster, and the data contained in it needs to get integrated somehow. This book will get you closer to solving gnarly problems a lot faster.

Kettle is a tool with very few limitations living on the bleeding edge of a lot of technologies, and people have been telling me over the years how liberating that is as compared to other software that constantly needs to tell you how to accomplish certain tasks. This freedom is meant to allow us to do complex data integration work and never get stuck and always find a way to get the job done, no matter how hard that is. With this book, getting started in this complexity is not daunting anymore; it's fun. I'm so very happy that María Carina decided to write this book, and I'm wishing you a lot of fun on the path to success that she's putting you on.

 

Matt Casters Kettle project founder Chief Solutions Architect at Neo4j

Contributors

About the author

María Carina Roldán was born in Argentina and has a bachelor's degree in computer science.

She started working with Pentaho back in 2006. She spent all these years developing BI solutions, mainly as an ETL specialist, and working for different companies around the world.

Currently, she lives in Buenos Aires and works as an independent consultant. Carina is the author of Learning Pentaho Data Integration 8 CE, published by Packt in December 2017. She has also authored other books on Pentaho, all of them published by Packt.

I'd like to thank all my friends who support my work, the technical reviewers for their time and dedication, and the readers who have trusted me through the years.

About the reviewer

Sahil Goyal is a developer residing in Hyderabad, India. He is an online trainer and consultant, teaching ETL development and SQL development to working professionals and students. Sahil has a keen interest in Pentaho Data Integration ETL development and has been working on it for several years in multiple contexts (consulting, freelancing, and contracting) and countries (India, the USA, Malaysia, and Spain), which has added professional value and experience to his career.

He is currently working for a multinational corporation based in Belgium as a data integration developer.

Thanks to my friends and family for their support and patience during those long working days. Especially to my mother, who always has a smile for me and has been by my side throughout my career to date.

 

 

 

Packt is searching for authors like you

If you're interested in becoming an author for Packt, please visit authors.packtpub.com and apply today. We have worked with thousands of developers and tech professionals, just like you, to help them share their insight with the global tech community. You can make a general application, apply for a specific hot topic that we are recruiting an author for, or submit your own idea.

Table of Contents

Title Page

Copyright and Credits

Pentaho Data Integration Quick Start Guide

Dedication

Packt Upsell

Why subscribe?

PacktPub.com

Foreword

Contributors

About the author

About the reviewer

Packt is searching for authors like you

Preface

Who this book is for

What this book covers

To get the most out of this book

Download the example code files

Download the color images

Conventions used

Get in touch

Reviews

Getting Started with PDI

Introducing PDI

Installing PDI

Configuring the graphical designer tool

Creating a simple transformation

Understanding the Kettle home directory

Summary

Getting Familiar with Spoon

Exploring the Spoon interface

Designing, previewing, and running transformations

Designing and previewing a transformation

Understanding the logging options

Understanding the Step Metrics tab

Dealing with errors while designing

Saving and running a transformation

Defining and using Kettle variables

Using named parameters

Running transformations with the Pan utility

Summary

Extracting Data

Getting data from plain files

Reading plain files

Reading files with great versatility

Reading files from remote locations

Reading files from Google Drive

Getting data from relational databases

Connecting to a database and using the database explorer

Getting data from a database

Getting data from other sources

XML and JSON

System information and Kettle variables

Combining different sources into a single dataset

Manipulating the metadata

Combining two different datasets into a single dataset

Summary

Transforming Data

Transforming data in different ways

Extracting data from existing fields

More ways to create new fields

Sorting and aggregating data

Sorting data

Aggregating data

Filtering rows

Filtering rows upon conditions

Splitting the stream upon conditions

Looking up for data

Looking for data in a secondary stream

Looking up data in a database

Summary

Loading Data

Generating different kinds of files

Inserting and updating data in database tables

Inserting data

Updating data

Handling errors

Loading a datamart

Loading a time dimension

Loading other kinds of dimensions

Loading a dimension with a combination lookup/update step

Loading a dimension with a dimension lookup/update step

Loading a fact table

Summary

Orchestrating Your Work

Understanding the purpose of PDI jobs

Designing and running jobs

Creating and running a simple job 

Understanding the results of execution

Sequencing tasks

Taking a tour of the job entries

Sending emails

Combining the execution of jobs and transformations

Executing transformations from a job

Creating user-defined Kettle variables

Nesting transformations and jobs

Running jobs with the Kitchen utility

Summary

Other Books You May Enjoy

Leave a review - let other readers know what you think

Preface

Pentaho Data Integration Quick Start Guide provides the guidance needed to get started with Pentaho Data Integration (PDI), covering the main features of the tool. The book shows the interactive features of the graphical designer, and explains the main ETL capabilities that the tool offers.

The book's content is based on PDI 8.1 Community Edition (CE), the latest version. However, it can be used with the Enterprise Edition (EE) as well. Many of the examples will also work with earlier versions of PDI.

Who this book is for

This book is a helpful guide for software developers, business intelligence analysts, IT students, and everyone involved or interested in developing ETL solutions, or more generally in performing any kind of data manipulation.

What this book covers

Chapter 1, Getting Started with PDI, presents the tool. This chapter includes instructions for installing PDI and gives you the opportunity to explore and configure the graphical designer (Spoon).

Chapter 2, Getting Familiar with Spoon, explains the fundamentals of working with Spoon by designing, debugging, and testing a transformation.

Chapter 3, Extracting Data, discusses getting and combining data from different sources. In particular, this chapter explains how to get data from files and databases.

Chapter 4, Transforming Data, explains how to transform data in many ways. Also, it explains how to get system information and predefined variables to be used as part of the data flow.

Chapter 5, Loading Data, explains how to save the output of transformations into files and databases. In addition, it explains how to load data into a datamart.

Chapter 6, Orchestrating your Work, shows how to organize your work through simple PDI jobs. You will learn how to use jobs to sequence tasks, deal with files, send emails, run DDL, and to carry out other useful tasks.

To get the most out of this book

PDI is a multiplatform tool, meaning that it can be installed and used under any operating system. The only prerequisite is to have JVM 1.8 installed. You will also need a good text editor, for example, Sublime III or Notepad ++. It's also recommended that you have access to a relational database. The examples in the book were built with PostgreSQL syntax, but you can adapt them to any other engine, as soon as there is a JDBC driver for it.Throughout the chapters, several internet links are provided to complement what is explained. Therefore, having an internet connection while reading is highly recommended.

Download the example code files

You can download the example code files for this book from your account at www.packtpub.com. If you purchased this book elsewhere, you can visit www.packtpub.com/support and register to have the files emailed directly to you.

You can download the code files by following these steps:

Log in or register at

www.packtpub.com

.

Select the

SUPPORT

tab.

Click on

Code Downloads & Errata

.

Enter the name of the book in the

Search

box and follow the onscreen instructions.

Once the file is downloaded, please make sure that you unzip or extract the folder using the latest version of:

WinRAR/7-Zip for Windows

Zipeg/iZip/UnRarX for Mac

7-Zip/PeaZip for Linux

The code bundle for the book is also hosted on GitHub at https://github.com/PacktPublishing/Pentaho-Data-Integration-Quick-Start-Guide. In case there's an update to the code, it will be updated on the existing GitHub repository.

We also have other code bundles from our rich catalog of books and videos available at https://github.com/PacktPublishing/. Check them out!

Download the color images

We also provide a PDF file that has color images of the screenshots/diagrams used in this book. You can download it here: http://www.packtpub.com/sites/default/files/downloads/PentahoDataIntegrationQuickStartGuide_ColorImages.pdf.

Get in touch

Feedback from our readers is always welcome.

General feedback: Email [email protected] and mention the book title in the subject of your message. If you have questions about any aspect of this book, please email us at [email protected].

Errata: Although we have taken every care to ensure the accuracy of our content, mistakes do happen. If you have found a mistake in this book, we would be grateful if you would report this to us. Please visit www.packtpub.com/submit-errata, selecting your book, clicking on the Errata Submission Form link, and entering the details.

Piracy: If you come across any illegal copies of our works in any form on the Internet, we would be grateful if you would provide us with the location address or website name. Please contact us at [email protected] with a link to the material.

If you are interested in becoming an author: If there is a topic that you have expertise in and you are interested in either writing or contributing to a book, please visit authors.packtpub.com.

Reviews

Please leave a review. Once you have read and used this book, why not leave a review on the site that you purchased it from? Potential readers can then see and use your unbiased opinion to make purchase decisions, we at Packt can understand what you think about our products, and our authors can see your feedback on their book. Thank you!

For more information about Packt, please visit packtpub.com.

Getting Started with PDI

Pentaho Data Integration (PDI) is a popular business intelligence tool, used for exploring, transforming, validating, and migrating data, along with other useful operations