Infrastructure Monitoring with Amazon CloudWatch E-Book

Ewere Diagboya

• Herausgeber: Packt Publishing
• Kategorie: Fachliteratur
• Sprache: Englisch

Seitenzahl: 371

Veröffentlichungsjahr: 2021

Beschreibung

CloudWatch is Amazon’s monitoring and observability service, designed to help those in the IT industry who are interested in optimizing resource utilization, visualizing operational health, and eventually increasing infrastructure performance. This book helps IT administrators, DevOps engineers, network engineers, and solutions architects to make optimum use of this cloud service for effective infrastructure productivity.
You’ll start with a brief introduction to monitoring and Amazon CloudWatch and its core functionalities. Next, you’ll get to grips with CloudWatch features and their usability. Once the book has helped you develop your foundational knowledge of CloudWatch, you’ll be able to build your practical skills in monitoring and alerting various Amazon Web Services, such as EC2, EBS, RDS, ECS, EKS, DynamoDB, AWS Lambda, and ELB, with the help of real-world use cases. As you progress, you'll also learn how to use CloudWatch to detect anomalous behavior, set alarms, visualize logs and metrics, define automated actions, and rapidly troubleshoot issues. Finally, the book will take you through monitoring AWS billing and costs.
By the end of this book, you'll be capable of making decisions that enhance your infrastructure performance and maintain it at its peak.

Leseprobe

Infrastructure Monitoring with Amazon CloudWatch

Effectively monitor your AWS infrastructure to optimize resource allocation, detect anomalies, and set automated actions

Ewere Diagboya

BIRMINGHAM—MUMBAI

Infrastructure Monitoring with Amazon CloudWatch

Copyright © 2021 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

Group Product Manager: Wilson D'souza

Publishing Product Manager: Shrilekha Inani

Senior Editor: Shazeen Iqbal

Content Development Editor: Romy Dias

Technical Editor: Shruthi Shetty

Copy Editor: Safis Editing

Project Coordinator: Neil Dmello

Proofreader: Safis Editing

Indexer: Manju Arasan

Production Designer: Shankar Kalbhor

First published: March 2021

Production reference: 1160321

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham

B3 2PB, UK.

ISBN 978-1-80056-605-7

www.packt.com

This book to dedicated to my late father, Mr. Patrick Nwose Diagboya, who was my mentor in knowledge acquisition.

Contributors

About the author

Ewere Diagboya is a technology lover at heart who started his journey into technology back in 2003. At an early age, he finished mastering Windows 98 applications. He learned coding in Visual Basic 6.0 with the help of his brother.

Afterward, he mastered other programming languages, building both desktop and web applications. Ewere moved into cloud computing and DevOps and has been practicing, training, and mentoring for close to a decade now.

He worked closely with other like minds to start the AWS User Group in Nigeria and fostered DevOps Nigeria Group vibrancy. In 2020 he was awarded the first AWS Community Hero award in Africa. Ewere also runs a training institute and has a blog on Medium where he writes about cloud computing and DevOps.

About the reviewer

Michael J. Lewis is currently a Principal in the cloud enablement practice at Slalom Consulting in Atlanta, Georgia, specializing in AWS, and DevSecOps. A computer science major and a US naval submarine veteran with over 25 years' experience in the computer industry, he has been at the forefront of emerging technologies, from the internet boom of the 90s to the latest trends in serverless and cloud computing. He and his wife Julie reside in Georgia with their three wonderful children.

Table of Contents

Preface

Section 1: Introduction to Monitoring and Amazon CloudWatch

Chapter 1: Introduction to Monitoring

Technical requirements

Introducing monitoring

The history of monitoring

Discovering the types of monitoring

Proactive monitoring

Reactive monitoring

Understanding the components of monitoring

Alerts/notifications

Events

Logging

Metrics

System availability

Dashboard

Incidents

Realizing when things go south

Ability to debug

Gaining insight

Sending data/notifications to other systems

Controlling CapEX to run cloud infrastructure

Getting to know Amazon CloudWatch

Introducing the relationship between Amazon CloudWatch and Well-Architected

Summary

Questions

Further reading

Chapter 2: CloudWatch Events and Alarms

Technical requirements

Introducing CloudWatch Events and Amazon EventBridge

Amazon EventBridge

Understanding the components of a CloudWatch event

Input trigger

Rules/event pattern

Target

Configuring a basic CloudWatch event

Introducing CloudWatch alarms

Importance of a CloudWatch alarm

Configuring a basic alarm

Summary

Questions

Further reading

Chapter 3: CloudWatch Logs, Metrics, and Dashboards

Technical requirements

Introducing CloudWatch Logs

Life cycle of a log

Understanding the components of CloudWatch Logs

Configuring a basic CloudWatch agent

Understanding metrics and CloudWatch metrics

Terms associated with CloudWatch metrics

Creating a metric filter from CloudWatch Logs

Working with dashboards

Summary

Questions

Further reading

Section 2: AWS Services and Amazon CloudWatch

Chapter 4: Monitoring AWS Compute Services

Technical requirements

Understanding the fundamentals of IaaS monitoring

Understanding CPU in IaaS

Understanding memory in IaaS

Understanding the disk in IaaS

Collecting custom metrics on EC2

Using a unified CloudWatch agent

Creating an Amazon EventBridge for Amazon EC2

Monitoring Elastic Beanstalk workloads

Monitoring AWS Batch

Case study on CloudWatch custom metrics

Solution

Summary

Questions

Further reading

Chapter 5: Setting Up Container Insights on Amazon CloudWatch

Technical requirements

Introducing the concept of containers

Orchestrating container services in AWS

Overviewing Amazon ECS

Overviewing Amazon EKS

Triggering ECS events on Amazon EventBridge

Configuring CloudWatch Container Insights

Why activate Container Insights?

Activating Container Insights for ECS

Collecting logs for ECS applications

Monitoring of EKS applications and services

Monitoring the control plane

Collecting logs for EKS resources

Setting up custom dashboards and metrics for containers

Case study of Amazon EKS logging and monitoring

Solution

Summary

Questions

Further reading

Chapter 6: Performance Insights for Database Services

Technical requirements

Introduction to database management

Understanding the different types of AWS database technologies

RDS

DynamoDB

ElastiCache

Amazon DocumentDB

Configuring metric monitoring in RDS

Logging operations in Amazon DynamoDB

Monitoring events in ElastiCache

Monitoring Redshift and Amazon DocumentDB cluster status

Monitoring Redshift

Monitoring an Amazon DocumentDB cluster

Case study on monitoring an RDS database

Solution

Summary

Questions

Further reading

Chapter 7: Monitoring Serverless Applications

Technical requirements

Introduction to serverless

Differentiating between serverless and managed services

Monitoring Lambda function metrics with Amazon CloudWatch

Endpoint monitoring for API Gateway and other applications

Monitoring SQS and SNS on Amazon CloudWatch

Monitoring Step Functions using CloudWatch alarms

Case study on Lambda tracing with Amazon X-Ray

Solution

Summary

Questions

Further reading

Chapter 8: Using CloudWatch for Maintaining Highly Available Big Data Services

Technical requirements

Introduction to big data

Properties of big data

Overviewing the aspects of big data

Extraction

Transformation

Loading

Monitoring Amazon Kinesis agent/service

Analyzing Amazon CloudTrail with Amazon Athena

Monitoring AWS Glue jobs with CloudWatch alarms

Case study on monitoring a Kinesis stream

Solution

Summary

Questions

Further reading

Chapter 9: Monitoring Storage Services with Amazon CloudWatch

Technical requirements

Understanding storage devices

EBS

S3

EFS

Monitoring Amazon EBS volume metrics

Understanding the performance metrics of Amazon EFS on CloudWatch

Monitoring of Amazon FSx

Understanding CloudWatch metrics on Amazon S3

Case study regarding a consolidated EBS volume dashboard

Solution

Summary

Questions

Further reading

Chapter 10: Monitoring Network Services

Technical requirements

Introduction to computer networking

Understanding a few common networking terms

Exploring AWS networking services

Monitoring Amazon VPC flow logs

Understanding the behavior of a load balancer with status metrics

Application observability with App Mesh and Cloud Map

AWS Cloud Map

Configuring logging in Amazon Route 53

Case study on VPC analysis

Solution

Summary

Questions

Further reading

Chapter 11: Best Practices and Conclusion

Best methods used in monitoring

Automate everything

Audit monitoring configurations from time to time

Measuring workload performance

Ensuring important metrics go with alarms

An explanation of CloudWatch billing

Summarizing everything learned so far

Summary

Assessments

Other Books You May Enjoy

Section 1: Introduction to Monitoring and Amazon CloudWatch

This part is focused on introducing the concepts of monitoring, logging, metrics, and alerts in a monitoring system. It will also explain the importance of monitoring infrastructure and applications and the advantages of using CloudWatch as a managed service for collecting metrics and alerting.

The following chapters are included in this section:

Chapter 1, Introduction to MonitoringChapter 2, CloudWatch Events and AlarmsChapter 3, CloudWatch Logs, Metrics, and Dashboards