Got a question? Call +632 8244 2098   |   
Contact usCheckoutContact us
Big Data on AWS
Cloud Computing and Virtualisation

Big Data on AWS

  • Length 3 days
Course overview
View dates &
book now
  • Register interest

Why study this course

Big Data on AWS introduces you to cloud-based big data solutions such as Amazon Elastic MapReduce (EMR), Amazon Redshift, Amazon Kinesis and the rest of the AWS big data platform.

Learn to use Amazon EMR to process data using the broad ecosystem of Hadoop tools like Hive and Hue, create big data environments, work with Amazon DynamoDB, Amazon Redshift, Amazon QuickSight, Amazon Athena and Amazon Kinesis, and design big data environments for security and cost-effectiveness.

This course is delivered through a mix of instructor-led training (ILT) and hands-on labs.

Please note: students are required to bring their own laptop/tablet and power cable for this course.

Aligns to certification

Request Course Information

By submitting an enquiry, you agree to our privacy policy and receiving email and other forms of communication from us. You can opt-out at any time.

What you’ll learn

In this course, participants will learn how to:

  • Use Apache Hadoop with Amazon EMR

  • Launch and configure an Amazon EMR cluster

  • Use common programming frameworks for Amazon EMR, including Hive, Pig, and Streaming

  • Use Hue to improve the ease-of-use of Amazon EMR

  • Use in-memory analytics with Spark on Amazon EMR

  • Understand how services like AWS Glue, Amazon Kinesis, Amazon Redshift, Amazon Athena, and Amazon QuickSight can be used with big data workloads

AWS at DDLS

DDLS is an official AWS Training Partner for the Australian and Philippines region. Through our Authorised AWS Instructors, we can provide you with a learning path that’s relevant to you and your organisation, so you can get more out of the cloud. We offer virtual and face-to-face classroom-based training to help you build your cloud skills and enable you to achieve industry-recognised AWS Certification.

View all AWS courses

Stay ahead of the technology curve

Don’t let your tech outpace the skills of your people

Get in touch today
Quality instructors and content

Expert instructors with real world experience and the latest vendor- approved in-depth course content.

Partner-Preferred Supplier

Chosen and awarded by the world’s leading vendors as preferred training partner.

Ahead of the technology curve

No matter your chosen technologies or platforms, we can help you stay one step ahead.

Who is the course for?

This course is intended for:

  • Individuals responsible for designing and implementing big data solutions, namely Solutions Architects and SysOps Administrators

  • Data Scientists and Data Analysts interested in learning about big data solutions on AWS

We can also deliver and customise this training course for larger groups – saving your organisation time, money and resources. For more information, please contact us via email on ph.training@ddls.com.ph

.

Course subjects

Module 1: Overview of Big Data

  • What is big data

  • The big data pipeline

  • Big data architectural principals

Module 2: Big Data ingestion and transfer

  • Overview: Data ingestion

  • Transferring data

Module 3: Big data streaming and Amazon Kinesis

  • Stream processing of big data

  • Amazon Kinesis

  • Amazon Kinesis Data Firehose

  • Amazon Kinesis Video Streams

  • Amazon Kinesis Data Analytics

  • Hands-on lab 1: Streaming and Processing Apache Server Logs Using Amazon Kinesis

Module 4: Big data storage solutions

  • AWS data storage options

  • Storage solutions concepts

  • Factors in choosing a data store

Module 5: Big data processing and analytics

  • Big data processing and analytics

  • Amazon Athena

  • Hands-on lab 2: Using Amazon Athena to Analyse Log Data

Module 6: Apache Hadoop and Amazon EMR

  • Introduction to Amazon EMR and Apache Hadoop

  • Best practices for ingesting data

  • Amazon EMR

  • Amazon EMR architecture

  • Hands-on lab 3: Storing and Querying Data on Amazon DynamoDB

Module 7: Using Amazon EMR

  • Developing and running your application

  • Launching your cluster

  • Handling output from your completed jobs

Module 8: Hadoop programming frameworks

  • Hadoop frameworks

  • Other frameworks for use on Amazon EMR

  • Hands-on lab 4: Processing Server Logs with Hive on Amazon EMR

Module 9: Web interfaces on Amazon EMR

  • Hue on Amazon EMR

  • Monitoring your cluster

  • Hands-on lab 5: Running Pig Scripts in Hue on Amazon EMR

Module 10: Apache Spark on Amazon EMR

  • Apache Spark

  • Using Spark

  • Hands-on lab 6: Processing NY Taxi Data Using Apache Spark

Module 11: Using AWS Glue to automate ETL workloads

  • What is AWS Glue?

  • AWS Glue: Job orchestration

Module 12: Amazon Redshift and big data

  • Data warehouses vs. traditional databases

  • Amazon Redshift

  • Amazon Redshift architecture

Module 13: Securing your Amazon deployments

  • Securing your Amazon deployments

  • Amazon EMR security overview

  • AWS Identity and Access Management (IAM) overview

  • Securing data

  • Amazon Kinesis security overview

  • Amazon DynamoDB security overview

  • Amazon Redshift security overview

Module 14: Managing big data costs

  • Total cost considerations for Amazon EMR

  • Amazon EC2 pricing models

  • Amazon Kinesis pricing models

  • Cost considerations for Amazon DynamoDB

  • Cost considerations and pricing models for Amazon Redshift

  • Optimising cost with AWS

Module 15: Visualising and orchestrating big data

  • Visualising big data

  • Amazon QuickSight

  • Orchestrating a big data workflow

  • Hands-on lab 7: Using TIBCO Spotfire to visualise data

Module 16: Big data design patterns

  • Common architectures

Module 17: Course wrap-up

  • What’s next?

Please note: This is an emerging technology course. Course outline is subject to change as needed.

Prerequisites

We recommend that attendees of this course have the following prerequisites:

  • Basic familiarity with big data technologies, including Apache Hadoop, HDFS, and SQL/NoSQL querying

  • Completed Data Analytics Fundamentals free digital training or equivalent experience

  • Working knowledge of core AWS services and public cloud implementation

  • Completed the AWS Technical Essentials classroom training or have equivalent experience

  • Basic understanding of data warehousing, relational database systems, and database design

Terms & Conditions

The supply of this course by DDLS is governed by the booking terms and conditions. Please read the terms and conditions carefully before enrolling in this course, as enrolment in the course is conditional on acceptance of these terms and conditions.

Request Course Information

By submitting an enquiry, you agree to our privacy policy and receiving email and other forms of communication from us. You can opt-out at any time.

Looking for more course options?

View all AWS coursesView all Data, Analytics and AI coursesView all Cloud Computing and Virtualisation courses