Apache Spark Big Data Boot Camp

Adjustable to meet your needs.
When training eight or more people, onsite team training offers a more affordable and convenient option.
Register Now
Request Quote
Individual
Onsite
Overview

Apache Spark: the second-generation big data platform that supplants and improves on Hadoop

The speed, expanded versatility, and new access to powerful APIs and libraries make Apache Spark the undisputed new toolset for powering big data solutions with distributed cluster computing. Also, for the first time ever Spark gives applications the ability to support serious data science capabilities with R-type dataframes and big data streaming to overcome time constraints.

Learn to use Spark for your own applications in three packed hands-on days

This fast-paced 3-day course is for data engineers, data analysts, data scientists, developers and operations teams and provides a thorough, hands-on overview of the Apache Spark Platform and various technologies and paradigms which are in Apache Spark.

  • We will explore Apache Spark, how it came into existence, how it compares with Apache Hadoop – currently the de facto big data standard – and the new use cases that can be realized with Apache Spark as well as how your current use cases can be made more performant and powerful.
  • We will also look at Apache Spark’s Streaming Architecture which can help realize most of the real time-constrained needs of your business. We will also explore Apache Spark’s SQL Architecture which provides very fast migration from traditional slower analytical tools like Hive to SparkSQL.
  • We will spend some time on Apache Spark ML/ML Lib which provide a total integrated Architecture with both real-time and batch analytics.
  • Finally, we will also look at Apache Spark GraphX which deals with Graph Algorithms.

All these workshops are delivered with guided hands-on labs allowing attendees to explore the data and the techniques and familiarize themselves with the various paradigms.

Upcoming Dates and Locations
Guaranteed To Run
Nov 6, 2017 – Nov 8, 2017    8:30am – 4:30pm Seattle, Washington

Please call ASPE for location details
at 1-877-800-5221
Seattle, WA 98101
United States

Register
Nov 6, 2017 – Nov 8, 2017    11:30am – 7:30pm Live Online
11:30am – 7:30pm
Register
Dec 11, 2017 – Dec 13, 2017    8:30am – 4:30pm Live Online
8:30am – 4:30pm
Register
Dec 11, 2017 – Dec 13, 2017    8:30am – 4:30pm Raleigh, North Carolina

Please call ASPE for location details
at 1-877-800-5221
Raleigh, NC 27609
United States

Register
Jan 16, 2018 – Jan 18, 2018    8:30am – 4:30pm Columbia, Maryland

Homewood Suites by Hilton
8320 Benson Drive
Columbia, MD 21045
United States

Register
Jan 16, 2018 – Jan 18, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Feb 12, 2018 – Feb 14, 2018    8:30am – 4:30pm Denver, Colorado

Microtek Denver
999 18th Street
Suite 300 South Tower
Denver, CO 80202
United States

Register
Feb 12, 2018 – Feb 14, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Mar 12, 2018 – Mar 14, 2018    8:30am – 4:30pm Phoenix, Arizona

Dynamic Worldwide
4500 S. Lakeshore Dr
Suite 600
Tempe, AZ 85282
United States

Register
Mar 12, 2018 – Mar 14, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Apr 9, 2018 – Apr 11, 2018    8:30am – 4:30pm Saint Louis, Missouri

Saint Louis University - Workforce Ctr
3545 Lindell Blvd.
2nd Floor Wool Center
Saint Louis, MO 63103
United States

Register
Apr 9, 2018 – Apr 11, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
May 14, 2018 – May 16, 2018    8:30am – 4:30pm Raleigh, North Carolina

ASPE Training
114 Edinburgh South Dr
Suite 200
Cary, NC 27511
United States

Register
May 14, 2018 – May 16, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Jun 11, 2018 – Jun 13, 2018    8:30am – 4:30pm Philadelphia, Pennsylvania

Hyatt Place
440 American Avenue
King Of Prussia, PA 19406
United States

Register
Jun 11, 2018 – Jun 13, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Aug 13, 2018 – Aug 15, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Sep 10, 2018 – Sep 12, 2018    8:30am – 4:30pm Dallas, Texas

Microtek Dallas
5430 Lyndon B Johnson Fwy
Three Lincoln Centre, Suite 300
Dallas, TX 75240
United States

Register
Sep 10, 2018 – Sep 12, 2018    10:30am – 5:30pm Live Online
10:30am – 5:30pm
Register
Oct 9, 2018 – Oct 11, 2018    8:30am – 4:30pm Atlanta, Georgia

Microtek Atlanta
1000 Abernathy Rd. NE Ste 194
Northpark Bldg 400
Atlanta, GA 30328
United States

Register
Course Outline
  1. Introduction to Big Data & Apache Spark
  • Introduce Data Analysis
  • Introduce Big Data
  • Big Data Definition
  • Introduce the techniques and challenges in Big Data
  • Introduce the techniques and challenges in Distributed Computing
  • Show how the functional programming approach is particularly useful in tackling these challenges
  • Short overview of previous solutions: Google’s MapReduce and Apache Hadoop
  • Introduce Apache Spark

Hands-on practice: We will get exposure to admin and setup

  1. Deploying & Understanding Apache Spark Architecture
  • Spark Architecture in a Cluster
  • Spark Ecosystem and Cluster Management
  • Deploying Spark on a Cluster
  • Deploying Spark on a Standalone Cluster
  • Deploying Spark on a Mesos Cluster
  • Deploying Spark on YARN cluster
  • Cloud-based Deployment

Hands-on practice: Learn to deploy and begin using Spark

  1. Spark Core, RDDs and Spark Shell
  • Dig deeper into Apache Spark
  • Introduce Resilient Distributed Datasets (RDDs)
  • Apache Spark installation (basic, local)
  • Introduce the Spark Shell
  • Actions and Transformations (Laziness)
  • Caching
  • Loading and Saving data files from the file system

Hands-on practice: Get hands-on with Spark Core and RDDs

4.Deep Dive into RDD

  • Tailored RDD
  • Pair RDD
  • NewHadoop RDD
  • Aggregations
  • Partitioning
  • Broadcast Variables
  • Accumulators

Hands-on practice: You’ll learn expanded RDD capabilities

5.Spark SQL and DataFrames

  • SparkSQL & DataFrames
  • DataFrame & SQL API
  • DataFrame Schema
  • Datasets and Encoders
  • Loading and Saving data
  • Aggregations
  • Joins

Hands-on practice: You’ll learn to use one of Spark’s most powerful features: DataFrames using R-style modeling supported by supercomputing clusters

6.Spark Streaming

  • Brief introduction to streaming
  • Spark Streaming
  • Discretized Streams
  • Structured Streaming
  • Stateful / Stateless Transformations
  • Checkpointing
  • Interoperability with Streaming Platforms (Apache Kafka)

Hands-on practice: Another of Spark 2.1’s most exciting features is the ability to provide big data streaming to allow beating the timeframe constraints of previous big data solutions

  1. Spark MLlib and ML
  • Introduction to Machine Learning
  • Spark Machine Learning APIs
  • Feature Extractor and Transformation
  • Classification using Logistic Regression
  • Best Practice in ML for the Practitioners

Hands-on practice: Use Spark to perform production-friendly calls for powerful machine learning service and predictive analytics

  1. Graphx
  • Brief Introduction to Graph Theory
  • GraphX
  • Vertex and Edge RDDs
  • Graph operators
  • Pregel API
  • PageRank / Travelling Salesman Problem *

Hands-on practice: Get hands-on practice using Graphx

  1. Testing and Debugging Spark
  • Testing in a Distributed Environment
  • Testing Spark Application
  • Debugging Spark Application

Hands-on practice: You’ll get lab practice supporting Spark solutions with best practices for testing, debugging, and normal-day production issues for Spark solutions

Who should attend
  • Developers and Team Leads
  • Software Engineers
  • Business Analysts
  • System Analysts
  • Data Analysts and Scientists
  • Data Scientists
  • Operations and DevOps Engineers
  • JAVA Developers
  • Big Data Engineers
Pre-Requisites

Labs can be accessed by everyone using the cloud environment set up by the instructor. Participation is not mandatory; if they prefer, attendees can simply observe the instructor perform the lab example. Scala/Python are a nice to have skill to better understand what is being done in the Labs.

Download the brochure