Pluralsightintermediateen

Building Machine Learning Models in Spark 2

Learn to train machine learning models efficiently with Spark! Explore, clean, aggregate data & build models on a single platform. Distributed computing for ML.

4.7(37)
3h 27m
Certificate
Janani Ravi
Janani RaviInstructor

Course Content

Building Machine Learning Models in Spark 2 is an intermediate-level Pluralsight course taught by Janani Ravi. It runs 3h 27m, is taught in English, and includes a certificate of completion. Learners rate it 4.7 out of 5 from 37 reviews. It is a paid course, first published February 2025.

Build Machine Learning Models with Spark 2

Unlock the power of big data with Spark 2! This course guides you through building and training a variety of Machine Learning (ML) models – including regression, classification, clustering, and recommendation systems – using Spark 2.x's robust distributed processing environment.

You'll start with a clear understanding of the two main ML libraries available in Spark 2:

  • spark.mllib: The established library built on Resilient Distributed Datasets (RDDs).
  • spark.ml: The modern library built on DataFrames, offering a more streamlined approach.

We'll compare these libraries head-to-head, helping you determine which is best suited for your specific needs. See how to implement a classification model using Decision Trees with both the older and newer libraries.

Dive deep into key Spark 2 features, including:

  • ML Pipelines: Learn to efficiently chain together data transformations and ML operations for a simplified workflow.
  • Transformers, Estimators, and Parameters: Master these essential components for building scalable distributed training systems.

By the end of this course, you'll be proficient in leveraging Spark 2's advanced capabilities for machine learning at scale. Gain the skills to process large datasets and build impactful predictive models. Spark is a leading engine for big data processing, and this course equips you to harness its potential for data science and AI applications.

$ whoami — the devs behind tutorialsearch.io

Want AI in your product? Hire the team behind TutorialSearch.io

LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.