Big Data Analytics Using Spark
About this Course
In data science, data is called "big" if it cannot fit into the memory of a single standard laptop or workstation. The analysis of big datasets requires using a cluster of tens, hundreds or thousands of computers. Effectively using such clusters requires the use of distributed files systems, such as the Hadoop Distributed File System (HDFS) and corresponding computational models, such as Hadoop, MapReduce and Spark. In this course, part of the Data Science MicroMasters program, you will learn what the bottlenecks are in massive parallel computation and how to use spark to minimize these bottlenecks. You will learn how to perform supervised an unsupervised machine learning on massive datasets using the Machine Learning Library (MLlib). In this course, as in the other ones in this MicroMasters program, you will gain hands-on experience using PySpark within the Jupyter notebooks environment.Created by: The University of California, San Diego
Level: Advanced
![](http://d278sointswlfn.cloudfront.net/1a173a97d2959e48be66f3e2fa027d58%2F600x400xwidth%2F98%2Fhttps%2Fprod-discovery.edx-cdn.org%2Fuloop%2Fr%3D4%2Fjpg%2Fmedia%2Fcourse%2Fimage%2F21be6203-b140-422c-9233-a1dc278d7266-d008b677f4c1.small.jpg)
Related Online Courses
Through a series of fun and engaging hands-on activities in Microsoft Excel, this module aims to equip the learner with the ability to thoughtfully apply computational tools when solving complex... more
SQL (Structured Query Language) is the most commonly used language to communicate with databases and extract data for application development, reporting and analytics. It is ubiquitous for... more
The data revolution is transforming the world; and yet much of the value of data remains untapped. This course, based on the World Development Report 2021: Data for Better Lives , explores the... more
In the information age, data is all around us. Within this data are answers to compelling questions across many societal domains (politics, business, science, etc.). But if you had access to a... more
Please Note: Learners who successfully complete this IBM course can earn a skill badge —a detailed, verifiable and digital credential that profiles the knowledge and skills you’ve acquired in thi... more