High-Dimensional Data Analysis
About this Course
If you’re interested in data analysis and interpretation, then this is the data science course for you. We start by learning the mathematical definition of distance and use this to motivate the use of the singular value decomposition (SVD) for dimension reduction of high-dimensional data sets, and multi-dimensional scaling and its connection to principle component analysis. We will learn about the batch effect, the most challenging data analytical problem in genomics today, and describe how the techniques can be used to detect and adjust for batch effects. Specifically, we will describe the principal component analysis and factor analysis and demonstrate how these concepts are applied to data visualization and data analysis of high-throughput experimental data. Finally, we give a brief introduction to machine learning and apply it to high-throughput, large-scale data. We describe the general idea behind clustering analysis and descript K-means and hierarchical clustering and demonstrate how these are used in genomics and describe prediction algorithms such as k-nearest neighbors along with the concepts of training sets, test sets, error rates and cross-validation. Given the diversity in educational background of our students we have divided the series into seven parts. You can take the entire series or individual courses that interest you. If you are a statistician you should consider skipping the first two or three courses, similarly, if you are biologists you should consider skipping some of the introductory biology lectures. Note that the statistics and programming aspects of the class ramp up in difficulty relatively quickly across the first three courses. By the third course will be teaching advanced statistical concepts such as hierarchical models and by the fourth advanced software engineering skills, such as parallel computing and reproducible research concepts. These courses make up two Professional Certificates and are self-paced: Data Analysis for Life Sciences: PH525.1x: Statistics and R for the Life Sciences PH525.2x: Introduction to Linear Models and Matrix Algebra PH525.3x: Statistical Inference and Modeling for High-throughput Experiments PH525.4x: High-Dimensional Data Analysis Genomics Data Analysis: PH525.5x: Introduction to Bioconductor PH525.6x: Case Studies in Functional Genomics PH525.7x: Advanced Bioconductor This class was supported in part by NIH grant R25GM114818.Created by: Harvard University
Level: Advanced
Related Online Courses
Causal diagrams have revolutionized the way in which researchers ask: What is the causal effect of X on Y? They have become a key tool for researchers who study the effects of treatments,... more
Analytical models are key to understanding data, generating predictions, and making business decisions. Without models it’s nearly impossible to gain insights from data. In modeling, it’s ess... more
The job of a data scientist is to glean knowledge from complex and noisy datasets. Reasoning about uncertainty is inherent in the analysis of noisy data. Probability and Statistics provide the... more
This proctored examination assesses all concepts, methods and techniques introduced across the following four courses within the LSE MicroBachelors program in Statistics Fundamentals: Statistics 1:... more
In data science, data is called "big" if it cannot fit into the memory of a single standard laptop or workstation. The analysis of big datasets requires using a cluster of tens, hundreds or... more