Machine Learning I

Categories: Data Science

About Course

In this course, we’ll cover the fundamentals of machine learning with a significant focus on supervised machine learning. We’ll start from introducing machine learning, the Scikit Learn library for machine learning, then we’ll delve deep into supervised learning methods i.e. Regression and Classification. We’ll close off the course by going through model evaluation by exploring metrics for regression and classification as well as how to conduct hyperparameter tuning for our machine learning models.

Acknowledgements and Attribution

This course is attributed to Jake VanderPlas’ Python Data Science Handbook alongside Andrew NG’s tutorials on Machine Learning Concepts. We also recommend checking out the StatQuest Youtube channel for faster explanations on Machine Learning Algorithms whenever you are stuck. We have added these videos to the course to help make harder concepts simpler to understand. Finally, you have notes by Cyril Michino shared on Slack or on the resources section highlighting the most important theoretic aspects of every ML algorithm covered in this course.

Course Content

1.1 Introduction to Machine Learning

What is Machine Learning

05:28
Supervised Learning – Regression

06:57
Supervised Learning – Classification

07:17
Unsupervised Learning – Clustering

08:53
Unsupervised Learning – Dimensionality Reduction

03:40
Steps in a Machine Learning Project (Summarized)

13:37
Machine Learning Fundamentals Quiz

1.2 Data Preparation with Scikit Learn

1.3 Hyperparameters & Model Validation

1.4 Feature Engineering
The previous sections outline the fundamental ideas of machine learning, but all of the examples assume that you have numerical data in a tidy, [n_samples, n_features] format. In the real world, data rarely comes in such a form. With this in mind, one of the more important steps in using machine learning in practice is feature engineering: that is, taking whatever information you have about your problem and turning it into numbers that you can use to build your feature matrix. In this section, we will cover a few common examples of feature engineering tasks: features for representing categorical data, features for representing text, and features for representing images. Additionally, we will discuss derived features for increasing model complexity and imputation of missing data. Often this process is known as vectorization, as it involves converting arbitrary data into well-behaved vectors.

1.5 Data Preparation Project

2.1 Linear Regression

Introduction to Regression

10:27
Model Representation

06:44
Cost Function

09:05
Cost Function Intuition

15:47
Cost Function Visualisation

08:33
Gradient Descent Visualisation

06:00
Gradient Descent

08:03
Gradient Descent Implementation

10:00
Gradient Descent Intuition

07:02
Learning Rate

09:03
Gradient Descent for Linear Regression

06:36
Running Gradient Descent

05:49
Linear Regression on Scikit Learn

00:00
Linear Regression Quiz
Intro to Linear Regression (Summarized)

10:36
Cost Function Intuition (Summarized)

16:43
Gradient Descent (Summarized) : Part 1

15:38
Gradient Descent (Summarized) : Part 2

20:55

2.2 Advanced Linear Regression

Multiple Features

09:52
Vectorisation

06:55
Vectorisation Intuition

06:52
Gradient Descent for Multiple Variables

07:46
Gradient in Practical Feature Scaling

06:35
Implementing Feature Scaling

07:34
Checking for Convergence

05:40
Gradient Learning Rate

06:07
Feature Engineering

03:04
Features & Polynomial Regression

05:52
Polynomial Regression on Scikit Learn

00:00
Advanced Linear Regression Quiz
Polynomial Regression (Summarized)

11:36

2.3 Regularisation

2.5 Regression Weekly Project

3.1 Naives Bayes & KNN
In this week, you are going to go through classification projects, starting with KNN, Logistic Regression, SVMs , Tree Based models, to ensemble learning models. For the python implementation of the models,we will use one notebook throughout the course, which has been included as a resource that you can download and follow along with in this course.

3.2 Logistic Regression

Understanding Classification

09:48
Introduction to Logistic Regression

09:49
Decision Boundary

10:43
Cost Function

12:00
Simplified Cost Function

05:45
Gradient Descent Implementation

06:32
Logistic Regression – Summarized

20:20
Logistic Regression in Python

15:53
Logistic Regression Quiz

3.3 Support Vector Machines

3.4 Trees & Random Forests

3.4 More on Ensemble Learning Algorithms

3.5 Classification Weekly Project

4.1 Applying Machine Learning Models

4.2 Regression & Classification Metrics

4.3 Hyperparameter Tuning

4.5 Model Tuning Weekly Project

5.0 Conclusion and Next Steps

6.0 Main Capstone – Choices

Student Ratings & Reviews

No Review Yet

About Course

Acknowledgements and Attribution

Course Content

1.1 Introduction to Machine Learning

What is Machine Learning

Supervised Learning – Regression

Supervised Learning – Classification

Unsupervised Learning – Clustering

Unsupervised Learning – Dimensionality Reduction

Steps in a Machine Learning Project (Summarized)

Machine Learning Fundamentals Quiz

1.2 Data Preparation with Scikit Learn

Introduction to Scikit Learn

Feature Scaling (Summarized)

Data Normalization and Standardization Quiz

1.3 Hyperparameters & Model Validation

Overview of Model Validation

Cross-Validation

Selecting the Best Model

Learning Curves

Validation in Practice

Bias Variance Tradeoff and Cross Validation (Summarized)

Model Validation Quiz

Categorical Features

Text Features

Images and Derived Features

Imputation of missing data

Feature Pipelines

Encoding Techniques (Summarized)

Missingness in Machine Learning (Summarized)

Data Preprocessing Quiz

1.5 Data Preparation Project

Data Cleaning Project

Submit Your Project

2.1 Linear Regression

Introduction to Regression

Model Representation

Cost Function

Cost Function Intuition

Cost Function Visualisation

Gradient Descent Visualisation

Gradient Descent

Gradient Descent Implementation

Gradient Descent Intuition

Learning Rate

Gradient Descent for Linear Regression

Running Gradient Descent

Linear Regression on Scikit Learn

Linear Regression Quiz

Intro to Linear Regression (Summarized)

Cost Function Intuition (Summarized)

Gradient Descent (Summarized) : Part 1

Gradient Descent (Summarized) : Part 2

2.2 Advanced Linear Regression

Multiple Features

Vectorisation

Vectorisation Intuition

Gradient Descent for Multiple Variables

Gradient in Practical Feature Scaling

Implementing Feature Scaling

Checking for Convergence

Gradient Learning Rate

Feature Engineering

Features & Polynomial Regression

Polynomial Regression on Scikit Learn

Advanced Linear Regression Quiz

Polynomial Regression (Summarized)

2.3 Regularisation

The Problem of Overfitting

Addressing Overfitting

Cost Function

Regularised Linear Regression

Regularised Logistic Regression

Regularisation on Scikit Learn

Regularization Quiz

Regularization (Summarized)

2.5 Regression Weekly Project

Blueberry Yield Prediction Challenge

Submit your Project

Naives-Bayes Classification