Supervised Learning - Classification Week 7 Challenge

1Q)

Support Vector Machine (SVM) is a supervised machine learning algorithm used for classification and regression tasks. It works by finding the optimal hyperplane that separates data into different classes in a high-dimensional space. The primary objective of SVM is to maximize the margin between the classes, which is the distance between the hyperplane and the nearest data points from each class.

Key components of SVM:

Hyperplane: A decision boundary that separates different classes in the feature space.

Margin: The distance between the hyperplane and the nearest data point from each class. SVM aims to maximize this margin.

Support Vectors: The data points that lie closest to the hyperplane and play a crucial role in determining the position of the hyperplane.

Pros of Support Vector Machines:

Effective in High-Dimensional Spaces: SVMs perform well in high-dimensional spaces, making them suitable for tasks with a large number of features.

Robust to Overfitting: SVMs are less prone to overfitting, especially in high-dimensional spaces, due to their focus on maximizing the margin.

Versatile Kernel Functions: SVMs can use different kernel functions (linear, polynomial, radial basis function, etc.) to handle complex relationships within the data.

Works well with Small and Medium-sized Datasets: SVMs can provide good results even with small to medium-sized datasets.

Global Optimization: The objective of SVM is to find the global optimum, making it less likely to get stuck in local minima.

Cons of Support Vector Machines:

Computational Intensity: Training an SVM can be computationally intensive, especially for large datasets, and might be time-consuming.

Choice of Kernel: The performance of SVM is sensitive to the choice of kernel and its parameters, which may require careful tuning.

Memory Usage: SVMs might consume a significant amount of memory, particularly when dealing with large datasets.

Limited Interpretability: The decision boundary produced by SVMs is not easily interpretable, which can make it challenging to explain the model's predictions.

Not Well-Suited for Noisy Datasets: SVMs can be sensitive to noisy data and outliers, potentially affecting their performance.