Supervised Learning - Classification Week 9 Challenge

What is a Neural Network?

computer system modelled on the human brain and nervous system.

What is deep learning?

type of machine learning based on artificial neural networks in which multiple layers of processing are used to extract progressively higher level features from data.

What is the role of the activation function?

Simply put, an activation function is a function that is added into an artificial neural network in order to help the network learn complex patterns in the data. When comparing with a neuron-based model that is in our brains, the activation function is at the end deciding what is to be fired to the next neuron.

What are the different types of activation functions?

Sigmoid Function.

Hyperbolic Tangent Function (Tanh)

Softmax Function.

Softsign Function.

Rectified Linear Unit (ReLU) Function.

Exponential Linear Units (ELUs) Function.

Softmax

What do you understand by backpropagation?

Backpropagation (backward propagation) is an important mathematical tool for improving the accuracy of predictions in data mining and machine learning. Essentially, backpropagation is an algorithm used to calculate derivatives quickly