Apr 5, 2021Optimizers in Deep LearningWhat is Optimizers? Optimizers are algorithms used to reduce the loss function and update the weights in backpropagation. Here is the formula used by all the optimizers for updating the weights with a certain value of the learning rate.Deep Learning4 min readDeep Learning4 min read
Mar 29, 2021Introduction to loss functionsBasically a loss function is a method of evaluating how well your algorithm models your dataset. A neural network is one such approach which applies arithmetic operations over many layers until an appropriate solution is obtained. To check how accurate the solution is, loss functions are used. Difference between a Loss Function and a Cost Function? Loss function is…Deep Learning3 min readDeep Learning3 min read
Mar 27, 2021Types of Activation FunctionsEverything you need to know about the activation functions in Deep learning! What is an Activation Function? In the neural network activation function plays an important role. The activation function determines the output of a deep learning network, its accuracy, and computational efficiency of training the network. Activation Function help in normalizing the output between…Deep Learning5 min readDeep Learning5 min read
