Search for a command to run...
Articles tagged with #gradient-descent
Imagine you're blindfolded on a mountainside, trying to find the lowest valley. You can only feel the slope beneath your feet and take one step at a time. How would you navigate to the bottom? This exact scenario mirrors one of the most fundamental a...
Imagine processing data where one feature records age in years and another tracks income in thousands of dollars. How do you fairly compare them? This disparity in scale mirrors the challenges machine learning algorithms face when features differ vas...
Have you ever wondered how neural networks learn? Have you ever wondered how your smartphone recognizes your face or how virtual assistants understand your voice? The secret lies in a powerful algorithm called backpropagation. Imagine trying to teach...
Have you ever spent days fine-tuning a deep learning models, only to see no difference on its performance? A couple days ago, I was helping a friend of mine to fine tune a classifier using CNN. We spent a couple of hours, adjusting every hyper-parame...
In the realm of neural networks, one parameter stands tall among the rest, significantly influencing the training process - the batch size. Although it might seem like a minor detail, the batch size can drastically affect the training curves of your ...
Introduction Activation functions are key pieces in the world of deep learning. They introduce non-linearity into neural networks, enabling them to learn complex patterns and relationships in data. Today, we're going to explore a specific activation ...
