How to apply Gradient Clipping in PyTorch
The value for the gradient vector norm or preferred range can be configured by trial and error, by using common values used in the literature, or by first observing common vector norms or ranges via experimentation and then choosing a sensible value.
How to Scale data into the 0-1 range using Min-Max Normalization.
min-max scaling, is the simplest and consists method in rescaling. The range of features to scale in [0, 1] or [−1, 1]. The impact is that we end up with smaller standard deviations, which can suppress the effect of outliers.
Pytorch Image Augmentation using Transforms.
The quality of the images will not be the same from each source. Some images might be of very high quality while others might be just plain bad. In such scenarios, we can blur the image. This helps make our deep learning model more robust. Transforms provide a class for randomly change the brightness, contrast, and saturation of an image.
Convert PASCAL dataset to TFRecord for object detection in TensorFlow
Once you are done annotating your image dataset in the Pascal VOC format, you must convert your data into the TFRecord format. Because to use your own dataset in TensorFlow Object Detection API, you must convert it into the TFRecord file format.
Change the Learning Rate using Schedules API in Keras
The intuition behind slowly reducing the learning rate is that maybe during the initial steps of learning you can afford to take much bigger steps but then as learning approaches convergence then having a slower learning rate allows you to take smaller steps.
Convolutional Neural Network using Sequential model in PyTorch.
How easy this looks compared to when we had to construct a model through the class way of doing it. Sequential class lives in the neural network package and this is a class that we are building by or we’re building an instance of this class by passing in other modules in a sequential.