Layer normalization vs Batch normalization
Why is normalization necessary? You can consider normalization as a way of scaling and shifting the input data in a particular range. Some common normalization techniques are min-max normalization and z-score (standardization) normalization. Min max normalization scales data between 0 to 1 whereas standardization scales data to have mean of 0 and stand deviation of 1. […]
Layer normalization vs Batch normalization Read More »
