When the machine learning algorithm tries to capture all the data points, and hence, as a result, captures noise also, then overfitting occurs in the model. Due to this overfitting issue, the algorithm shows the low bias, but the high variance in the output. Overfitting is one of the main issues in machine learning.
Methods to avoid Overfitting in ML:
- Cross-Validation
- Training With more data
- Regularization
- Ensembling
- Removing Unnecessary Features
- Early Stopping the training.