Posts

Showing posts with the label Multi-Collinearity in machine Learning

Multi-Collinearity in Machine Learning

 # What is multicollinearity? >Multicollinearity occurs when independent variables in a regression model are correlated. This correlation is a problem because independent variables should be independent. If the degree of correlation between variables is high enough, it can cause problems when you fit the model and interpret the results. >Multicollinearity occurs when two or more independent variables are highly correlated with one another in a regression model. This means that an independent variable can be predicted from another independent variable in a regression model # Why Multi-Collinearity is a problem? When independent variables are highly correlated, change in one variable would cause change to another and so the model results fluctuate significantly. The model results will be unstable and vary a lot given a small change in the data or model. This will create the following problems: 1>It would be hard for you to choose the list of significant variables for the mod...