What will happen if someone fits a linear regression on a 0-1 problem rather than to fit on logistic regression?

455    Asked by JamesWILLIAMS in Data Science , Asked on Jan 12, 2020
Answered by James WILLIAMS

Basically linear regression uses straight line function but logistic regression uses sigmoid function .Below are the points of things that happen during fitting a linear regression problem into a logistic problem.

a) Error terms will be large at the middle values of independent variables which is X and small at the extreme values, which strictly violates the rules of linear regression assumptions that errors should have zero mean and should be normally distributed

b) It will generate nonsensical predictions of greater than 1 and less than 0 at end values of X

c) The ordinary least squares (OLS) estimates are inefficient and standard errors are biased

d) High error variance will occur in the middle values of X and low variance at ends

The below image can show how fitting of linear and logistic regression differ from each other




Your Answer

Interviews

Parent Categories