user1596466 user1596466 - 8 months ago 79
Python Question

Linear Regression\Gradient Descent python implementation

So I'm trying to implement linear regression using the gradient descent method from scratch for learning purposes. One part of my code is really bugging me. For some reason the variable x is being altered after I run a line of code and I'm not sure why.

The variables are as follow. x and y are numpy arrays and I've given them random numbers for this example.

theta = [0,0]
alpha = .01
m = len(x)

The code is:

theta[0] = theta[0] - alpha*1/m*sum([((theta[0]+theta[1]*x) - y)**2 for (x,y) in zip(x,y)])

Once I run the above code x is no longer a list. It becomes only the variable n or the last element in the list.

Any help is much appreciated!


What is happening is that python is computing the list zip(x,y), then each iteration of your for loop is overwriting (x,y) with the corresponding element of zip(x,y). When your for loop terminates (x,y) contains zip(x,y)[-1].


theta[0] = theta[0] - alpha*1/m*sum([((theta[0]+theta[1]*xi) - yi)**2 for (xi,yi) in zip(x,y)])