Skip to content

Instantly share code, notes, and snippets.

@bushaev
Created September 2, 2018 15:01
Show Gist options
  • Select an option

  • Save bushaev/8e24950c8f3399c8d592fde65ca617ee to your computer and use it in GitHub Desktop.

Select an option

Save bushaev/8e24950c8f3399c8d592fde65ca617ee to your computer and use it in GitHub Desktop.
grads_squared = 0
for _ in num_iterations:
dw = compute_gradient(x, y_
grad_squared += dw * dw
w = w - (lr / np.sqrt(grad_squared)) * dw
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment