Skip to content

Instantly share code, notes, and snippets.

@bushaev
Created September 2, 2018 15:02
Show Gist options
  • Select an option

  • Save bushaev/57c56fb4ac5345a1ce35967e8ca26412 to your computer and use it in GitHub Desktop.

Select an option

Save bushaev/57c56fb4ac5345a1ce35967e8ca26412 to your computer and use it in GitHub Desktop.
grads_squared = 0
for _ in num_iterations:
dw = compute_gradient(x, y)
grad_squared += dw * dw
w = w - (lr / np.sqrt(grad_squared)) * dw
@frankbryce
Copy link

s/grads_squared/grad_squared/g
please

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment