First, yes, your understanding is correct. Second, you asked for the vector form of gradient descent. The one I wrote above (the very first formula) is the vector form :-) GD Formula for vector and scala are exactly the same!

Maybe this is what you are looking for… (I found this image from Google.)

Image for post
Image for post

I’m an Engineering Manager at Scale AI and this is my notepad for Applied Math / CS / Deep Learning topics. Follow me on Twitter for more!

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store