When I started sharing AI by Hand ✍️ exercises, RNN was the second advanced exercise in the series. My intention was to provide a foundation for introducing Mamba in the next exercise. Since no one outside my graduate classes has seen my unique representation, the RNN exercise I shared was the simplest form with only 1D features.
I never imagined this series can continue till today and is still generating strong interests! Thanks! 🙌
Today, I'd like to give RNN a proper introduction, with non-trivial 3D features. I created a spreadsheet version of my RNN representation. You can enter your own values, watch the calculations, and even read the equations. I also provide a typical RNN graphical diagram to help you see the correspondences between RNN's matrix representation (left) and the graphical representation (right).
Download
Download a copy using the link below, and enjoy learning!
Love this!
Thank you for sharing excellent work