AI by Hand ✍️
Subscribe
Sign in
Home
✨ Frontier
Certificates
Lectures
Walkthrough
Excel
Store 🛒
RoPE vs PE in QKV Self-Attention
Frontier Model Math by hand ✍️
Sep 30
•
Prof. Tom Yeh
15
Lecture
View all
Next Tuesday: New AI by Hand ✍️ Mini Course by Mohsena Begins
1200+ Registered!
Sep 13
•
Prof. Tom Yeh
14
Special Lecture: Scaling LLMs in JAX (sponsored by Google)
When Google’s JAX team first approached me to sponsor a special lecture, I told them, “You asked the wrong person.
Aug 13
•
Prof. Tom Yeh
13
NN to Transformer by Hand ✍️
Thank you to the 900+ people who registered my special lecture yesterday—and especially to the 300+ who showed up live!
Aug 8
•
Prof. Tom Yeh
37
5
Special Lecture: From Neural Networks to Transformers
I like to invite you to attend a special lecture this Wednesday (8/6) where I will teach how neural networks “transform” to transformer models by hand…
Aug 3
•
Prof. Tom Yeh
8
Introduction to Agentic AI
I would like to invite you to join my "Introduction to Agentic AI" mini-course.
Mar 8
•
Prof. Tom Yeh
92
3
Draw DeepSeek
We drew DeepSeek by hand ✍️ together in a live webinar yesterday (~900 attendees) ~ The most rewarding is to receive drawings from people around the…
Feb 20
•
Prof. Tom Yeh
25
DeepSeek Lecture (1/28)
Computer Vision - Spring 2025
Jan 27
•
Prof. Tom Yeh
178
19
Building a Vector Database in Excel
Webinar hosted by SingleStore
Nov 14, 2024
•
Prof. Tom Yeh
39
Subscribe to receive new AI by Hand ✍️ content in your inbox!
Subscribe
Walkthrough
View all
GPU by Hand ✍️
I drew 42 frames to show how a GPU speeds up an array operation of 8 elements in parallel over 4 threads in 2 clock cycles.
Jul 22
•
Prof. Tom Yeh
30
3
Context Engineering by Hand ✍️
There has been a lot of talks about context engineering.
Jul 20
•
Prof. Tom Yeh
29
Matmul on GPU/TPU by Hand ✍️
I drew 91 frames to show how to divide large matrices into "tiles" to use accelerators such as GPU/TPU.
Jul 18
•
Prof. Tom Yeh
16
BitNet by Hand ✍️
This week, Mohamed Mekkouri from Hugging Face published a blog post to share their success in fine-tuning LLMs to 1.58bit.
Sep 21, 2024
•
Prof. Tom Yeh
16
6
Discrete Fourier Transform by Hand ✍️
In signal processing, the Discrete Fourier Transform (DFT) is no doubt the most important method.
Jun 24, 2024
•
Prof. Tom Yeh
50
Superposition by Hand ✍️
Superposition is a key property that differentiates a qubit in a quantum computer from a bit in a classical computer.
Jun 17, 2024
•
Prof. Tom Yeh
26
1
LSTM by Hand ✍️
Jun 12, 2024
•
Prof. Tom Yeh
43
2
Sparse Auto Encoder (SAE) by Hand ✍️
Earlier this week, Anthropic published a paper on their latest effort toward interpretable AI:
May 24, 2024
•
Prof. Tom Yeh
10
1
Variational Auto Encoder (VAE) by Hand ✍️
A Variational Auto Encoder (VAE) learns the structure (mean and variance) of hidden features and generates new data from the learned structure.
May 8, 2024
•
Prof. Tom Yeh
19
Deep RNN by Hand ✍️
A Deep Recurrent Neural Network (RNN) extends a basic single-layer RNN into multiple layers of hidden states, effectively incorporating deep learning…
Mar 23, 2024
•
Prof. Tom Yeh
11
SVM by Hand ✍️
Support Vector Machines (SVMs) reigned supreme in machine learning before the ascendancy of the deep learning revolution.
Mar 18, 2024
•
Prof. Tom Yeh
18
U-Net by Hand ✍️
Thanks for reading AI by Hand ✍️!
Mar 14, 2024
•
Prof. Tom Yeh
8
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts