> AI by Hand is the research publication of By Hand Research, founded by Prof. Tom Yeh. By Hand Research studies model interpretability and explainability at the math and algorithm level. Subscribers receive free new articles and join live seminars. Members get access to our full research library.
i created something similar a while back. Inspired by micrograd for showing the connection between math/calculus and code, then building along the way to a full NumPy deep learning library that I pretrained GPT-2 124M model with it. One way to learn is to trace through the PRs merged to the repo in chronological order.
https://www.byhand.ai/p/library
> AI by Hand is the research publication of By Hand Research, founded by Prof. Tom Yeh. By Hand Research studies model interpretability and explainability at the math and algorithm level. Subscribers receive free new articles and join live seminars. Members get access to our full research library.
This is also recommended reading if you want to learn more about building LLMs from scratch: See:
Train your own LLM - https://github.com/angelos-p/llm-from-scratch
HN Discussion - https://news.ycombinator.com/item?id=48017948
I'm not sure what this is. Click past the subscribe page to get a bunch of links to descriptions of articles I could read if I was a subscriber?
Scroll all the way down and there's a video, it's a course he's making for deep-dive into how Qwen 3.6 works internally
Click "Later->" to bypass subscribe.
dont see later
Eventually, none of us do.
i created something similar a while back. Inspired by micrograd for showing the connection between math/calculus and code, then building along the way to a full NumPy deep learning library that I pretrained GPT-2 124M model with it. One way to learn is to trace through the PRs merged to the repo in chronological order.
The philosophy is the same: "What I cannot create, I do not understand." https://github.com/workofart/ml-by-hand
wow this is nice work. i am diving into this world and was hoping to this exact thing. i am going to look to see how you did it. ty for sharing.
I’d say bad UX design. It may or may not be something good behind the door. But why do I enter?
My professor used this "by hand" technique when teaching quantum computation algorithms, so I have a soft spot for it.
this is sick!