Yi Cui
onekq
AI & ML interests
Benchmark, Code Generation Model
Recent Activity
posted
an
update
17 minutes ago
I am starting a new series on matrix. The idea came to me when I wrote about the Muon optimizer.
Matrix itself has lots of fascinating properties and is applied in STEM fields for many decades. Its application in ML is just the beginning. There are lots of low hanging fruits. At the very least, I hope this math perspective will give you a new lens.
https://huggingface.co/blog/onekq/matrices-transformers-preface
published
an
article
about 23 hours ago
🔀 Matrices in Transformers: Preface
Organizations
