It's a nice treatment of the subject, but I wish he would post a conventionally-formatted .PDF that puts every page on a full sheet of standard printer paper.
Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it.
My favorite little book is François Fleuret's: The Little Book of Deep Learning https://fleuret.org/francois/lbdl.html
I love how that site offers a phone-formatted PDF as an option. How thoughtful!
i got duo to increase my reading.
It's a nice treatment of the subject, but I wish he would post a conventionally-formatted .PDF that puts every page on a full sheet of standard printer paper.
I immediately wanted the same thing, so I made it. The book is licensed Creative Commons BY-NC-SA 4.0 International License, so here you go.
https://cdn.filepost.dev/file/filepost/uploads/15/1578f21219...
Thanks!
Wow, this book is surprisingly readable! I like how he starts from basics of linear algebra.
Appreciated, I drop all of these into a RAG folder for when I need them later on in projects.
8Gb of whitepapers/books...
Can you share what you have so far in that folder?
They spell it out quite clearly: "8Gb of whitepapers/books..."
Are there any deep learning books with some problems to solve ?
Interesting!
Is there any one who have recommended books on the attention architecture specifically? I have been interested in that for a long time but never gotten around to actually studying it.
Not a book, but 3blue1brown's video on attention is pretty great: https://www.youtube.com/watch?v=eMlx5fFNoYc
formal algorithms for transformers provides perhaps the most succinct introduction to attention I can imagine https://arxiv.org/pdf/2207.09238