The Truth of AI (@truthofai) header
The Truth of AI (@truthofai) profile picture

Essays about artificial intelligence. Separating fact from fiction. Coming soon...

Joined September 2018
Advances in in-context learning are making fine-tuning and RAG less relevant.
Highest alpha secret in AI right now: If you provide ~10 examples to Claude 3 Haiku… it’ll often outperform Claude 3 Opus, and far outperform GPT-4 at a fraction of the cost, with blazing fast speeds
20
Happy to see the shift key on your keyboard is fixed!
happy to see this—excited for intel, the US, and more AI capacity!
23
The Truth of AI retweeted
Improving LLMs' math reasoning ability is actually not as easy as what people anticipated. There are some interesting observations: 1. Using textbooks does not improve models' reasoning a lot. We tried to use the 800 high-quality math textbooks from Mathpile to continue training
44
53
9
485
110,772
To clear your mind, program
to program, first clear your mind
22
These tweets about git and devops and releasing features is really weird. Is everything okay at @OpenAI
something very satisfying about waking early and clearing out the daily backlog to then be able to focus the rest of the day
1
23
Hmmm.... a search engine for LLM agents. It will be interesting to see which directions this is going to take the field to.
Today, I'm sharing AgentSearch, an open-core effort to make humanity's knowledge accessible for LLM agents. To start, I have embedded all of Wikipedia, Arxiv, filtered common crawl, and more. The result is over 1 billion embedding vectors, try it at search.sciphi.ai/.
1
1
137
Graph ML/DL is underrated
A new family of antibiotics discovered with graph deep learning.
27
The Truth of AI retweeted
OpenAI is no longer a research lab. It's a company selling AI.
42
34
7
397
55,898
Great visualization of transformers
How Transformers Work This is probably one of the most beautiful visualizations of how today's LLMs work. ig.ft.com/generative-ai/
24
The Truth of AI retweeted
Here, in full directly on Twitter, is "A Hackers' Guide to Language Models". This 90 minute tutorial is designed to be the one place I point coders at when they ask "hey, tell me everything I need to know about LLMs!" It covers both @OpenAI models and open source ones in depth.
77
998
52
5,913
777,517
Educate yourself on the basics of AI Understand the difference between academic and commercial AI Know the importance of the people creating the AI Don't botch your AI pitches! bdtechtalks.com/2021/01/06/h… via @bdtechtalks
2
4