Steve Cook (@RevBooyah) profile picture

Entrepreneur, CEO, Data Scientist, Big Data, Machine Learning, AI, Programmer, Black Belt, and Family Man, based in Albuquerque. https://xitter.gq/t.co/yhMR3O6GGX

Albuquerque, NM
Joined August 2008
Tokenization is the first step in every LLM pipeline — and we barely look at it. I built TokEntropyDrift to fix that. It's a tokenizer drift + entropy explorer for researchers, prompt engineers, and LLM nerds like me.
2
1
103
🔧 Written in Go 📦 CLI + plugin support 📊 Designed for research pipelines, prompt debugging, or CI-based tokenizer analysis 🧪 Built for scientific reproducibility
1
89
Different tokenizers (BPE, WordPiece, SentencePiece, OpenAI’s, etc.) break down the same text differently. This affects: • Compression • Prompt consistency • Model performance • Debuggability And yet… nobody’s instrumenting this.
1
65
TokEntropyDrift tracks: 🔹 Entropy & compression metrics 🔹 Drift across tokenizers and corpora 🔹 Token reuse 🔹 Rolling entropy over time 🔹 Reproducible comparisons between tokenizers
41
i vibe coded a little game called Coldplay Canoodlers you're the camera operator and you have to find the CEO and HR lady canoodling 10 points every time you find them 👇link
608
3,878
774
57,174
5,094,677
After 15 years at the Tour de France, the Shimano mechanics who saved Tadej Pogacar after his crash are happy every time they help a rider, whether they are in first or last. ❤️ #TDF2025
15
135
13
1,967
146,608
Can You Do It All? Lessons from Johnny Walker youtube.com/shorts/_hO0qQPRZ… via @YouTube
36
Every airplane on Earth: Emirates Flight 129: LEEEEEEEROYYYYY JENKINNNNNNNNNSSSS
800
6,900
509
127,857
10,641,625
all the cyber security contractors watching everyone deploying vibe coded SaaS apps
14
85
6
529
36,819
When do we get the Grok app in the Tesla? I'd love to have conversations while driving. Thanks @elonmusk
59
Steve Cook retweeted
The Raptor 22. We have the most bad ass military in the world.
472
3,014
253
17,417
611,872
Steve Cook retweeted
Wait. What did she say ? 😬😐
1,234
7,757
1,730
17,206
980,911
155
183
49
3,262
399,809
This from @ThePrimeagen is spot on
4
29
5
514
30,416
Instead of “how much time a task will take,” asking “what task can I complete in the available time?” has been a good productivity boost. Pleased that I was able to finish a feature and refactor some code in the 15 minutes of free time this morning before heading to airport.
2
4
1
61
3,646
Steve Cook retweeted
$ hawk tuah
22
892
92
11,247
612,157