ML, programming, neuroscience. Previously @UMichCSE, @Microsoft, @Numenta. Now making Jupyter / Tensorboard / etc. easier to reach at https://xitter.gq/t.co/7ketvVRlch
San Francisco, CA
Joined February 2011
- Tweets1.2K
- Following613
- Followers712
- Likes7.2K
Brad from fireinabottle.net has been obviously hacked for like a month, spamming followers with messages. (Anyone who tags him and says he's hacked gets blocked.)
reddit.com/r/SaturatedFat/co…
158
For me, a fun entry-point into this paper is just to observe:
The transformer is a silly architecture for token generation. During inference, transformers operate with their hands tied behind their back. They do this because it makes training cheaper.
What if a foundation model could tell us how to modify its architecture to boost inference and reasoning instantaneously—without retraining? What if that tweak incurred near zero latency cost during generation and supported indefinite state tracking? arxiv.org/abs/2608.17981
Finally convinced myself that non-distorting watermarking is real, a la Anthropic / Google SynthID. It's not just spin / marketing. This really is a "Monty Hall" like problem. (h/t @random_walker for that analogy.)
Sharing here in case it helps anyone else.
1
2
262
Tip: if you play piano with a toddler in your lap, you get to blame all the mistakes on the toddler.
1
235
New experience: going offline to have lunch with your toddler while your blog post is on the front page of Hacker News.
Thing #28 I didn’t know about toddlers:
They choose a book and put it in your hand the same way you would choose a cartridge and put it into a Nintendo.
4
192
People talk about how having kids teaches them things about ML / AI, but for me it's more the opposite direction. ML gives me a vocabulary for kids.
For example, when a grandparent gives him "noisy training data", I'm relaxed, because a little bit of "regularization" is good.
4
238
A fun part of having a kid is seeing random things from your past repurposed:
- the Pavarotti YouTube video you saw in your college opera musicology class becomes his ritual teethbrushing music
- the guitar capo you got in high school becomes his most interesting chew toy
1
1
117
One good way to clean up vibe code: ask the agent to write Markdown files about certain cross-sections. For example, "messages-between-components.md" or "database-format.md" or "example-usage.md". Then, suggest improvements.
You're like Plato, editing the shadows on the wall.
100
A fun part of early parenthood is you keep noticing "second chances". You get another run through childhood. Another chance to be good at throwing a ball, to know the difference between maple and oak trees, to be able to do fun accents.
117
I made something. It's like a web view, but native. Rather than parsing HTML and running JavaScript, it fetches machine code binaries over the internet and runs them sandboxed.
Here's the first app: a "Top" app that runs over SSH.
Blog post: “It’s like a web view, but native”
probablymarcus.com/blocks/20…
222
A fun use of LLMs: set a breakpoint in your optimized code, copy-paste the disassembly, ask the LLM to find and explain how it does [THING YOU'RE CURIOUS ABOUT].
(I just learned how the compiler handles big "switch" statements over lots of integer values)
2
1
167