james (@http_413) header
james (@http_413) profile picture

develooper / bullish on a post-scarcity, post-suffering world via ai / building @thereabouts_app so you never lose a new place to try

Joined August 2017
Anthropic $ANT just rang the opening bell for the stock market today at the NASDAQ exchange
1
142
say the prompt is “the sky is” and the model adds “blue.” when it processes “blue,” it reuses the keys and values it already saved for “the sky is” and adds an entry for “blue.” which saves it from doing the same math on the prompt again.
1
11
sensenova runs the first 4 layers, then the middle 24, then those same 24 again, then the last 4. that's 56 steps. the arrow between the two middle boxes is the whole trick. whatever comes out of pass one goes straight into pass two.
1
10