
Local AI. Building @picogpt Download: https://xitter.gq/t.co/o0PKhVM691 Discord: https://xitter.gq/t.co/KNirjAzl32
San Francisco, CA
Joined April 2008
- Tweets28.9K
- Following6.5K
- Followers6.9K
- Likes105K
Pinned Tweet
Apple Silicon + Gemma 4 fans: this is for you.
Pico AI Server now supports continuous batching with MLX-Swift.
43 tok/s on 1 stream.
26 tok/s per stream on 2 concurrent streams.
That’s 52 tok/s total. a 21% throughput gain on a six-year-old MacBook Pro M1 Max!
Oh no. Captain Picard will always be my favorite captain
In lieu of flowers, memorial contributions may be made to:
Johns Hopkins Alzheimer’s Disease Research Center Fund
alzresearch.org/giving/
Alzheimer’s Foundation of America Caregiver Resources
alzfdn.org/donate/
Photo Credit: Tommy Garcia
Interesting
Finally figured out why the 512GB M5 Ultra costs so much.
The M5 Ultra has 64 RAM channels.
The 256GB model stacks standard 4GB LPDDR5X chips on each channel.
To hit 512GB, Apple needs custom, ultra-dense 8GB chips per channel.
That special RAM is why the price is higher.
Honestly, for regular buyers, getting two 256GB models makes way more sense and costs less.
Linking them with Thunderbolt 5 gives you 120Gb/s (around 15GB/s).
That connection is pretty slow on its own, but clustering two machines roughly doubles your total memory bandwidth.
Plus, you can just run two smaller models separately whenever you want.
I am probably just going to buy two 256GB units instead.
TL;DR: we haven’t scratched the surface what AI can do
So one of our ambassadors @divagr1925 has been working on something cool
He found a way to use Qwen's Gated DeltaNet state as memory, and built a 32-bit RISC-V CPU directly into the model's weights. So instead of relying on predicting the answer to a calculation, the model can execute instructions internally. It can also run C and MicroPython programs.
He calls it Qwenputer, love the name btw. The results so far are pretty impressive. On one arithmetic benchmark, accuracy jumped from 48.6% to 100%.
Pretty cool to see developers experimenting with Qwen's architecture. Great work, my friend!
Local AI software, libraries, and startups are booming. Within 3 to 6 months, many more people will realize local AI is already a viable alternative to the cloud.
Today we're coming out of stealth, introducing Neywa Labs 🚀
We built the infrastructure to build and deploy AI that runs on the devices people already own. Private, offline, unlimited.
One mission: make AI available to everyone in the world.
neywalabs.ai/
This is great. And if you need to read, write or edit the old iWork files, I have a WIP library for that: github.com/PicoMLX/PicoDocs
Big news today from Apple: Keynote is getting an open, JSON-based file format (.keyx), plus a Python library to create Keynote files on any platform.
Pages, Numbers and Keynote files today are closed and hard to modify unless you use AppleScript (limited and old) or Shortcuts (a huge pain), so you can’t really use AI to make documents in those formats. This was a HUGE pain inside Apple as well as outside, and most tools worked around it by making a PowerPoint file and importing it into Keynote, which wasn’t perfect.
Creator Studio subscribers on the Mac also get MCP support in Keynote, Pages and Numbers, so you can bring your own AI agent to read, edit and automate all three. Both the new format and MCP support arrive in November.
Bringing an AI-friendly format to Keynote (and I assume Pages and Numbers soon after) is a big positive change.
So basically, a non-foldable iPhone Duo for a third of the price
Looks like this is going to be a week of Apple press releases, starting today with the new OLED iPad Mini
- 8.5" OLED display
- A20 Pro chip
- "Acoustic display" instead of speaker grilles
- IP67 rating
- N1 and C2 chips
- Starting at $699 (+$200 from last gen)
My take: WAY better screen, WAY better chip, so a very welcome refresh. Very curious to try this audio system. but also I can't find any mention of 120Hz or ProMotion on the website, so.... 60Hz?
apple.com/newsroom/2026/10/a…
You know what? Let’s forget this ever existed. Let’s wait another year or so until the technology catches up. We’ll get there, but this isn’t it.
Watch Episode 1 of our Odyssey series made with Grok Imagine.
Let us know in the comments if you'd like a full breakdown of how it was done!
Creative collaboration with @WonderStudiosX and director Dev Walker @glumlot_
Everybody: Please stop posting useless but cool iPhone duo demo. It makes me want to buy one 🤬
STOP IT
⚽️ I’m having WAY too much fun with this game on the iPhone Duo 😂
This is how you take advantage of a foldable!
🥅 The goalie is on the vertical screen
⚽️ You kick the ball using the bottom screen
📱 The entire form factor becomes part of the game!
It genuinely feels like we’re back in the Wild West of apps, when developers made fun, creative experiences just for the sake of having FUN.
We need more of this!! 🔥
I’m still not sure if the vertical controls was a good idea but the open and close transition is a timeless gem (that will be copied by everyone I’m sure)
























