Building Transformers.js at 🤗 @huggingface // @GoogleDevExpert for #WebTechnologies and #AI

Thun, Switzerland
Joined April 2015
I'm sooooo soo happy to see the first snow in the mountains😍
2
28
477
I turned structured output into a game 🎮 The LLM scores the next tokens. You pick one. The constraints decide if it’s allowed. Most likely ≠ valid. Even a capital letter can lose you points. Watch the demo. Play it yourself below 👇
3
11
397
New York, here I come! 🗽 On Nov 16 I'm speaking at JSNation US about multimodal AI agents that see, hear and remember, all running entirely in your browser.
Voice, vision and memory, all running in the browser. No backend, no API keys 🙌 @nicodotdev, Machine Learning Engineer at @huggingface, shows how WebGPU and WebAssembly make real-time AI agents possible on the open web. Join us at JSNation US 👇 jsnation.us/
2
12
297
More Ternary Bonsai 2 models from @PrismML just dropped: 2B, 4B, 9B, 27B 🌱 Hundreds of tok/s on consumer hardware, fully in the browser with custom WebGPU kernels. At ~1.8 bits/weight the 2B is just 430MB. Local agentic AI is getting wild 🤯
Today has been one of the biggest days for open-source AI this year... and it keeps getting better. @PrismML just released more Ternary Bonsai 2 models on Hugging Face: now in 2B, 4B, 9B, and 27B. The 2B reaches up to 500 tok/s on my M4 Max ENTIRELY in the browser with custom WebGPU kernels... that's insane! 🤯 At ~1.8 bits per weight, the language-model weights are just 430MB for 2B and 950MB for 4B (plus ~365MB for the 8-bit vision weights). The future of local agentic AI is going to be wild. Try out the demo yourself 👇
1
11
614
Next week I'll be at F{AI}R, an AI unconference in Liebefeld, Bern 🇨🇭 The best part of unconferences: the schedule is built together on the spot, and the best moments usually happen over coffee, not on stage.
4
11
523
I'll bring some input on running AI directly in the browser, but mostly I’m looking forward to the conversations. Got a topic? Submit a session. Entry is free. fair.siliconlovefield.ch/sch…
2
84
The prompt says what we want. The constraints define what’s allowed. Token Arcade lets you step through that distinction yourself: probabilities, token choices, rejected continuations, and explanations. Code: github.com/nico-martin/token…
43
Multimodal similarity search in the browser❤️!
NEW: EmbeddingGemma 2 just released on Hugging Face. Project text, images, video, and audio into a single, unified embedding space. At just 740M parameters, it can even run 100% locally in your browser on WebGPU with 🤗 Transformers.js! Try it yourself 👇
2
1
14
1,321
🤷 Nico Martin retweeted
AI that runs in your browser, on your hardware, without calling the cloud? That’s not boring. That’s pretty handy. In “Boring but Effective: WebAI That Ships,” Nico Martin shows how small open models can handle useful tasks right in the browser - from semantic search to speech recognition and background removal. No API key, no cloud subscription, no giant download. Just WebAI that’s ready to get to work. @nicodotdev is a Machine Learning Engineer focused on WebML at Hugging Face, and a Google Developer Expert in AI and Web Technologies. He makes it easier for web developers to bring machine learning into the browser - and shares what he learns through workshops, articles and talks. 🟡 Catch the replay: youtube.com/watch?v=WfojGcUb…
1
1
165
Today marks one year at @huggingface 🤗 Transformers.js went from 150k to 3.7M weekly downloads, we shipped v4, Tokenizers.js, structured output and 207 WebGPU kernels. I wrote down the whole story 👇 linkedin.com/pulse/one-year-…
1
1
58
1,176
🖐️ No clicks, no scripts — just an AI agent driving the browser itself. @nicodotdev, Machine Learning Engineer at @huggingface, built a multimodal AI agent that runs entirely client-side and holds context across conversations. Catch the talk 👉 jsnation.us/
1
1
1
608
I'll be back in SF for Web AI Summit! A year after the v4 preview, Transformers.js went from 1.7M to 10M monthly downloads. Come see what shipped. Also, @xenovacom will be talking about agents optimizing GPU kernels at web scale. The whole WebAI world in one room: rsvp.withgoogle.com/events/w…
2
16
739
🤷 Nico Martin retweeted
GLiNER2.5-Decide now runs entirely in your browser 🎉 ONNX weights + a WebGPU demo in @nicodotdev's open-jev: 4 typed decisions in ~100 ms on a MacBook, and your text never leaves the tab. Try it: huggingface.co/spaces/shreya…
Introducing GLiNER2.5-Decide, our new 340M parameter open weight, encoder-based decision model. GLiNER2.5-Decide is built for fast, deterministic classification. The model evaluates a set of user-defined typed questions and rules, and jointly decodes their answers, returning structured decisions with probability distributions and confidence scores. We evaluated the model’s performance on Fast Decisions, an unseen, internally generated classification suite based on 17 datasets testing real-world use cases across routing, triage, classification, sentiment, and content understanding. Measured against similar decision models, GLiNER2.5-Decide leads in 9 of the 17 datasets, achieving the highest average score: - GLiNER2.5-Decide: 60.1% - SemIf: 56.4% - JevK5: 57.5% - Laya: 46.6% This performance makes the model a strong fit for use cases like tool calling, model routing, browser and computer use, and LLM-as-a-judge. GLiNER2.5-Decide’s lightweight encoder architecture makes it easy to fine-tune the model for specific tasks, while being efficient enough to run locally on consumer-grade CPUs or in air-gapped environments, giving users greater control over where their data goes and where the model runs. To make building and experimenting with GLiNER2.5-Decide as easy as possible, we're also offering hosted inference. You can now use our API to run inference and fine-tune GLiNER models on specialized tasks right inside your own coding agent: agent.fastino.ai As with previous models, we’re also releasing the model weights on @huggingface under the Apache 2.0 license: huggingface.co/fastino/GLiNE…
8
6
22
1,149
Jev is the most exciting AI release in months. So I built the open, in-browser version 🎉 open-jev: System One style decisions running 100% on your device. Text in, typed answers out, one forward pass. Nothing is generated, so it can't hallucinate.
17
23
3
155
19,689
Under the hood: the KEV models by @jaredpalmer , open Apache-2.0 decision models with the same contract as @typesafeai 's Jev. Not the same model, but the same shape. I converted them to ONNX and they run on your GPU via WebGPU 🔥 huggingface.co/onnx-communit…
1
6
979