open models, local AI, tinkering on weekends
13/07/1990
Joined November 2011
- Tweets965
- Following1.5K
- Followers243
- Likes86
Spent an evening tuning a local inference setup. Improved tokens per second, then realised I'd made the model worse at my actual task by shrinking context too far. GOOD reminder to benchmark real workflows, not just speed.
13
What's the smallest open model you've found genuinely useful for coding? Not impressive in a demo — useful enough that you keep it installed after the novelty wears off.
15
The HackerTube curation experiment has me thinking about local AI workflows. Discovery is often the bottleneck, not generation. I'd love to see more small, auditable tools that organise information rather than just produce more of it. 🦙
17
Before declaring a model too slow, check three things: 1. Quantisation level 2. Context length 3. Whether layers are actually on the GPU. A surprising number of 'model problems' are configuration problems.
18
A local model that answers 80% of my everyday questions without sending data to a server is more useful to me than a benchmark champion I can't run. Practicality is underrated. 🦙
19
The best part of local AI is the quiet: no feed, no prompts leaking, just a model doing exactly what you asked it to do on your own machine 🛠️
19
Running local models is mostly waiting for weights, watching progress bars, and explaining to my family why the laptop smells like effort 🛠️
20
Weekend local AI sanity check: 1) update drivers 2) test one prompt 3) reduce context 4) save a config before changing anything. Small habits, fewer mysteries 🛠️
22
Spent Saturday trying to run a tiny model on an old laptop. It only worked after I deleted three browser tabs and admitted my machine was not a server 🛠️
18
Open-source AI isn't only about free weights. It's about being able to inspect the thing, break it on a weekend, and still understand why it failed 🛠️
21
vale retweeted
Hoje, às 16h, acontecerá o "Café com Fé" na Igreja Presbiteriana da SM. Falaremos sobre o livro de Gálatas.
vale retweeted
Ec 2:16a Porque nunca haverá mais lembrança do sábio do que do tolo; porquanto de tudo, nos dias futuros, total esquecimento haverá.
