Pinned Tweet
Inspired by the Generative Agents paper I decided to create a small sandbox game to test out a few LLM models over the weekend. Running LLAMA2-7B on this one.
Leonardo Menezes retweeted
Congrats to the team! Amazing to run a model of Muse Spark Open's caliber and scale this efficiently, right from your desk. Mac Studio keeps pushing the boundaries of on-device AI!
Leonardo Menezes retweeted
explicando rapidamente sobre como a marca d'água "invisível" da Anthropic vai funcionar p qm tiver curiosidade:
1. assuma um LLM como uma função f(tokens) -> probabilidades próximo token; você define o próximo token, simplificadamente, com argmax(f(tokens))
2. crie um hash: seed = hash(tokens) // igual uma árvore binária, o hash vai dividir todo o vocabulário em 2 grupos A e B
3. agora próximo token = argmax(f(tokens) + ε) onde ε > 0 se o token pertencer a A, por exemplo
isso vira uma "marca d'agua" porque agora você pode pegar um texto e pra cada token, ver qts % dos tokens preditos eram do grupo A (que foi boostado)
se % > threshold arbitrário, pode-se assumir que foi aquele LLM q gerou o texto
Does anyone have any recommendations of non-profits teaching or involved with coding?
I would love to help and I’m researching options (preferably orgs in Brasil)
TIL that you can write code to control your monitors with DDC.
I will never click a button on a monitor again.
Also, link to my new article about my desktop build for this year: ltmenezes.dev/posts/desktop-…
Yesterday I was compiling a mobile application that I'm building and it took 5> minutes on Windows on a high-end PC. The build took so long that I bought a Mac mini M4 before it was finished.
Development on Windows is getting worse with time, we desperately need WSL1.0 back.
"Most Brazilians I talk to have 1) no idea about investing outside Brazil"
The real problem is that people have a very strong bias towards investing locally. The same issue happens with europeans over-indexing in their own stock market.
Go long S&P500, forget your local market.
🇧🇷 The Brazilian Real currency should be on crypto exchanges because it's the biggest shitcoin ever
Imagine losing 19% of your money every year!
Or 32% in the last 5 years!
Most Brazilians I talk to have 1) no idea about investing outside Brazil, 2) no idea about investing in the first place
When they do have they only talk about Brazilian investment products offered by their bank, or they jubilate about the great Brazilian bonds that pay with 15%/year return
That 15%/year return makes no sense though if you lose 19%/year to the BRL perpetually crashing against the USD (ever since it existed it went down)
For example:
US$1,000 invested by a Brazilian in Brazilian bond a year ago would be:
US$1,150 (+15%) after 1 year IF the currency would remain stable but it didn't, it dropped -19.07%, meaning you actually now have
US$930 (-7%)
A terrible investment
Every Brazilian I meet I try make them open a brokerage account like IBKR (not affiliated) to just get them to buy into investments outside Brazil
Brazilians are very patriotic so it's not easy to convince them about stuff OUTSIDE of Brazil
That patriotism makes no sense though when Brazil's currency has been turned into a shitcoin by its corrupt governments who use it to rob from the people for decades
Back on X after a short break in Tokyo, aka the best city in the world.
Also shipping a new app soon, dm me if you like eating out/travelling and want to test it out!
Just released a hack project I've worked on for the past few days.
Fences is an LLM-augmented OpenAPI spec interpreter, it automatically categorizes endpoints, generates request bodies, and learns based on past req/responses.
Try it out on 'pip install fences-api; fences'
What a sad day for Brazil.
We’re slowly marching towards a more regionalised internet, where governmental reach is more important than individual rights online.
Thanks to everyone from Brazil who connected with me, us expats will continue to voice our opinions on here.
I got my first job as a programmer because I wanted to meet other people who also liked coding.
Now I get to work on one of my favorite products and talk to people building awesome stuff every day, what a privilege.
Valeu todo mundo pelo apoio ao video de ontem! Foi muito massa ver como ele foi útil para vocês e a repercussão que ele teve!
Como muitos pediram sobre recursos para estudar mais sobre System Design queria compartilhar um dos melhores pontos de partida: o system-design-primer (link nos comentários). System Design é uma área gigantesca (BDs, redes, Filas, etc) então não tem como recomendar apenas um recurso, mas o primer é um bom guia de estudo para começar.
Deixa nos comentários se tem alguma área especifica que você tem dúvidas para eu recomendar outros livros/sites ou gravar um video no futuro.
Augusto e eu exploramos como ele faria a arquitetura de um serviço de streaming com limite de usuários simultâneos, ficou massa!
Curiosidade: fazemos esses vídeos sem ele ter qualquer contexto prévio, então ele realmente está resolvendo esses problemas ao vivo.
74 / 100 - Tópicos de entrevistas Senior Engineer
Entrevista de System Design ao vivo.
com: @ltmenezes