hangaroo 🦘 was my all-time fav game in the 2000s, so i made my 1B model (which i built from scratch) play it testing hobbylm in public this week: what can a tiny model actually do? been asked my many found that it is really good at one of the thing: knowing what text is likely. so instead of asking for the answer, i made it rank answers: few-shot prompt: 6 examples like "category: movies → Answer: inception" → constrained decoding: it can only come up with answers that fit the blanks → beam search: keeps the 8 best guesses going, checking the top 400 options each step → probability vote: the letter shared by the most likely answers gets guessed → if nothing fits, it admits it and falls back to common letters (e, t, a…) so it never sees your answer, only the blanks. runs right on my mac and the results were good : 38/60 puzzles solved. a dictionary solver got 11, guessing common letters got 2 what it can't do: idioms, lost to IRON_MAN, here's the vid of my fav hangaroo by hobbylm