God of SaaS, Software Engineer, Techvangelist. co-lead @logistixafrica
Earth
Joined November 2019
- Tweets1K
- Following211
- Followers149
- Likes680
Barnie retweeted
I'm more and more confident that tokenization will be gone.
Humans don't think in "tokens".
Tokens are hardcoded abstractions in LLMs that lead to weird behavior: LLMs can solve PhD-level math questions but cannot answer "Is 9.9 > 9.11?"
Meta is shifting LLMs to LCMs (Large Concept Models), changing "next-token prediction" to "next-concept prediction". A "concept" is treated as a sentence, representing an abstract idea or action.
Two weeks ago, Meta also published the "Byte Latent Transformer", a new architecture that processes raw bytes grouped into patches instead of relying on tokenization.
My intuition says LCM is probably better at reasoning and modalities.
Barnie retweeted
A prompt that helps Claude 3.5 Sonnet beat OpenAI's o1 model in reasoning!
Can @AnthropicAI Claude 3.5 sonnet outperform @OpenAI o1 in reasoning? Combining Dynamic Chain of Thoughts, reflection, and verbal reinforcement, existing LLMs like Claude 3.5 Sonnet can be prompted to increase test-time compute and match reasoning strong models like OpenAI o1. 👀
TL;DR:
🧠 Combines Dynamic Chain of thoughts + reflection + verbal reinforcement prompting
📊 Benchmarked against tough academic tests (JEE Advanced, UPSC, IMO, Putnam)
🏆 Claude 3.5 Sonnet outperformes GPT-4 and matched O1 models
🔍 LLMs can create internal simulations and take 50+ reasoning steps for complex problems
📚 Works for smaller, open models like Llama 3.1 8B +10% (Llama 3.1 8B 33/48 vs GPT-4o 36/48)
❌ Didn’t benchmark like MMLU, MMLU pro, or GPQA due to computing and budget constraints
📈 High token usage - Claude Sonnet 3.5 used around 1 million tokens for just 7 questions
Barnie retweeted
Reboot camp 2023 first night🥹🔥🔥.
#Rebootcampiscoming
Barnie retweeted
They are not celebrating the independence of Nigeria, they are celebrating their independence from Nigeria. The two aren't the same!!!😤
Barnie retweeted
AAAI is delighted to announce our partnership with GITEX GLOBAL 2024 as a Community Partner. GITEX GLOBAL is one of the world's most significant and influential technology exhibitions, held annually in Dubai, UAE. The event attracts tech giants, startups, investors, and industry leaders from around the globe to showcase groundbreaking innovations, discuss future trends, and promote collaboration. Covering a wide range of sectors, including artificial intelligence, 5G, cloud computing, cybersecurity, fintech, and smart cities, GITEX GLOBAL is a premier platform for networking, knowledge exchange, and business opportunities.
The event also features numerous conferences, workshops, and live demonstrations, offering valuable insights into the latest advancements and strategic developments in the tech industry. Join this transformative event and witness the future of technology unfold in Dubai. Learn more: gitex.com/
Barnie retweeted
Register today for @hcomp_conf, held October 16-19th in Pittsburgh, Pennsylvania. This year's theme is ''Responsible Crowd Work for Better AI.''
More information: bit.ly/46MIpl2
#hcomp2024
Barnie retweeted
The root of inner healing is in forgiveness. When you forgive people, you limit the actions of entities that you do not like, in your life.
@Piidii19
#Boundaries
Barnie retweeted
Kindly presave my new album🥹🔒❤️ Decagon here lnk.fuga.com/anendlessocean_… 2weeks till we feast
Barnie retweeted
Startups should think like Nike.
Sell a lifestyle.
Sell a goal.
Sell a story.
Celebrate your customers.
Because brand affinity is a defensible moat.
Barnie retweeted
Learning useState and useEffect was one of the weirdest things about learning React.
I watched so many tutorials, read articles, and even read the docs! I just couldn't understand it and then one day it just CLICKED!
Barnie retweeted
Happy Democracy Day from us at Logistix.africa
#Nigeria #democracy #delivery #DemocracyDay2023 – at Victoria Island, Nigeria
