Enlybee retweeted
Have you ever wanted to train LLMs in pure C without 245MB of PyTorch and 107MB of cPython? No? Well now you can! With llm.c:
github.com/karpathy/llm.c
To start, implements GPT-2 training on CPU/fp32 in only ~1,000 lines of clean code. It compiles and runs instantly, and exactly matches the PyTorch reference implementation.
I chose GPT-2 to start because it is the grand-daddy of LLMs, the first time the LLM stack was put together in a recognizably modern form, and with model weights available.
Enlybee retweeted
I think AI agentic workflows will drive massive AI progress this year — perhaps even more than the next generation of foundation models. This is an important trend, and I urge everyone who works in AI to pay attention to it.
Today, we mostly use LLMs in zero-shot mode, prompting a model to generate final output token by token without revising its work. This is akin to asking someone to compose an essay from start to finish, typing straight through with no backspacing allowed, and expecting a high-quality result. Despite the difficulty, LLMs do amazingly well at this task!
With an agentic workflow, however, we can ask the LLM to iterate over a document many times. For example, it might take a sequence of steps such as:
- Plan an outline.
- Decide what, if any, web searches are needed to gather more information.
- Write a first draft.
- Read over the first draft to spot unjustified arguments or extraneous information.
- Revise the draft taking into account any weaknesses spotted.
- And so on.
This iterative process is critical for most human writers to write good text. With AI, such an iterative workflow yields much better results than writing in a single pass.
Devin’s splashy demo recently received a lot of social media buzz. My team has been closely following the evolution of AI that writes code. We analyzed results from a number of research teams, focusing on an algorithm’s ability to do well on the widely used HumanEval coding benchmark. You can see our findings in the diagram below.
GPT-3.5 (zero shot) was 48.1% correct. GPT-4 (zero shot) does better at 67.0%. However, the improvement from GPT-3.5 to GPT-4 is dwarfed by incorporating an iterative agent workflow. Indeed, wrapped in an agent loop, GPT-3.5 achieves up to 95.1%.
Open source agent tools and the academic literature on agents are proliferating, making this an exciting time but also a confusing one. To help put this work into perspective, I’d like to share a framework for categorizing design patterns for building agents. My team AI Fund is successfully using these patterns in many applications, and I hope you find them useful.
- Reflection: The LLM examines its own work to come up with ways to improve it.
- Tool use: The LLM is given tools such as web search, code execution, or any other function to help it gather information, take action, or process data.
- Planning: The LLM comes up with, and executes, a multistep plan to achieve a goal (for example, writing an outline for an essay, then doing online research, then writing a draft, and so on).
- Multi-agent collaboration: More than one AI agent work together, splitting up tasks and discussing and debating ideas, to come up with better solutions than a single agent would.
I’ll elaborate on these design patterns and offer suggested readings for each next week.
[Original text: deeplearning.ai/the-batch/is…]
Unlock POWERFUL AI Marketing with Google's P-Max! youtu.be/B1uFnE9dsso via @YouTube
1
103
Welcoming the Year of Tiger -Our way🐯👻🎉 Happy Chinese New Year 2022 youtu.be/bHf48_ZGTJ4 via @YouTube
2
Enlybee retweeted
#Westlife, with great popularity in China for years, sang the Chinese song "the road to ordinary" at its online concert.
Favorite band singing a favorite song.
Happy.
How To Make China Your Market 2022: The 8 Steps Localisation Marketing S... youtu.be/DZBOnatpPvk via @YouTube
How-large-is-the-market-for-mobile-video-in-China?😁🧐🤑
enlybee.com/guide-to-china-v…
Why is localisation important?
Discover the key 8 steps on a great strategy:🎢
👍1. Market research on local competitions
👍 2. Organise your message right
👍3. Overcome the language barriers and cultural differences
4,5,6,7,8👇
enlybee.com/the-most-compreh…
Tik Tok vs Douyin (China Tik Tok) 🤳✌
It is similar but different.
enlybee.com/how-to-download-…
Learn How The Douyin Algorithm Works in 1 Minute😎
✔The Completion Rate
✔The Number of Likes
✔Comment Count
✔Number of Followers
✔Reposts and Shares
Find out more from our blog. #Douyin
These two biggest search engines in the world. Which is better for your brand?🤔
enlybee.com/baidu-sem-ppc-vs…
Enlybee retweeted
🥰"Hi, everyone. I wanna say thank you to you guys and I hope you could enjoy my tennis. I'm thrilled to win. Love you all, see you."
-#EmmaRaducanu, whose mother is Chinese from Shenyang, China's northeastern Liaoning Province, spoke in mandarin after the #USOpen triumph.
From fashion websites like Shein, to entertainment websites like iQiyi to view Jaehyun...Check it out!
enlybee.com/chinas-top50-web…
We have published two #Baidu related articles recently, from #ChinaAdvertising to #ChinaSEO, from for beginners to for experts. 👇🎯
enlybee.com/the-best-beginne…
In order for UK institutions to grow in the #Chinese education market, they need the assistance of a #digitalmarketing agency that is familiar with the Chinese market, especially if there are marketing limitations. Read more about it in our latest article: https://xitter.gq/t.co/NXDSTTw2gy
1
Enlybee is an innovative resource #marketplace specialising in helping UK schools to increase online reputation and visibility to achieve leads for #Chinese students. Find out more by visiting our website: enlybee.com/
With the popularisation of network capabilities, an increasing number of #Chinese people are spending time on short videos. Find out the top 10 video #marketingplatforms in China to help you to grasp the general situation of China video marketing: https://xitter.gq/t.co/wJ9ud0HSyq
The pandemic has also spurred the innovation of China’s #socialmediamarketing. For #Chinese young people, they tend to spend much of their time on China’s largest short-form video app, Douyin. Read this article about Douyin: https://xitter.gq/t.co/xfXKiBJTNl
1









