
Research engineer (NLP) at @GoogleDeepMind | Content Creator at https://xitter.gq/t.co/FYEt8IyaL1
Joined July 2017
- Tweets158
- Following140
- Followers227
- Likes344
1/ Tabular foundation models (TabPFN, TabFM) process the entire training set on every prediction (or KV-cache it, costing memory). Subsample it and inference gets cheaper, but accuracy drops.
My new paper: you can get much of that accuracy back with a single linear layer. ๐งต
1
7
356
4/ Results on 38 TabArena datasets, TabPFN-3 and TabFM:
โข Beats the unaligned student in ~80% of cases (statistically significant)
โข At 10% context, closes ~half the gap to the full-context model
1
42
5/ Paper: huggingface.co/papers/2610.0โฆ
Interactive explainer: yoel-zeldes.github.io/tabaliโฆ
Code: github.com/yoel-zeldes/tabalโฆ
23
๐ค We all know that when machines will come to destroy us they'll look and behave like humans (you did see The Terminator, didn't you?)
So it's a basic skill to be able to determine whether you talk to a human or an AI bot. Let's see if you can!
Weโre excited to share our latest innovation with the world and have it launch today on @ProductHunt!
Introducing our latest gaming experiment, โHuman or Not?โ - the first ever Social Turing Game. ๐พ humanornot.ai
1
256
ืชืืื ืจืฆืืชื ืืืขืช ืื ืงืืจื ืื ืืื ืื ืืืจืื ืื ืฉื ืืืืื ืืจื ืกืคืืจืืจ? @CohenShuki ืืื ื ืืจืืื ืืกืจืืื ืืื ืืืืื ืืื ื ืืช ืืชืืืืช ืฉืื ืฉืืื ืืืจ ืฉืืื. ืืืงืื ืืืืืช ืืคืื ืืกืืคื ืืฉืืื ืืจืืืช ืืช ืืชืืืืช, ืืคืฉืจ ืืฉืืื ืืช ืืืืื ืื ืชืืืืช ืืืื ืืื ืืฉืืืืช ืืืื ืืื ืฉืื!
ืืกืจืืื ืืืื: youtube.com/watch?v=b6BnhqWQโฆ
1
1
155
ืืืืชื? ืืขืืื! ืืืฅ ืืืกืคืจ ืืืืจืืื ืขื ืขืจืืฅ ืืืืืืื ืฉืื ื One Shot Learning, ืื ืื ื ืจืืฆืื ืฉืชืืขื ืฉืื ืกืจืืื ืคืจืืื ืืืจืืข ืฉื ื ืืืืืื ืฉืื ื, ืื ืื ืื ื ื ืฆืื ืืื ืงืื (ืืชื!) ืืช ืืฉืื ืืื ืฉืื ื! ืืฉืื ืื ืื ื ื ืฆืืื ืืขืืืง ืื ืืื ืขืื ืชืืื ืืช ืืขื ืืื ืืช ืื ืืื ืืช ืืืื ื ืฉืื ื ืฉื ืื ืงืืจื ืืฉืืืืช ืืฉืื ืืช.
1
83
ืคืจืืื ืืืืฉื, ืืื ืืื ืชืืื - ืฉืจืืื ื ืืช 22/5 ;)
ืจืืฆืื ืืืชืขืืื ืืคืจืืื ืืืื ืืืจืืข?
ืืชื ืืืืื ืื ืืืฆืืจืฃ ืืงืืืืช ืืืืืจื ืฉืื ื - t.me/one_shot_learning
ืืฉืืืื ืงืืืืื ืืืืจืฉืื ืืจืฉืืืช ืืชืคืืฆื, ืืงืจื ื-oneshotlearning.io
66
ืืืืชื? ืืขืืื! ืืืฅ ืืืกืคืจ ืืืืจืืื ืขื ืขืจืืฅ ืืืืืืื ืฉืื ื One Shot Learning, ืื ืื ื ืจืืฆืื ืฉืชืืขื ืฉืื ืกืจืืื ืคืจืืื ืืืจืืข ืฉื ื ืืืืืื ืฉืื ื, ืื ืื ืื ื ื ืฆืื ืืื ืงืื (ืืชื!) ืืช ืืฉืื ืืื ืฉืื ื! ืืฉืื ืื ืื ื ื ืฆืืื ืืขืืืง ืื ืืื ืขืื ืชืืื ืืช ืืขื ืืื ืืช ืื ืืื ืืช ืืืื ื ืฉืื ื ืฉื ืื ืงืืจื ืืฉืืืืช ืืฉืื ืืช.
1
51
ืคืจืืื ืืืืฉื, ืืื ืืื ืชืืื - ืฉืจืืื ื ืืช 22/5 ;)
ืจืืฆืื ืืืชืขืืื ืืคืจืืื ืืืื ืืืจืืข?
ืืชื ืืืืื ืื ืืืฆืืจืฃ ืืงืืืืช ืืืืืจื ืฉืื ื - t.me/one_shot_learning
ืืฉืืืื ืงืืืืื ืืืืจืฉืื ืืจืฉืืืช ืืชืคืืฆื, ืืงืจื ื-oneshotlearning.io
42
ืืื ืื ืื ืืืง ืืืื, ืืื ืชืงืืข ืืฉื ืช 2021...
ChatGPT, ืืืืข ืืืื ืืขืืื ืืืชื ืขื ืงืฆืช ืืืข ืืืชืงืืคื ืืืืจืื ื!
ืฆืคื ืืืืืื ืฉืื ืืฉื @CohenShuki ืืื ืืจืืืช ืืื ืขืืฉืื ืืช ืื - ืืงืื ืืืื!
ืืืื ื ืฉืืขื ื ืืื ChatGPT ืืื ืืขืืื ๐คฉ, ืืื ืืื ืื ืืืืข ืืืืื ืขืืื ื ืืขืืจ ืืกืคืืืืจ 2021. ืืืฉื, ืืื ืืืืจืื ืืฉ ืื? ืืืืื ืฉืืื ืื ืืืข ืืขื ืืช ืฉืืฉ ืื ืืืจ ืืขื ืืืืืื ืืืืจืื...
ื One Shot Learning ืื ื ื @YZeldes ืืื ืืื ื ืืืชืืืื ืืืืืง ืขื ืืืขืื ืืื
1
186
Exciting news to those of you who wish to use the power of Large Language Models but fear for data privacy! You can now deploy @AI21Labs Jurassic-1 on your private SageMaker env!
Haven't yet discovered the capabilities of generative AI? Visit our website, experience it yourself!
Our Co-founder & Co-CEO @origoshen kicking off @awscloud #reInvent2022 with an exciting announcement: you can now deploy our LLM Jurassic-1 on your private SageMaker environment!
ืฉืืื #ืคืืืืง
ืืฉ ืื ืืฉืื ืืขื ืืื ืืืฆืืข ืืื ืฉืฆืืจื ืืจืื ืืืืข ืืชืื - ืื ืื ืืื ืื ื-Wordtune Read! ืืชืืชื ืืช ืื ืืคืจืืื ืคื:
linkedin.com/posts/yoelzeldeโฆ
1
2
ืืชืืื ืืื ืืื ืขื ืืืฉืืื! ืื ืืฆืืืชื ืืืคืก ืืกืืื ืงืฉื ืืงืืจ, ืืื ืืืจืชื ืืืฉื ืืช ืืชืืจืก ืืคื ื ืฉื ืจืงื!
1
ืืืกืฃ ืืืจื ืฉื ืืืช ืฉืื ืืืื.
ืืืืจื: "ืชืกืืื ืืช ืืชืืง ืฉืื!"
ืื ื: ืืชืขืื ืืืืื ืืืืช ืืืืฉืืฃ ืืื ืืคืืืฆืื ืฉืื.
1
ืืช ืืฉืจืฉืืจ ืืื ืืชื ืืืฉื? ืื... ืืื ืื ืื, ืืื ืืื ืืื ืืกืืื ืืืชืื ืฉืจืฉืืจืื ืฉืื ืื, ืื ืฉืชืืื ืืื ืืืฆื ืื ืืืชื ืืืืจ?
@YuvalinTheDeep ืืกืืืจ ;)
1/ ืืืื ืฉืคื ืืืขืืช ืืืืข ืืืฉืืื ืืงืกืืื. ืืื ืืชืงืฉืจ ืืขืืจืช ืืืงื ืื (ืืงืื ื - ืคืืจืืง ืฉื ืืืงืกื ืืืืืืืช ืงืื ืืช, ืืื ืฉืื ืื ื ืืชืงืฉืจืื ืืขืืจืช ืืืืื), ืืื ืืื ืืฉ ืื ืืืืจื ืืืคืฉืืช? ืืื ืชืืื ืืืืจ ืืช ืืืชื ืืืงื ืืืื ืชื ืจืฆืฃ ื ืชืื? ืื ืฉืื ืคืขื ื ืงืื ืืฉืื ืืืจ? ืืืื ืคืื, ื ืขืฉื ืงืฆืช ืกืืจ >>
1
ืืืืจ ืงืจืืื ืืขื ืืื ืขื ืืืจืื ืฉืืืงืืื ืืืฉืืื ืืฉืืืืฆืจืื ืืืืื ืฉื ืืืงื ืื ืขืืืจ ืืืื ืฉืคื. ืื ืฉืืืื, "developer advocate" ืฆืจืื ืืืืืช ืืืืืื ;)
1/ ืื ืฉืคื ืืืืืงืช ืืืื ื ืื ืืื ืืกืืกืืืช. ืืขืืจืืช, ืืืฉื, ืืฉ ืื ื 22 ืืืชืืืช (ืื ืืืื ืืืชืืืช ืกืืคืืืช ืื ืืืืื ืืืืืื) ืืื ืกืืื ื ืคืืกืืง. ืืืื ืขื ืื ืืื ืื ืื ื ืืืืืื ืืืจืืื ืื ืืงืกื ืฉื ืืชื ืืขืืจืืช. ืืื ืืืืจืื ืืช ืืื ื ืืื ืืื ืืืื ืขืืืจ ืืืืื ืฉืคื? ืืฆืื ื ืืืืืช.
1
[1.54,6.22,5.16], [12.01,96.44,22.87], [1.2,55.3,9.54]
ืื ืืื ืชื? ืื ืืกืืจ, ืื ืืืืชื ืืืืจืื... ืืื ืืืืฉื ืืืื ืื.
@YuvalinTheDeep
ื ืืชื ืืกืืจ ืืคื ืืชืืฆืืชื ืืืื ืืืืฉื ืืขืื ืืืืื, ืืืืฆืขืืช ืืจืื ืืืื ืืกืคืจืื.
1/ ืืฉืขืืืืื ืขื ืืงืกื ืื ืชืืื ืืช, ืฆืจืื ืืืืืจ ืฉืื ืืขืกืง ืืื ืฉื ืืืืืจืืชืืื ืขืืื ืขื ืืกืคืจืื, ืื ืืืชืจ ืืืืืง - ืืงืืืจืื ืฉื ืืกืคืจืื. ืืืืืจ, ืืืื ืชื ืชืืื ื ืื ืืงืกื, ืงืืื ืื ื ืืืจ ืืืชื ืืืงืืืจืื ืฉื ืืกืคืจืื ืืื ื ืืื ืืืชื ืืืืืืจืืชื. ืืื ืืงืื ืชืืฆืืืช ืืืืืช, ืืฉืื ืฉืชืืื ืืืงืืืจืื ืืืื ืืืืืฉืื ืืฉืืขืืช.
2
What would RBG (probably) say?
A couple of weeks ago, @ykilcher, an AI researcher and YouTuber, has finetuned GPT-J 6B on 134.5m posts from the Politically Incorrect board of 4chan. Lots of toxic stuff... Next, he released the model on @huggingface .
1/3
1
4
So I asked @AI21Labs's Jurassic-1 model that was trained on Ruth Bader Ginsburg's data what it thinks about the release. Seems like it agrees with Hugging Face's next move - disabling the inference widget in order not to make it easier to use the model.
2/3
1
1
This is the first #AI drop we at AI21 Labs have launched. More to come ;)
What would RBG (probably) say: ask-rbg.ai
Yannic Kilcher's video about his model: youtube.com/watch?v=efPrtcLdโฆ
3/3
4








