Yoel Zeldes (@YZeldes) header
Yoel Zeldes (@YZeldes) profile picture

Research engineer (NLP) at @GoogleDeepMind | Content Creator at https://xitter.gq/t.co/FYEt8IyaL1

Joined July 2017
Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)Photo by Yoel Zeldes (@YZeldes)
1/ Tabular foundation models (TabPFN, TabFM) process the entire training set on every prediction (or KV-cache it, costing memory). Subsample it and inference gets cheaper, but accuracy drops. My new paper: you can get much of that accuracy back with a single linear layer. ๐Ÿงต
1
7
356
4/ Results on 38 TabArena datasets, TabPFN-3 and TabFM: โ€ข Beats the unaligned student in ~80% of cases (statistically significant) โ€ข At 10% context, closes ~half the gap to the full-context model
1
42
๐Ÿค– We all know that when machines will come to destroy us they'll look and behave like humans (you did see The Terminator, didn't you?) So it's a basic skill to be able to determine whether you talk to a human or an AI bot. Let's see if you can!
Weโ€™re excited to share our latest innovation with the world and have it launch today on @ProductHunt! Introducing our latest gaming experiment, โ€œHuman or Not?โ€ - the first ever Social Turing Game. ๐Ÿ‘พ humanornot.ai
1
256
ืชืžื™ื“ ืจืฆื™ืชื ืœื“ืขืช ืžื” ืงื•ืจื” ื‘ื ื‘ื›ื™ ื”ื ื•ื™ืจื•ื ื™ื ืฉืœ ืžื•ื“ืœื™ ื˜ืจื ืกืคื•ืจืžืจ? @CohenShuki ื•ืื ื™ ืžืจืื™ื ื‘ืกืจื˜ื•ืŸ ืื™ืš ื”ืžื•ื“ืœ ื‘ื•ื ื” ืืช ื”ืชื—ื–ื™ืช ืฉืœื• ืฉื›ื‘ื” ืื—ืจ ืฉื›ื‘ื”. ื‘ืžืงื•ื ืœื—ื›ื•ืช ืœืคืœื˜ ื”ืกื•ืคื™ ื‘ืฉื‘ื™ืœ ืœืจืื•ืช ืืช ื”ืชื—ื–ื™ืช, ืืคืฉืจ ืœืฉืื•ืœ ืืช ื”ืžื•ื“ืœ ืžื” ืชื—ื–ื™ืช ื”ื‘ื™ื ื™ื™ื ื‘ืฉื›ื‘ื•ืช ื”ื‘ื™ื ื™ื™ื ืฉืœื•! ืœืกืจื˜ื•ืŸ ื”ืžืœื: youtube.com/watch?v=b6BnhqWQโ€ฆ
1
1
155
ืื”ื‘ืชื? ืžืขื•ืœื”! ื—ื•ืฅ ืžืœืกืคืจ ืœื—ื‘ืจื™ื›ื ืขืœ ืขืจื•ืฅ ื”ื™ื•ื˜ื™ื•ื‘ ืฉืœื ื• One Shot Learning, ืื ื—ื ื• ืจื•ืฆื™ื ืฉืชื“ืขื• ืฉื–ื” ืกืจื˜ื•ืŸ ืคืจื•ืžื• ืœืืจื•ืข ืฉื ื” ื”ื—ื’ื™ื’ื™ ืฉืœื ื•, ื‘ื• ืื ื—ื ื• ื ืฆืœื ืžื•ืœ ืงื”ืœ (ืืชื!) ืืช ื”ืฉื•ื˜ ื”ื‘ื ืฉืœื ื•! ื‘ืฉื•ื˜ ืื ื—ื ื• ื ืฆืœื•ืœ ืœืขื•ืžืง ื•ื ื“ื•ื’ ืขื•ื“ ืชื•ื‘ื ื•ืช ืžืขื ื™ื™ื ื•ืช ื•ื ื—ื“ื“ ืืช ื”ื”ื‘ื ื” ืฉืœื ื• ืฉืœ ืžื” ืงื•ืจื” ื‘ืฉื›ื‘ื•ืช ื”ืฉื•ื ื•ืช.
1
83
ืคืจื˜ื™ื ื‘ื”ืžืฉืš, ืื‘ืœ ื‘ื™ื ืชื™ื™ื - ืฉืจื™ื™ื ื• ืืช 22/5 ;) ืจื•ืฆื™ื ืœื”ืชืขื“ื›ืŸ ื‘ืคืจื˜ื™ื ืœื’ื‘ื™ ื”ืืจื•ืข? ืืชื ืžื•ื–ืžื ื™ื ืœื”ืฆื˜ืจืฃ ืœืงื”ื™ืœืช ื”ื˜ืœื’ืจื ืฉืœื ื• - t.me/one_shot_learning ืœืฉื•ื˜ื™ื ืงื•ื“ืžื™ื ื•ืœื”ืจืฉืžื” ืœืจืฉื™ืžืช ื”ืชืคื•ืฆื”, ื‘ืงืจื• ื‘-oneshotlearning.io
66
ืื”ื‘ืชื? ืžืขื•ืœื”! ื—ื•ืฅ ืžืœืกืคืจ ืœื—ื‘ืจื™ื›ื ืขืœ ืขืจื•ืฅ ื”ื™ื•ื˜ื™ื•ื‘ ืฉืœื ื• One Shot Learning, ืื ื—ื ื• ืจื•ืฆื™ื ืฉืชื“ืขื• ืฉื–ื” ืกืจื˜ื•ืŸ ืคืจื•ืžื• ืœืืจื•ืข ืฉื ื” ื”ื—ื’ื™ื’ื™ ืฉืœื ื•, ื‘ื• ืื ื—ื ื• ื ืฆืœื ืžื•ืœ ืงื”ืœ (ืืชื!) ืืช ื”ืฉื•ื˜ ื”ื‘ื ืฉืœื ื•! ื‘ืฉื•ื˜ ืื ื—ื ื• ื ืฆืœื•ืœ ืœืขื•ืžืง ื•ื ื“ื•ื’ ืขื•ื“ ืชื•ื‘ื ื•ืช ืžืขื ื™ื™ื ื•ืช ื•ื ื—ื“ื“ ืืช ื”ื”ื‘ื ื” ืฉืœื ื• ืฉืœ ืžื” ืงื•ืจื” ื‘ืฉื›ื‘ื•ืช ื”ืฉื•ื ื•ืช.
1
51
ืคืจื˜ื™ื ื‘ื”ืžืฉืš, ืื‘ืœ ื‘ื™ื ืชื™ื™ื - ืฉืจื™ื™ื ื• ืืช 22/5 ;) ืจื•ืฆื™ื ืœื”ืชืขื“ื›ืŸ ื‘ืคืจื˜ื™ื ืœื’ื‘ื™ ื”ืืจื•ืข? ืืชื ืžื•ื–ืžื ื™ื ืœื”ืฆื˜ืจืฃ ืœืงื”ื™ืœืช ื”ื˜ืœื’ืจื ืฉืœื ื• - t.me/one_shot_learning ืœืฉื•ื˜ื™ื ืงื•ื“ืžื™ื ื•ืœื”ืจืฉืžื” ืœืจืฉื™ืžืช ื”ืชืคื•ืฆื”, ื‘ืงืจื• ื‘-oneshotlearning.io
42
ื›ืœื™ ื›ืœ ื›ืš ื—ื–ืง ื•ื—ื›ื, ืื‘ืœ ืชืงื•ืข ื‘ืฉื ืช 2021... ChatGPT, ื”ื’ื™ืข ื”ื–ืžืŸ ืœืขื“ื›ืŸ ืื•ืชืš ืขื ืงืฆืช ื™ื“ืข ืžื”ืชืงื•ืคื” ื”ืื—ืจื•ื ื”! ืฆืคื• ื‘ื•ื™ื“ืื• ืฉืœื™ ื•ืฉืœ @CohenShuki ื›ื“ื™ ืœืจืื•ืช ืื™ืš ืขื•ืฉื™ื ืืช ื–ื” - ื”ืงื•ื“ ื›ืœื•ืœ!
ื›ื•ืœื ื• ืฉืžืขื ื• ื›ืžื” ChatGPT ื”ื•ื ืžืขื•ืœื” ๐Ÿคฉ, ืื‘ืœ ื”ื•ื ืœื ืžื•ื“ืข ืœื“ืื˜ื” ืขื“ื›ื ื™ ืžืขื‘ืจ ืœืกืคื˜ืžื‘ืจ 2021. ืœืžืฉืœ, ื›ืžื” ื™ื•ื–ืจื™ื ื™ืฉ ืœื•? ื›ืžื•ื‘ืŸ ืฉื”ื•ื ืœื ื™ื“ืข ืœืขื ื•ืช ืฉื™ืฉ ืœื• ื›ื‘ืจ ืžืขืœ ืžื™ืœื™ื•ืŸ ื™ื•ื–ืจื™ื... ื‘ One Shot Learning ืื ื™ ื• @YZeldes ื”ืื— ื‘ืื ื• ืœื”ืชืžื•ื“ื“ ื‘ื“ื™ื•ืง ืขื ื”ื‘ืขื™ื” ื”ื–ื•
1
186
Exciting news to those of you who wish to use the power of Large Language Models but fear for data privacy! You can now deploy @AI21Labs Jurassic-1 on your private SageMaker env! Haven't yet discovered the capabilities of generative AI? Visit our website, experience it yourself!
Our Co-founder & Co-CEO @origoshen kicking off @awscloud #reInvent2022 with an exciting announcement: you can now deploy our LLM Jurassic-1 on your private SageMaker environment!
2
2
ืฉืœื•ื #ืคื™ื“ื˜ืง ื™ืฉ ืœื™ ืžืฉื”ื• ืžืขื ื™ื™ืŸ ืœื”ืฆื™ืข ืœืžื™ ืฉืฆื•ืจืš ื”ืจื‘ื” ืžื™ื“ืข ื›ืชื•ื‘ - ืžื ื•ื™ ื—ื™ื ืžื™ ืœ-Wordtune Read! ื›ืชื‘ืชื™ ืืช ื›ืœ ื”ืคืจื˜ื™ื ืคื”: linkedin.com/posts/yoelzeldeโ€ฆ
1
2
ืืชืžื•ืœ ื”ื™ื” ื™ื•ื ืขื ื”ื™ืฉื’ื™ื! ื’ื ื”ืฆืœื—ืชื™ ืœื˜ืคืก ืžืกืœื•ืœ ืงืฉื” ื‘ืงื™ืจ, ื•ื’ื ื–ื›ืจืชื™ ืœื‘ืฉืœ ืืช ื”ืชื™ืจืก ืœืคื ื™ ืฉื ืจืงื‘!
1
ืื•ืกืฃ ื—ื‘ืจื” ืฉืœ ื”ื‘ืช ืฉืœื™ ืžื”ื’ืŸ. ื”ื—ื‘ืจื”: "ืชืกื—ื•ื‘ ืืช ื”ืชื™ืง ืฉืœื™!" ืื ื™: ืžืชืขืœื ื‘ืืœื’ื ื˜ื™ื•ืช ืžื›ื™ืฉื•ืฃ ื”ืžื ื™ืคื•ืœืฆื™ื” ืฉืœื”.
1
ืืช ื”ืฉืจืฉื•ืจ ื”ื–ื” ื›ืชื‘ ืžื—ืฉื‘? ืœื... ืื‘ืœ ืื ื›ืŸ, ื”ืื ื”ื•ื ื”ื™ื” ืžืกื•ื’ืœ ืœื›ืชื•ื‘ ืฉืจืฉื•ืจื™ื ืฉื•ื ื™ื, ืื• ืฉืชืžื™ื“ ื”ื™ื” ื™ื•ืฆื ืœื• ืื•ืชื• ื”ื“ื‘ืจ? @YuvalinTheDeep ืžืกื‘ื™ืจ ;)
1/ ืžื•ื“ืœ ืฉืคื” ื˜ื‘ืขื™ืช ื™ื•ื“ืข ืœื”ืฉืœื™ื ื˜ืงืกื˜ื™ื. ื”ื•ื ืžืชืงืฉืจ ื‘ืขื–ืจืช ื˜ื•ืงื ื™ื (ื‘ืงื˜ื ื” - ืคื™ืจื•ืง ืฉืœ ื”ื˜ืงืกื˜ ืœื™ื—ื™ื“ื•ืช ืงื˜ื ื•ืช, ื›ืžื• ืฉืื ื—ื ื• ืžืชืงืฉืจื™ื ื‘ืขื–ืจืช ืžื™ืœื™ื), ืื‘ืœ ื”ืื ื™ืฉ ืœื• ื‘ื—ื™ืจื” ื—ื•ืคืฉื™ืช? ื”ื•ื ืชืžื™ื“ ื™ื‘ื—ืจ ืืช ืื•ืชื• ื˜ื•ืงืŸ ื‘ื”ื™ื ืชืŸ ืจืฆืฃ ื ืชื•ืŸ? ืื• ืฉื›ืœ ืคืขื ื ืงื‘ืœ ืžืฉื”ื• ืื—ืจ? ื‘ื•ืื• ืคื™ื“, ื ืขืฉื” ืงืฆืช ืกื“ืจ >>
1
ื—ื•ืžืจ ืงืจื™ืื” ืžืขื ื™ื™ืŸ ืขืœ ื“ื‘ืจื™ื ืฉืœื•ืงื—ื™ื ื‘ื—ืฉื‘ื•ืŸ ื›ืฉืžื™ื™ืฆืจื™ื ืžื™ืœื•ืŸ ืฉืœ ื˜ื•ืงื ื™ื ืขื‘ื•ืจ ืžื•ื“ืœ ืฉืคื”. ืžื” ืฉื‘ื˜ื•ื—, "developer advocate" ืฆืจื™ืš ืœื”ื™ื•ืช ื‘ืžื™ืœื•ืŸ ;)
1/ ื›ืœ ืฉืคื” ืžื—ื•ืœืงืช ืœืื‘ื ื™ ื‘ื ื™ื™ื” ื‘ืกื™ืกื™ื•ืช. ื‘ืขื‘ืจื™ืช, ืœืžืฉืœ, ื™ืฉ ืœื ื• 22 ืื•ืชื™ื•ืช (ืœื ื›ื•ืœืœ ืื•ืชื™ื•ืช ืกื•ืคื™ื•ืช ืื• ื’ืžืœื™ื ื’ื“ื•ืœื™ื) ื•ื’ื ืกื™ืžื ื™ ืคื™ืกื•ืง. ื‘ื™ื—ื“ ืขื ื›ืœ ืืœื” ืื ื—ื ื• ื™ื›ื•ืœื™ื ืœื”ืจื›ื™ื‘ ื›ืœ ื˜ืงืกื˜ ืฉื ื›ืชื‘ ื‘ืขื‘ืจื™ืช. ืื™ืš ื‘ื•ื—ืจื™ื ืืช ืื‘ื ื™ ื”ื‘ื ื™ื™ืŸ ื”ืืœื” ืขื‘ื•ืจ ืžื•ื“ืœื™ ืฉืคื”? ื™ืฆืื ื• ืœื’ืœื•ืช.
1
[1.54,6.22,5.16], [12.01,96.44,22.87], [1.2,55.3,9.54] ืœื ื”ื‘ื ืชื? ื–ื” ื‘ืกื“ืจ, ืœื ื”ื™ื™ืชื ืืžื•ืจื™ื... ืื‘ืœ ื”ืžื—ืฉื‘ ืื•ืœื™ ื›ืŸ. @YuvalinTheDeep ื ื•ืชืŸ ื”ืกื‘ืจ ื™ืคื” ื•ืชืžืฆื™ืชื™ ืœืื™ืš ื”ืžื—ืฉื‘ ืžืขื‘ื“ ืžื™ืœื™ื, ื‘ืืžืฆืขื•ืช ื”ืจื‘ื” ืžืื•ื“ ืžืกืคืจื™ื.
1/ ื›ืฉืขื•ื‘ื“ื™ื ืขื ื˜ืงืกื˜ ืื• ืชืžื•ื ื•ืช, ืฆืจื™ืš ืœื–ื›ื•ืจ ืฉื›ืœ ื”ืขืกืง ื”ื–ื” ืฉืœ ืืœื’ื•ืจื™ืชืžื™ื ืขื•ื‘ื“ ืขืœ ืžืกืคืจื™ื, ืื• ื™ื•ืชืจ ืžื“ื•ื™ืง - ื•ืงื˜ื•ืจื™ื ืฉืœ ืžืกืคืจื™ื. ื›ืœื•ืžืจ, ื‘ื”ื™ื ืชืŸ ืชืžื•ื ื” ืื• ื˜ืงืกื˜, ืงื•ื“ื ื›ืœ ื ืžื™ืจ ืื•ืชื ืœื•ืงื˜ื•ืจื™ื ืฉืœ ืžืกืคืจื™ื ื•ืื– ื ื–ื™ืŸ ืื•ืชื ืœืืœื’ื•ืจื™ืชื. ื›ื“ื™ ืœืงื‘ืœ ืชื•ืฆืื•ืช ื˜ื•ื‘ื•ืช, ื—ืฉื•ื‘ ืฉืชื”ื™ื” ืœื•ืงื˜ื•ืจื™ื ื”ืืœื” ืื™ื–ื•ืฉื”ื™ ืžืฉืžืขื•ืช.
2
What would RBG (probably) say? A couple of weeks ago, @ykilcher, an AI researcher and YouTuber, has finetuned GPT-J 6B on 134.5m posts from the Politically Incorrect board of 4chan. Lots of toxic stuff... Next, he released the model on @huggingface . 1/3
1
4
So I asked @AI21Labs's Jurassic-1 model that was trained on Ruth Bader Ginsburg's data what it thinks about the release. Seems like it agrees with Hugging Face's next move - disabling the inference widget in order not to make it easier to use the model. 2/3
1
1
This is the first #AI drop we at AI21 Labs have launched. More to come ;) What would RBG (probably) say: ask-rbg.ai Yannic Kilcher's video about his model: youtube.com/watch?v=efPrtcLdโ€ฆ 3/3
4