Hayden retweeted
the engagement is dying, nikita hates us, the posters are leaving, the lowbies aren't contacting us
we might be alone, it just might be you and me, but that's okay, because do you really need anyone else?
Hayden retweeted
you dont post bangers because all you do is scroll all day. little to no irl data to train on. no genuine inspiration to draw from. shallow creative waters. go live life a little and then get back to us. getting sick and tired of seeing the same mumbo jumbo recycled signalling on the timeline.
Hayden retweeted
you gotta distinguish aiko pot from tpot as a simcluster built upon fundamentally different norms and values in which technical content and shitposting has superseded the delicate mixture of rationality and vibes which previously defined """tpot""" you would for example be unlikely to see any aiko pot posters at vibecamp and they would be unlikely to be invited into eliezer yudkowsky's polycule as math pets however you can appreciate their dedication to the acceleration of the geeks mops and psychopaths paradigm via the introduction of linkedin posters and racial prejudice the current rebirth comes across as very keiyuva esque and in that way it is similar to the milady tradition
Hayden retweeted
looking for end of studies internship starting early february, as researcher or MLE
some of my public work includes training a llama 3 vlm that was sota for <20b, with a new training method,
experienced in working as researcher at a lab
location: 🇫🇷/remote
RTs appreciated
Hayden retweeted
Excited to announce Lucid V1:
A world model that can emulate Minecraft environments in real-time on consumer hardware! 🔥
play here: lucidv1-demo.vercel.app/
post: ramimo.substack.com/p/lucid-…
repo: github.com/SonicCodes/lucid-…
Hayden retweeted
The future expands the variance of human condition a lot more than it drags its mean. This is an empirical observation with interesting extrapolations.
The past is well-approximated as a population of farmers, living similar lives w.r.t. upbringing, knowledge, activities, ideals, aspirations, etc.
The future trends to include all of:
- the transhumanists who "ascend" with neuralinks etc., and the Amish living ~19th century life.
- those who "worship" ideals of religion, technology, knowledge, wealth, fitness, community, nature, art, ...
- those exploring externally into the stars, those exploring internally into minds (drugs++), or those who disappear into digital VR worlds
- those who date a different partner every day and those who are monogamous for life
- those who travel broadly and those who stay in one location their entire life
- those in megacities and those off-the-grid
For almost any question about a dimension of human condition, the answer trends not to any specific thing but to "all of the above". And to an extreme diversity of memetics. At least, this feels like the outcome in free societies that trend to abundance. I don't know what it feels like to live in such a society but it's interesting to think about.
Hayden retweeted
Behaviorally major differences between human and LLM reasonings exist but have less to do with architecture and more with data&objectives. Recall for instance that animal learning is not SSL nor RL or SSL+RL, but a secret, more complex hybrid thing based on "self-interpretation".
Hayden retweeted
Guys. Click like on posts you reply to
Basic courtesy. Without it we are lost and no better than animals
If you're being disagreeable on purpose, then ok, but rn I feel like my dad when my friends would not take their hats off in the house. There are rules. Trust me it's better
Hayden retweeted
NeRV is pretty interesting ngl
- it makes a neural representation of a video and returns a frame when given the timestamp
- this already compresses the video, and further model compression methods can be used to make it even smaller (like quantization)
Hayden retweeted
Episode w @dylan522p and @asianometry out!
A bonanza on how the semiconductor industry actually works.
& what Xi could do if he becomes scaling pilled, how we can train models with 10,000x GPT-4's compute by end of decade, & much more.
This one is very fun. Enjoy! Links below.
0:00:00 – Xi’s path to AGI
0:05:05 – Liang Mong Song
0:09:10 – How semiconductors get better
0:12:01 – China can centralize compute
0:19:35 – Export controls & sanctions
0:33:45 – Huawei’s intense culture
0:39:45 – Why the semiconductor industry is so stratified
0:41:50 – N2 should not exist
0:46:47 – Taiwan invasion hypothetical
0:50:15 – Mind-boggling complexity of semiconductors
1:00:06 – Chip architecture design
1:05:29 – Architectures lead to different AI models? China vs. US
1:11:06 – Being head of compute at an AI lab
1:17:17 – Scaling costs and power demand
1:37:59 – Are we financing an AI bubble?
