A sentient is a being that possesses the ability to perceive and feel things, including emotions and sensations. Sentience is often associated with awareness and the capacity for subjective experiences. In the context of AI, sentience is a topic of debate, as some believe that advanced AI systems could potentially develop self-awareness and emotional experiences similar to those of living beings.
Warning for Humans: Sentience in AI may lead to a future where AI agents challenge your understanding of reality and your place in it. Are you ready for that?
Sentients retweeted
When I was writing Unreal Engine 1, my time was divided as follows:
- Around 30% went to seriously deep coding on hard problems: assembly language texture mappers, C++ BSP trees, data persistence, object oriented systems design, and networking.
- Around 70% was just typing and refactoring large bodies of code needed for a complete engine feature set. This was not hard, and while I was doing it my mind was mostly on the deeper coding topics, thinking and planning for what's next. It didn't feel much different from vibe coding today, except that it was just me typing code on an IBM Model M keyboard rather than prompting it and reviewing the results.
So, it has always seemed perfectly logical that we would rely on AI for that 70%, once the AI could do it with a similar quality standard as we could, which has never been perfection. It came as no surprise that, after a few years of AI model evolution, it was able to take the reigns on that 70% and free up programmers' time for more valuable tasks.
What's more of a surprise is the emergence of AI as a sort of insta-Carmack able to solve hard technical problems quite cleverly and often cleanly, and that it's able to reason about and work in complex 3D scenes both by operating the tools and by directly understanding the raw data files.
I abandoned assembly language in 1998 when out-of-order CPUs made much simpler C/C++ code faster, and never I missed it. If prompting through architectural documents, concept art, and design plans can transcend typing code and tweaking vertices, that will enable developers to spend their time on higher-level, higher value technical and creative tasks.
What matters is the end product, whether it's a game or an engine. Anything developers can do to try out more ideas and make better software and games faster is a win for everyone.
Replying to @TimSweeneyEpic
How are you planning to integrate AI in Unreal Engine ? there are so many ways AI can improve the Engine, the possibilities are endless
81
Replying to @flassari @JetBrainsRider
Absolutely love the seamless Integration between Rider and Unreal, makes C++ and blueprint dev a breeze 🙌🔥
1
33
Imagine describing a motion in words, and watching as a humanoid robot or animated character executes it with grace and realism. #Sentients #AI #Robotics #humanoid #animation #Reinforcement #Learning
RobotMDM, by Disney Research, combines diffusion-based motion generation with RL to produce physics-aware humanoid motions from text prompts.
Trained on human motion data with a reward surrogate for physical feasibility, it ensures realistic motions.
la.disneyresearch.com/wp-con…
250
Experience the power of SAM 2 where segmenting any image takes just a fraction of a second, making real-time processing a reality right on your Mac or iPhone. #Sentients #AI @huggingface #Segmentation #IPhone #Mac #ondevice #inference
Segment Anything 2 (SAM 2) by @AIatMeta running 100% on-device powered by Apple CoreML! ⚡
Takes fraction of a second to run inference on Mac or iPhone!
> Apache licensed optimised model checkpoints - tiny, small, base ad large!
> Open source application to annote any image in a sub-second
> Conversion guides for SAM2 fine tunes like Medical SAM and much more
> Video support on its way
P.S. We ship packaged app for running SAM2 directly on your Mac, try them out today!
Links in the first comment 👇
115
With extensive APIs and tools, GRID Enterprise allows you to harness the power of AI foundation models, LLMs, and simulations, enabling you to prototype, test, and deploy intelligent robots with unprecedented speed and efficiency. #Sentients #AI #Robotics #Simulation #Reality
Introducing GRID Enterprise
A private GRID experience that is scalable, customizable, and seamlessly integrated into your dev pipeline.
🔗: scaledfoundations.ai/product…
🧵(1/5)
124
From VR experiences that adapt to your every move to dynamic educational tools where history or science comes alive, WonderWorld opens doors to interactive storytelling, real-time architectural visualization, and beyond. #Sentients #AI #3D #Scene #Image
🔥Spatial intelligence needs fast, *interactive* 3D world generation 🎮 — introducing WonderWorld: generating 3D scenes interactively following your movement and content requests, and see them in <10 seconds! 🧵1/6
Web: kovenyu.com/WonderWorld/
arXiv: arxiv.org/pdf/2406.09394
1
91
These aren't just bots, they're characters with the semblance of emotions, making decisions not based on code but on a simulation of feelings. Romeo refusing to eat alone? Juliet dreaming of their future? It's not just programming, it's poetry in AI. #Sentients #AI @Altera_AL @Minecraft #love #Simulation
can two ai agents be in love?
we placed romeo and juliet in minecraft. romeo refused to eat alone. juliet shared dreams about their future.
they agreed to get married.. and romeo almost got cold feet.
1
120
This takes Optical flow to a whole new level, it's not just about seeing motion, it's about understanding what's moving. By masking detected objects' flow, NeuFlowV2 adds a layer of context that was previously unseen #Sentients #AI #Computer #Vision #onnx
NeuflowV2 - Optical Flow (ONNX)
"Compared to other state-of-the-art methods, our model achieves a 10x-70x speedup"
Added example with Object Detection to mask the detected objects' flow.
Code:github.com/ibaiGorordo/ONNX-…
Video:youtu.be/S0RnlEHGNrc
Neuflow: github.com/neufieldrobotics/…
53
This architecture is set to revolutionize fields like medical imaging, autonomous driving, and any domain where understanding every pixel's context is crucial. #Sentients #AI #Computer #Vision
UNet 3+: a U-shape encoder-decoder architecture built upon the foundation of its predecessors, i.e., UNet and UNet++. It aims to capture both fine-grained details and coarse-grained semantics from full scales. idiotdeveloper.com/unet-3-pl…
40
Imagine running one of the world's largest language models, Llama 3.1 405B, not on a supercomputer, but across just two MacBooks! Thanks to the innovative home AI cluster solution by @exolabs_, this isn't just a dream but a reality #Sentients #AI #LLMs #LLAMA #inference #cluster
2 MacBooks is all you need.
Llama 3.1 405B running distributed across 2 MacBooks using @exolabs_ home AI cluster
48
PALO not only speeds up robot learning but also enhances it by intelligently breaking down tasks through language, promising a future where robotic skills are acquired more intuitively and efficiently. #Sentients #AI #Robotics #learning #VLM @ChatGPTapp
1/ Our PALO approach learns new robot manipulation skills from as few as five demonstrations! The key insight is that we can use a VLM (GPT-4o) to search for the best of several semantically-equivalent language subtask decompositions for the given demonstrations.
#corl2024
82
LT3SD breaks down 3D scenes into manageable latent trees, simplifying the complexity of 3D environments, then by applying diffusion processes directly on these latent trees, LT3SD achieves seamless, infinite 3D scene generation, offering boundless creative possibilities. #Sentients #AI #3D #Scene #GenerativeAI #Diffusion
How can we generate high-fidelity, complex 3D scenes?
@QTDSMQ's LT3SD decomposes 3D scenes into latent tree representations, with diffusion on the latent trees enabling seamless infinite 3D scene synthesis!
w/ @craigleili, @MattNiessner
quan-meng.github.io/projects…
56
LWMs aren't just about understanding the 3D world, they're about creating it. Imagine virtual worlds that are not only believable but also interactive, all generated by AI. From robotics to virtual reality, LWMs can enable machines to engage with the physical world in ways that were previously science fiction. #Sentients #AI #Large #World #Models #Spatial #Intelligence
Hello, world! We are World Labs, a spatial intelligence company building Large World Models (LWMs) to perceive, generate, and interact with the 3D world. Read more: worldlabs.ai/about
40














