John Duffield retweeted
It was great to join colleagues as a panelist at #ACC25’s Innovations in Valvular Heart Disease Town Hall!
Excellent discussion on the use of imaging, shared decision making processes & opportunities to improve patient care.
@CleClinicHVTI @CCF_CTSRes @CCFcards @tavrkapadia
John Duffield retweeted
"if you want web pages, use google. if you want [life saving] answers, use ai." — @johnjduffield
john's story is incredibly touching, it hits different, this is why i'm so passionate about what i do and why i advocate for truly understanding and adopting the use of ai tooling
John Duffield retweeted
Celebrate our amazing hearts and forward flow!
It's Heart Valve Disease Awareness Day!!! heart-valve-surgery.com/hear…
#SaveLivingValves
@CleClinicHVTI @CCF_CTSRes @Heart_Valve
John Duffield retweeted
🎙️❤️🎧 Life in Seasons🌸🍂
75 years, 4 seasons – a blink in time. Eddie Murphy's BTS message resonates: embrace life's beauty, shun the superficial. [Official Dad]'s counsel adds – cherish family, break free from tech's hold. Let's make every moment count. #alevels2023 #JISOO
John Duffield retweeted
We're excited to roll out Perplexity Pages, a simple way to turn your research into visually appealing articles. With formatted images and sections, Pages lets you share in-depth knowledge on any topic. Available now for Pro users and rolling out to all users soon!
John Duffield retweeted
I spent 10% of my life contributing to the development of the #VisionPro while I worked at Apple as a Neurotechnology Prototyping Researcher in the Technology Development Group. It’s the longest I’ve ever worked on a single effort. I’m proud and relieved that it’s finally announced. I’ve been working on AR and VR for ten years, and in many ways, this is a culmination of the whole industry into a single product. I’m thankful I helped make it real, and I’m open to consulting and taking calls if you’re looking to enter the space or refine your strategy.
The work I did supported the foundational development of Vision Pro, the mindfulness experiences, ▇▇▇▇▇▇ products, and also more ambitious moonshot research with neurotechnology. Like, predicting you’ll click on something before you do, basically mind reading. I was there for 3.5 years and left at the end of 2021, so I’m excited to experience how the last two years brought everything together. I’m really curious what made the cut and what will be released later on.
Specifically, I’m proud of contributing to the initial vision, strategy and direction of the ▇▇▇▇▇▇ program for Vision Pro. The work I did on a small team helped green light that product category, and I think it could have significant global impact one day.
The large majority of work I did at Apple is under NDA, and was spread across a wide range of topics and approaches. But a few things have become public through patents which I can cite and paraphrase below.
Generally as a whole, a lot of the work I did involved detecting the mental state of users based on data from their body and brain when they were in immersive experiences.
So, a user is in a mixed reality or virtual reality experience, and AI models are trying to predict if you are feeling curious, mind wandering, scared, paying attention, remembering a past experience, or some other cognitive state. And these may be inferred through measurements like eye tracking, electrical activity in the brain, heart beats and rhythms, muscle activity, blood density in the brain, blood pressure, skin conductance etc.
There were a lot of tricks involved to make specific predictions possible, which the handful of patents I’m named on go into detail about. One of the coolest results involved predicting a user was going to click on something before they actually did. That was a ton of work and something I’m proud of. Your pupil reacts before you click in part because you expect something will happen after you click. So you can create biofeedback with a user's brain by monitoring their eye behavior, and redesigning the UI in real time to create more of this anticipatory pupil response. It’s a crude brain computer interface via the eyes, but very cool. And I’d take that over invasive brain surgery any day.
Other tricks to infer cognitive state involved quickly flashing visuals or sounds to a user in ways they may not perceive, and then measuring their reaction to it.
Another patent goes into details about using machine learning and signals from the body and brain to predict how focused, or relaxed you are, or how well you are learning. And then updating virtual environments to enhance those states. So, imagine an adaptive immersive environment that helps you learn, or work, or relax by changing what you’re seeing and hearing in the background.
All of these details are publicly available in patents, and were carefully written to not leak anything. There was a ton of other stuff I was involved with, and hopefully more of it will see the light of day eventually.
A lot of people have waited a long time for this product. But it’s still one step forward on the road to VR. And it’s going to take until the end of this decade for the industry to fully catch up to the grand vision for this tech.
Again, I’m open to consulting work and taking calls if your business is looking to enter the space or refine your strategy. Mostly, I’m proud and relieved this has finally been announced. It’s been over five years since I started working on this, and I spent a significant portion of my life on it, as did an army of other designers and engineers. I hope the whole is greater than the sum of the parts and Vision Pro blows your mind.
John Duffield retweeted
Replying to @johnjduffield @hdexposhow
We know attendees are really looking forward to this presentation.
John Duffield retweeted
AI is about to completely reshape most corporate functions and be a 10x-100x productivity booster for organizations with:
- A strategy for deploying AI
- A tech fluent workforce that's open to change
- Clearly defined processes and KPIs
Those companies will grow and take market share, the others will be forced to restructure
Probably nothing 🤯
🤖 An AI agent that autonomously does sales prospecting on its own with GPT-4.
Powered by BabyAGI from @yoheinakajima & run on @Replit. Imagine once you integrate it with @langchain tools like @HubSpot or Apollo.
Tip: don't forget to hit pause it like me.
John Duffield retweeted
Three upcoming AI milestones to prepare for:
-AGI (Artificial General Intelligence): is capable of performing any intellectual task that a human can.
-The Singulairty: AI surpasses human intelligence and causes a fundamental change in society.
-SuperIntelligence emerges: An AI that is at genius+ level of humans, I’ve heard it described as 100-1000x more intelligent than the smartest humans.
In the final phase, it’s likely most human can’t even identify/understand phase 3, as it’s too advanced for us. Think about how animals observe humans.
#ai
John Duffield retweeted
GPT-4's response when asked "what career advice would you give young people today"
(The advice was scary good)
John Duffield retweeted
Here's the rundown of the most significant events in AI last week:
1. Microsoft launches 365 copilot
ChatGPT for Word, Excel, Outlook, Teams, and more 👇
John Duffield retweeted
GPT-4 has already created apps, new businesses & an Ai generated episode of Friends.
It's Day 3 of GPT-4 and the new usecases keep flooding in.
Here's the latest news you may have missed:
🧵👇
John Duffield retweeted
🚨 HUGE news in AI: Google just launched Generative AI across ALL of Google Workspace -- Gmail, Docs, Sheets, Slides, Images -- EVERYTHING.
They made a video showing off the new AI's capabilities. It's AWESOME.
John Duffield retweeted
GPT-4 demo livestream replay: youtube.com/watch?v=outcGtbn…
John Duffield retweeted
GPT-4 does drug discovery.
Give it a currently available drug and it can:
- Find compounds with similar properties
- Modify them to make sure they're not patented
- Purchase them from a supplier (even including sending an email with a purchase order)
John Duffield retweeted
I just watched GPT-4 turn a hand-drawn sketch into a functional website.
This is insane.



























