
đ©ș doctor defected to tech đšđŒâđ» prev engineer @exolabs | medicine @uniofoxford | ML @imperialcollege
Joined August 2021
- Tweets215
- Following807
- Followers8.5K
- Likes667
Seth Howes retweeted
I lost my dog because we could not build her next mRNA cancer vaccine fast enough
Today we are announcing a $4M seed led by @foundersfund to change that.
Curing dog cancer
We are bringing personalized mRNA cancer vaccines to dogs and building the evidence to show how well they work.
We have raised a $4M seed led by @foundersfund to make it happen
This investment allows us to launch a clinical trial to validate the personalized cancer treatment protocol we developed for Rosie.
If your dog has cancer or you know someone whose dog does, please tell them about Gamgee.
Seth Howes retweeted
My dog Rosie was given months to live. Chemo and immunotherapy failed
I used chatgpt + computational genomics to design a personalised mRNA cancer vaccine for her tumour. Several of her tumours shrank
Today we launch Gamgee (YC S26): personalised mRNA cancer vaccines for dogs
Seth Howes retweeted
New Huang lab publication at Nature. Our newly developed technique: transient Pore Analyte Looping (tPAL) now achieves âchop and measureâ nanopore sequencing of peptide, in an amino acid by amino acid manner. nature.com/articles/s41586-0âŠ
Seth Howes retweeted
Big news today. Science's PRIMA visual prosthesis, our retinal implant for macular degeneration, has received its CE mark, which means marketing approval in Europe. This is a huge milestone to begin to have a device like this commercially available to regular patients. 1/
Seth Howes retweeted
I built a 50k parameter language model to run on an 8-bit 6502 processor from 1975. It learnt to spell words and construct basic grammar!
The model is build on a Mamba backbone (attentionâs KV cache not fit in 32KB of memory) with a character-level tokenizer.
The MOS-6502 doesnât have a âmultiplyâ instruction - only 8-bit integer addition. I therefore used ternary weights to reduce matrix multiplication to a series of add/subtracts operations.
Technical write-up here: mattbeton.com/blog/bitnet-65âŠ
Source code: github.com/MattBeton/BitNet6âŠ
Seth Howes retweeted
Automated liquid handlers for biology are much older than I thought. A rough timeline:
- The 96-well plate is invented in 1951 by a Hungarian physician, Gyula TakĂĄtsy, who physically drilled each well out of a plate of Lucite, a type of acrylic.
- John Sever made the first "modern-looking" 96-well plate by punching it directly out of a sheet of plastic.
- The first automated liquid-handling device was released in 1967 (!!!). It was called the Autotiter, and was developed by a man named Tom Astle. I found a few sentences on Astle's company:
"Tomtec has succeeded since 1967 by working with its clients to help solve their liquid handling needs. From 1967 to 1981, the Company had essentially one employee, Tom Astle. From 1967 to 1971, the Company operated as Astec, Inc. In 1971 the Company's name was changed to Tomtec, and incorporated. Tom Astle has been the President and CEO since that time. In 1967, Tomtec developed the Autotiter. This automated what were then the manual microtiter techniques. The primary market was serology and virology. The original instruments were an essential element of Smith Kline's rubella vaccine program." (Photos of the original patent filing below.)
- In 1986, Beckman gets into the microplate automation space. They release the Biomek 1000 and mark it as a "fast and accurate...robotic workstation" that sits on a scientist's bench, "takes over tedious manual tasks and integrates the work of four different instruments." I found these details in a Beckman ad, which was published in a 1987 issue of the "Journal of Automatic Chemistry." Photos below.
The Beckman device looks fully modern; it could even connect to an IBM computer so scientists could program new methods on it. I couldn't find a launch price, but the device was similar to the Zymark Zymate, and that device cost about $35,000 when it released in the 1980s, which would be equivalent to hundreds of thousands of dollars today.
Seth Howes retweeted
The pMHC binding with an antibody is so crazy to me. If the binding is general across patient MHCs, you can basically target cancer driver mutations with antibodies (which Revolution meds showed was effective towards pancreatic cancer). Step change, congrats to @nablabio team!
Today, we expand zero-shot drug design beyond binding to the design of multifunctional medicines, the intracellular proteome, and state-of-the-art atomic precision with our model, JAM-2.
In a new report (below), we show:
1. The first drug-grade, fully computationally designed multispecific antibodies against five peptide-MHCs: Routine picomolar T-cell activation/cell-killing EC50s, >100-fold selectivity, and drug-like developability
2. The first fully generatively designed, drug-grade dual-variant KRAS G12 multispecifics: They recruit primary T-cells from human donors to kill G12V and G12C presenting cells at pM to single-digit-nM potency, completely sparing wild-type.
3. Atomic accuracy, from sequence alone: Angstrom-level agreement between Cryo-EM and JAM-2 de novo designs, requiring only target sequences (not structure) as input.
4. Unrivaled speed with an AI-native in-house wet lab: Designed, built, and tested five programs in one parallelized campaign, end-to-end in-house in ~6 weeks.
5. A higher validation bar for AI-generated drug candidates:Â In a field increasingly rife with hype and uneven standards of proof, we provide the highest quality public wet-lab validation of AI-designed antibodies to date. We share experimental methods in full, and invite folks to adopt and build on these standards.
Truly individualized therapies will be the most important contribution of AI in drug design. These advances help accelerate this future.
Seth Howes retweeted
Today, we are launching our research blog!
Weâll use it for technical notes from our work building tools for enzyme and biomolecular design.
Our first post is about The Unreasonable Redundancy of Nature's Protein Folds.
TLDR: Please don't fold more sequences (1/n)
Seth Howes retweeted
You know, the only thing I ever feared at Oxford Nanopore, wasnât failure, wasnât risk, wasnât running out of money, wasnât personal criticism, wasnât the technical challengesâŠâŠ. It was customer/ investor indifference.
Seth Howes retweeted
I really don't get the Mormon hate.
They are genuinely the nicest people I've ever met and a joy to be around.
You can insult their religion, call it weird, say it's made up, and they just tell you that everyone's entitled to an opinion and ask if you want to play board games.
Seth Howes retweeted
Love that this has popped, more people need to see that nanopores are one of the few pieces of actual "nanotech" that were speculated about in the 80s and 90s. While nanopores are for analytical work, what could be the equivalent for molecular manufacturing?
Iâve wanted to do this for a decade.
But I never did - I refuse to give any company my DNA.
It is me.
So this week I sequenced my genome entirely at home. Literally on my kitchen table.
I never exposed my DNA sequence to the internet. Not at any point.
I used a MinION to do the sequencing (itâs smaller + weighs less than an iPhone).
I used open-source DNA models for the analysis (Evo2 and AlphaGenome) running locally on a DGX Spark and Mac Studio.
I traced mechanisms behind my familyâs multigenerational autoimmune conditions that no clinician has been able to understand.
When I set out to do this I didnât know if it would actually work. It does.
Your genome is the most private data you will ever have. You probably shouldnât let it leave your house.
Seth Howes retweeted
sequencing my genome and using agents to help me explore the results taught me a ton about genomics in general and obviously a lot about my own genetics, so I love that this is becoming more popular (h/t @patrickc and @sethshowes)
exploring my genome has also helped me understand the important limits of our current understanding of the human genome and genetic variation
genomic variants 101
DNA is >99% similar across humans so if you get your whole genome sequenced (WGS) the interesting results are where you differ from a "reference genome." the locations where you differ are "variants"
these variants can be single nucleotide swaps (eg the reference genome has a T at a certain location but you have a G), missing or extra letters (aka insertion/deletion or "indels") or entire long chunks that are different
there are large databases like clinvar (ncbi.nlm.nih.gov/clinvar/) where researchers can submit findings about variants to catalog what we know about them, sort of like wikipedia for variants
example: suppose your genome sequencing results say you have a variant in chromosome 17 at position 43051118. you have an A there and in the reference genome there's a C. clinvar tells you what researchers have found about this specific variant in the BRCA1 gene -- unfortunately it means you are at increased risk of hereditary breast and ovarian cancer
in practice however most people's genomes are full of rare variants that are poorly studied. that BRCA1 variant is pretty famous but most clinically relevant variants are either absent from clinvar or are labeled as "variants of unknown significance" (VUS)
when I cross referenced my WGS results with clinvar I had 310 variants of unknown significance. aka 310 instances where researchers have looked into a variant and yet we still can't say whether it's harmful or harmless or irrelevant
using DNA foundation models to understand variants
there are several ways to determine whether a variant is harmful -- you can run large-scale population studies and look for correlations between variants and diseases, you can try to find families where some people have the variant and others don't as a pseudo controlled trial, you can run actual wet lab experiments to see if introducing a variant into a gene disrupts its ability to produce viable proteins, etc.
the newest generation of foundation models trained on huge quantities of DNA offers a new computational approach
evo2 is a model trained on trillions of nucleotides across organisms of all kinds including bacteria & plants & animals. of all the genomes it was trained on, only one was a human genome. the training wasn't meant to teach it about human genetics but instead to develop a broader understanding of DNA as the language of all biology, to learn the general grammar of what "good" DNA looks like based on the broad arc of evolutionary history
with models like evo, we can feed in DNA sequences that have specific variants and see how the model "reacts" to each one. sort of like taking a sentence and making a change to one word, then using a language model to see whether that change was a typo or just a different but valid phrase. or swapping a line of code and using the knowledge inside a coding model to gauge whether that introduced a bug
there are simple ways to "gauge the model's reaction" (eg using the model's loss) that work pretty well, but last week we @GoodfireAI released a novel method for using evo's internal activations to achieve state of the art performance on variant effect prediction, in collaboration with @MayoClinic. this was a super exciting breakthrough for the team and we hope it's a big moment for this field as a whole
we then did the natural thing -- take all 4.2 million variants on clinvar, get a whole bunch of gpus running with parallel copies of evo, and use our new approach to predict the pathogenicity of every single one of 'em. weâve released the results to the public (link below!)
in addition to these raw predictions, the team made a major breakthrough in actually understanding and communicating how/why evo considers a variant to be harmful or not. using additional classifiers to understand key variables inside the model's activations, we can generate a specific human-readable hypothesis for each variant. these explanations are also all made available on our public interactive explorer: evee.goodfire.ai/
- - -
i mentioned that my genome has 310 variants of unknown significance. i built an MCP to so agents could query our EVEE tool to understand each of them, and it's public in case others want to do the same as part of their personal genome analysis: github.com/goodfire-ai/evee-âŠ
fortunately most of my variants that evo predicts to be pathogenic with high probability are in genes linked to recessive diseases and Iâm heterozygous. (this means only one of my two copies of the gene has the variant, and even having a single functional copy of the gene is enough for me to be healthy.) it's nevertheless useful for me to know about these variants because it means i'm a carrier for a few rare diseases like reticular dysgenesis
stepping back, it's a truly insane tech stack that makes all of this possible. modern sequencing tech means I can get my genome sequenced for a few hundred bucks; frontier LLM agents let me process and analyze my genome using all sorts of tools and databases despite having no formal bioinformatics training; frontier scientific models like evo can understand modalities like DNA as fluently as we understand english giving them an ability to intuit which variants are harmful; interpretability techniques allow us to extract knowledge from these superhuman systems.
right now personal genome analysis using AI might sound like an SF biohacker thing but every technology I just mentioned is getting cheaper and more broadly accessible -- the future is already here, itâs just not evenly distributed
New Anglofuturism episode: Oxford's startup monastery
We visited HomeDAO: a newly-founded, ĂŒber-competitive and highly successful start-up accelerator. If there is to be a British PayPal mafia then it is quite likely that it will emerge from this hacker house in Oxford.
Part 1 is out today. Calum and I talked to Josh Lavorini, a HomeDAO co-founder, about talent identification, taste, Oxford, the Coase theorem, British unicorns, the shortcomings of Old Street, and plenty more.
Listen via anglofuturism dot c o or your usual podcast app.
Seth Howes retweeted
There was a lively debate between @leecronin and the AI scientist teams about the philosophy of AI scientists and whether they are even possible, I spent the weekend thinking about it and wrote up my thoughts into an article where I try to steelman Lee's perspective 1/3
SoTA's Frontiers Night on Self-Driving Labs
Thanks to our brilliant Demonstrators for a series of live demos, technical talks, and an extremely lively debate on making AI scientists running closed-loop experimentation a reality:
- Lee Cronin, Founder & CEO of Chemify and Regius Chair of Chemistry at the University of Glasgow
- Shamit Shrivastava, Cofounder & CEO of Apoha
- James Baghurst & Calum Drysdale, Winners of SoTA's Embodied Intelligence Hackathon and Founders of London Biocompute
- Miao Guo, Senior Lecturer in Engineering at King's College London
- Pranay Shah & Aayush Chadha, AI Scientist Programme at Advanced Research + Invention Agency (ARIA)
Thanks also to IQ Capital for hosting us.
@ChemifyX
@experilearning
@CalumDrysdale
@Shamits
@leecronin
@BiorenewableLab
@Pranay_Shahh
@AayushChad40496
@IQ_Capital_Fund
@ARIA_research
Seth Howes retweeted
OpenAI's new 120B MoE runs nicely in mlx-lm on an M3 Ultra.
Running the 8-bit quant:
Seth Howes retweeted
We're doubling the number of Apple Silicon macs that can train together coherently every 2 months.
Our new KPOP optimizer was designed specifically for the hardware constraints of Apple Silicon and implemented using mlx.distributed.
Seth Howes retweeted
.@karpathy shouted out my work on @exolabs at @ycombinator AI SUS!
âwe use LLMs similarly to mainframes in the â70s - compute is timeshared by having a slice in the batch dimension. models will compress over time, and with this weâll be able to run more on-deviceâ
Seth Howes retweeted
we use LLMs similarly to mainframes in the â70s - compute is timeshared by having a slice in the batch dimension
models will compress over time, and with this weâll be able to run more on-device
thanks @karpathy for the shout out đ„
Seth Howes retweeted
Running DeepSeek R1 0528 on the tube
1TB of portable high-speed unified memory in a box








































