Why 2D brain segmentation is hopeless in grey matter:
It is so densely packed with dendrites that an H&E mostly shows slices of wiring from cells near and far.
For gross tissue features, raw unsegmented RNA gives you more signal than forced cell boundaries.
Why standard nucleus-first segmenters fail on heart muscle:
Cardiomyocytes run up to 140 µm long. In a 5 µm section, you only catch a slice of each cell.
Most profiles have no nucleus at all.
If your model seeds from nuclei, it has nothing to start from. 1/
3/ Slice angle changes the apparent shape.
Along fibers, the cell is a ribbon; across, a polygon.
Turning the knife 60° drops ribbons from 63% to 9% and jumps profile count from 37 to 67. 57 µm deeper, fibers rotate 60°, so one section cuts along some cells and across others.
3/ Slice angle changes the apparent shape.
Along fibers, the cell is a ribbon; across, a polygon.
Turning the knife 60° drops ribbons from 63% to 9% and jumps profile count from 37 to 67. 57 µm deeper, fibers rotate 60°, so one section cuts along some cells and across others.
RJ Honicky retweeted
🧪🧭 What if we could ask a model which experiment gives us the cells we want?
Our new preprint, LabCompass, takes a step in this direction through generative inverse design. For me, this is one of the most exciting directions for the field.
Together with many others, we have been working on predicting how cells respond to perturbations. How can we use these models to design experiments that achieve a desired biological outcome?
🎛️ This inverse problem is difficult. Combinations and doses create spaces that cannot be exhaustively screened, and each experiment produces a distribution of cell states. Predictive models are also imperfect, particularly in unexplored regions where we want to discover something new.
LabCompass couples a generative model of experimental designs with a forward model of cellular responses. The desired phenotype guides generation in continuous design space, while a learned prior favors plausible designs. Selected candidates are tested experimentally, and the measurements inform the next round.
💡 The method is not tied to a particular virtual cell model. It can work with different differentiable forward models and cellular readouts, and the same trained models can address different phenotypic objectives.
🩸 We demonstrated this in primary human blood stem and progenitor cells. Across the study, we profiled 78 million cells and experimentally validated conditions enriching megakaryocytic, erythroid, monocytic and early lymphoid populations.
One result I particularly like: distinct culture recipes produced similar target enrichments. Several solutions to the same biological objective give us alternatives to investigate and develop further.
🔬 The opportunity extends beyond blood and cell culture. We also applied LabCompass to single-cell transcriptomic data from viral infection. I’m excited to explore its potential for other perturbation systems, drug combinations, differentiation and organoids.
This raises a question for virtual cell models: alongside prediction accuracy, how effectively can they guide experiments toward desired biological outcomes?
If this connects to a problem you are working on, I’d love to hear from you. We’re keen to see how LabCompass transfers to new systems and happy to explore ideas together.
A wonderful collaboration with Bertie Göttgens and Nicola Wilson at the Cambridge Stem Cell Institute. Huge credit to joint first authors Licyel Paulas-Condori, Alessandro Palma, Lorenzo Consoli and Juan Antonio Rubio-Lara, and the whole team across both labs!
📄 Preprint: biorxiv.org/content/10.64898…
💻 Code: github.com/theislab/LabCompa…
#InverseDesign #VirtualCell #SingleCell
Thank you for taking the time to sit down with us. I learned a ton about GMLs, CoT, multiomics and biosecurity!
I sat down with Latent Space to talk about the research preview of Omnii, our latest genome language model, and what becomes possible when AI can reason more directly across biology.
We covered a lot of ground, especially the potential across human health.
Much more to share in the coming months.
youtube.com/watch?v=B7DdNj_V…
Fable 5 is nerfed, so even if Mythos is better, Astra beats Opus. My bottleneck is now my computer. Astra + ERA (ask me for the skill) unlocks hill climbing on algorithms for bio applications. I think I’m going to bite the bullet and buy a desktop to increase my throughput....
A customer needs Visium HD to work on heart, so we’re making sure it works. As Visium users know, segmentation is based on H&E. It’s hard to even validate, but we’re cooking, more to come…
5-trillion(!) token models???
Scientific models need MASSIVE scale to consume data directly, and transfer data between domains that share some physics
@AnimaAnandkumar and @bjenik launched @accelerated_u out of stealth to do that.
youtube.com/watch?v=KS_IpnX7…
RJ Honicky retweeted
Was fun to be on the @latentspacepod podcast a few weeks ago to talk about AI for physical simulation and understanding. This pre-dates the public launch of @accelerated_u so I couldn't yet talk the exact details but hint at what happens if you scale some of these methods to Trillion parameter model sizes and fully 4D context lengths in the Trillions in a universal model.
The podcast covers some of the ideas that provide the foundation for scaling. It also goes into the promise and successes that were possible even before going really big like building high resolution fully AI based weather models that are tens of thousands of times faster and as accurate as existing forecasts. We talk about predicting plasma behavior in fusion so quickly that one could take corrective action before something bad happens. And we cover how physical understanding doesn't just help with replacing experiments but lets us optimize design directly.
We even briefly touch on the promise of combining those capabilities into one large model which I can now talk about more.
Watch for yourself: youtu.be/79mIutht1f4?si=M3Wd…
RT @realdealpatil: Was fun to tag team @latentspacepod with @mattmcpartlon1! My favorite part was Matt explaining why mice make for such fo…
This quoted post is unavailable.
Pharma tools deals are accelerating, check out our new @chaidiscovery episode with @Mattmcpartlon1 and @realdealpatil to find out why.
latent.space/p/chai-discover…
I was lucky enough to get access to Silico called Silico last week and tried it out on a problem I’ve been wanting to tackle for while: H&E whole-cell segmentation.
The Visium / HD users out there can probably appreciate how important segmentation is.
1/
White is based on boundary stain fluorescent data (ground truth), orange is StartDist + watershed expansion, black is our model. Still some work to do, but clearly way, way better.
4/







