Curr: Bios Life AI Prev: GDM Genomics, Harvard PhD SSQB @DeboraMarksLab Opinions are my own, Turtles all the way down

Cambridge, MA
Joined October 2019
Courtney Shearer retweeted
Also @AlanNawzadAmin is one of the most creative computational scientists in bio. Love his work.
2
4
11
1,928
Courtney Shearer retweeted
Our new preprint pushes causal machine learning into new scientific domains using probabilistic symmetry and geometry.
1
11
1
51
7,879
Courtney Shearer retweeted
My first-author paper describing our protocol for the zero-shot de novo design of drug-binding proteins is now available as an article in Nature! Here’s what we did and what's new from the preprint posted last year 🧵 (1/10):
15
92
2
580
48,233
Courtney Shearer retweeted
Many of you may have received pessimism from me over the years about using Hi-C to predict distal regulatory effects, mired with paradoxical optimism that cohesin loop extrusion is key. Well, the story behind all that rambling is finally ready to be told.
4
31
138
21,076
Courtney Shearer retweeted
The Hallmarks of Cancer brought clarity through abstraction - but cancer is more complex than we can reduce. honored to build on their legacy in our @CellCellPress perspective on generative models as unified, multimodal systems for cancer discovery 📄 msft.it/6013QhkUS !
2
9
1
35
2,703
Courtney Shearer retweeted
We found a surprisingly large technical artifact hiding in a widely-used scRNA-seq technology. In all Flex v1 datasets we’ve analyzed, we see hundreds of DE genes between probe set barcodes. More on why this matters and what to do about it below: biorxiv.org/content/10.64898… (1/n)
3
75
9
226
53,017
Courtney Shearer retweeted
Another Claude project: a static site that pulls in GWAS SNP data from ensemble, multiple public biobanks, open targets, gtex, eqtl catalog, and OMIM.
4
31
1
166
13,821
Courtney Shearer retweeted
Mapping 3.4 billion gene circuit designs with AI Designing synthetic gene circuits is like tuning a complex instrument in the dark. You have dozens of genetic parts—promoters, transcription factors, binding motifs—that must work together precisely, yet each combination behaves unpredictably due to context-dependent molecular interactions. Traditional approaches test circuits one at a time, making optimization painfully slow. Kshitij Rai and coauthors just changed the rules of the game. Their platform, CLASSIC (Combining Long- And Short-range Sequencing to Investigate genetic Complexity), combines Nanopore and Illumina sequencing to profile over 100,000 multi-kilobase gene circuit designs in a single experiment—then uses machine learning to predict the behavior of billions more. The workflow is elegant: pooled DNA assembly with barcodes, long-read sequencing to index composition-to-barcode mappings, phenotypic sorting in human cells, and short-read sequencing to link barcodes to function. The result? Quantitative expression data for 121,000 single-input circuits and 128,000 dual-input circuits, used to train neural networks that predict circuit behavior with r² values of 0.86–0.90. The insights are remarkable. High-fold-change circuits don't emerge from a single "optimal" design but from multiple balanced combinations of medium-activity components. AND-gate logic requires clustered transcription factor binding sites; OR-gates need interspersed patterns. These rules were invisible before—now they're learnable from data. The message: by scaling the design-build-test-learn cycle by orders of magnitude and combining it with ML, we can finally navigate genetic design spaces too vast for human intuition, accelerating everything from metabolic engineering to cell therapies. Paper: nature.com/articles/s41586-0…
4
59
5
285
28,557
Courtney Shearer retweeted
One of my favorite findings: Positional embeddings are just training wheels. They help convergence but hurt long-context generalization. We found that if you simply delete them after pretraining and recalibrate for < 1% of the original budget, you unlock massive context windows.
Introducing DroPE: Extending the Context of Pretrained LLMs by Dropping Their Positional Embeddings pub.sakana.ai/DroPE/ We are releasing a new method called DroPE to extend the context length of pretrained LLMs without the massive compute costs usually associated with long-context fine-tuning. The core insight of this work challenges a fundamental assumption in Transformer architecture. We discovered that explicit positional embeddings like RoPE are critical for training convergence but eventually become the primary bottleneck preventing models from generalizing to longer sequences. Our solution is radically simple: We treat positional embeddings as a temporary training scaffold rather than a permanent architectural necessity. Real-world workflows like reviewing massive code diffs or analyzing legal contracts require context windows that break standard pretrained models. While models without positional embeddings (NoPE) generalize better to these unseen lengths, they are notoriously unstable to train from scratch. Here, we achieve the best of both worlds by using embeddings to ensure stability during pretraining and then dropping them to unlock length extrapolation during inference. Our approach unlocks seamless zero-shot context extension without any expensive long-context training. We demonstrated this on a range of off-the-shelf open-source LLMs. In our tests, recalibrating any model with DroPE requires less than 1% of the original pretraining budget, yet it significantly outperforms established methods on challenging benchmarks like LongBench and RULER. We have released the code and the full paper to encourage the community to rethink the role of positional encodings in modern LLMs. Paper: arxiv.org/abs/2512.12167 Code: github.com/SakanaAI/DroPE
49
236
24
2,476
347,473
Courtney Shearer retweeted
Deep learning is cool...but have you tried ✨logistic regression✨? Using just one round of sorting, these models predict affinity boosts and design nanobodies up to ~2500× better. Great work Steffanie, Eddie & team! 🧠🧬 biorxiv.org/content/10.64898…
1
19
1
86
7,343
Courtney Shearer retweeted
If you want to do diffusion on discrete data, you have three choices: discrete, Gaussian, or simplicial. How are they related? Which should you use? We theoretically unify all three and train one model to do them all! @AlinaChandra @yucenlily @alex4ali @andrewgwils 1/7
11
60
3
395
61,286
Courtney Shearer retweeted
What if we have a big protein but need a smaller version for delivery or engineering? Introducing SCISOR: we shrink proteins by training a diffusion model to find natural substrings! arXiv: arxiv.org/abs/2511.07390 @EthanBaron78553, @ruben_weitzman, @deboramarks, @andrewgwils! 1/7
3
29
3
169
18,174
Courtney Shearer retweeted
If you’re into protein design but also a minimalist, check out this great collab!
What if we have a big protein but need a smaller version for delivery or engineering? Introducing SCISOR: we shrink proteins by training a diffusion model to find natural substrings! arXiv: arxiv.org/abs/2511.07390 @EthanBaron78553, @ruben_weitzman, @deboramarks, @andrewgwils! 1/7
1
8
593
Huge paper led by @roseorenbuch ! Glad to have contributed. We must find variants responsible for undiagnosed, rare genetic diseases. popEVE could help clinicians diagnose single-variant genetic diseases with life saving speed and accuracy.
New paper “Proteome-wide model for human disease genetics” is now live at Nature Genetics: rdcu.be/eRu7K popEVE (pop.evemodel.org) finds the needles in the haystacks of human genetic variation:
6
674
Unstoppable
Thank you MoML! I will spend the novelty cheque wisely
4
339
Courtney Shearer retweeted
Thank you MoML! I will spend the novelty cheque wisely
A big congrats to @NYU_Courant’s @AlanNawzadAmin on winning the prestigious Octavian-Eugen Ganea Prize for Best Paper for his work “Shrinking Proteins with Diffusion”! 👏🏆#MoML2025
3
2
2
50
8,829
Courtney Shearer retweeted
Announcing our new protein design server evedesign.bio: • End-to-end protein design for everyone! • Analyze your generated library interactively and on 3D structures • Export codon-optimized DNA sequences for experimental testing. Developed in collaboration between @deboramarks, @thomas_a_hopf, @SteineggerM, Simon d'Oelsnitz, Chris Sander, Artem Gazizov,@haysunny_hi, Milot Mirdita, Sergio Garcia Busto, Jake Reardon
3
79
4
373
39,667
Courtney Shearer retweeted
very amped to see more of these competitions coming up!!
Super excited about this competition! Use your own developability predictors or build your own on our public dataset of 250 antibodies. We're hoping to benchmark the current state-of-the-art hydrophobicity/thermostability/etc models out there 🏆 (1/2)
1
4
512
Courtney Shearer retweeted
🚨New paper 🚨 Can protein language models help us fight viral outbreaks? Not yet. Here’s why 🧵👇 1/12
1
38
5
159
26,965