The world's leading publication for data science and artificial intelligence professionals. Submit an Article ✍️ https://xitter.cf/t.co/57pIMegK1o

We're Global 🌏
Joined October 2016
Can a model teach itself new skills without forgetting old ones? Jonathan Yahav breaks down on-policy self-distillation, the technique behind dozens of papers since January, and explains why it seems to reduce catastrophic forgetting. towardsdatascience.com/could…
4
851
Raw Raman spectra are rarely ready for modeling. @NCocaLopez walks us through the full pipeline (cropping, spike removal, baseline correction, normalization), and uses non-negative least squares to track a zeolite phase transformation. towardsdatascience.com/raman…
2
1,142
Towards Data Science retweeted
Big thanks to the @TDataScience team for featuring my new piece in the Editor's Picks. If you’re curious about how skills and MCP reshape trust boundaries in LLMs, this one’s for you. towardsdatascience.com/skill…
1
2
383
Why does taking your shirt off to celebrate still earn a yellow card when the goal is disallowed? Irfan Alghani Khalid built a football referee assistant that answers from the text of Law 12, not the model's memory, and shows the paragraph it used. towardsdatascience.com/ai-as…
2
1,369
"Did someone make a mistake? Is the data broken? Did Python quietly decide to ruin your afternoon? (It does that sometimes; we’ve all been there.)" Sara A. Metwalli presents a beginner-friendly introduction to Simpson's paradox. towardsdatascience.com/both-…
1
5
1,371
Is the "always switch" approach always the right one for participants in a Monty Hall-like scenario? Samit Ganguly explains why the host's position and prior knowledge can change everything. towardsdatascience.com/infer…
2
1,372
LLMs or decision models? Why not both! Shuai Guo's hands-on guide to hybrid LLM workflows shows how to build browser automation by combining decision models with LLMs. towardsdatascience.com/decis…
1
3
13
1,897
We're thrilled to welcome Anand Rawat to TDS — we invite everyone to explore his excellent article on transforming long-running Python simulations into a self-service platform. towardsdatascience.com/how-t…
1
5
1,880
Don't miss the latest installment in @ibbysalam's data engineering learning journey — this time, walking us through the process of building an incremental pipeline with dbt snapshots. towardsdatascience.com/i-bui…
8
1,689
For an incisive look at the areas where AI models hit a wall, read Lars Benedikt Kaesberg and Jan Philip Wahle's debut TDS article, which focuses on spatial reasoning and the grid puzzles that trip up powerful language and vision models. towardsdatascience.com/spati…
6
1,661
Towards Data Science retweeted
Okay, finally I can announce it. So excited to make a comeback for @TDataScience ! So here is the glimpse for what I made,
2
3
1
8
915
Towards Data Science retweeted
I wrote an article for @TDataScience, and it ended up as an Editor’s Pick It’s about grid puzzles people solve easily, but the best AI models still get stuck on, and what this tells us about their spatial reasoning skills. Thanks to @jpwahle for the help! towardsdatascience.com/spati…
1
3
556
Towards Data Science retweeted
Cheaper LLMs don't always mean lower costs. While exploring LLM routing, I found that switching models has hidden costs too. Check it out at @TDataScience #LLM #GenerativeAI #AIEngineering #LLMRouting #AgenticAI
Switching to a cheaper model should... lower your overall costs, right? @nhu_hoang Nhu Hoang explains why that's not always the case, and stresses the importance of verifying the hidden costs of LLM routing. towardsdatascience.com/the-h…
1
1
7
595
Towards Data Science retweeted
Stacking doesn't automatically beat your best model. Diverse models: 0.830 vs 0.820 ✅ Correlated tree ensembles: +0.1 at 35x the training cost ❌ Plain voting lost to the best single model both times. @TDataScience Full test + notebook: towardsdatascience.com/does-…
1
4
565
Behind every news story about an AI-related safety failure, we can likely detect a range of technical causes. Stephanie Kirmer unpacks the processes that can lead to such failures and the steps teams and practitioners can take to mitigate them. towardsdatascience.com/ai-ha…
7
1,555
"Every additional EEG channel adds another electrode, another signal stream, another source of setup complexity, and another feature block that must be processed at inference time." Renish Joshi looks at various approaches to making EEG models perform more efficiently. towardsdatascience.com/how-m…
3
1,775
What happens to EEG models when they "see" the same people in both training and testing sets? Renish Joshi introduces us to the challenges of participant-aware evaluation. towardsdatascience.com/when-…
1
7
2,102
What does it take to push a ML model from accurate to reliable? Devashish Thakar walks us through one approach leveraging the conformal prediction framework. towardsdatascience.com/can-c…
3
1,565