I’m into open science, elegant software architecture, and well-crafted interfaces. Building https://xitter.cf/t.co/0GX1wFmPoU

San Diego, California
Joined July 2017
Big milestone for Reducto: we’ve raised a $75M Series B led by a16z, bringing our total funding to $108M. Since our launch, we’ve been obsessed with pushing the limits of what’s possible when AI meets the real-world messiness of documents. We’ve now processed 1B+ pages, nearly 6x the pages since our Series A less than 6 months ago. We’re doubling down on model research, developer tooling, and the reliability that production AI demands. We'll be announcing a series of product improvements that will extend our capabilities even further, helping our customers get even closer to perfect accuracy across their most challenging docs. A big thank you to everyone who helped get us here. But we're just getting started - if you're interested in what we're doing, we’re hiring across all functions! reducto.ai/careers
42
11
6
348
67,129
. @modal dojo is very cool like an oss tinker with more supported models you can hack on yourself needs better marketing! would have used earlier if I had known about it
2
180
one of the best things openai/anthropic could do is support arbitrary OIDC issuers then you wouldn’t need to give BYOK tools your creds and setup a trust policy instead. of course if their servers are fully compromised it could still be abused but it would seriously help.
we did invent it and it's called OIDC federation vercel and github actions do it: - each deploy gets a short-lived signed token - AWS/npm/other services verify it via trust policy - you get temporary creds no keys to paste the problem is not enough APIs and services accept it
1
11
749
Look guys if you’re building something on a cloud platform and you don’t want to get owned through a platform compromise at some point you have like 4 real options AWS Azure Cloudflare GCP You should not trust key infra to a neocloud Neoclouds may get you faster performance on something like S3 but they just can’t match the availability, durability, and security of a “real” cloud They don’t and can’t design for as many nines
37
19
8
408
39,186
Raunak retweeted
Hundreds of millions of pages move through Reducto every week 📃 On October 27th, we’re bringing together the people who power the infrastructure behind them. Join us at our HQ in San Francisco for a chat with Siddhant Pagariya and Lijie Zhou from our Infra Team. They will walk us through real projects and afterwards, we'll turn it over to you to try an interactive Capture the Flag with a live leaderboard. Expect great food, drinks, and time to connect with fellow infrastructure engineers 🔮
4
2
3
13
1,360
Railway is compromised, rotate all API keys as soon as possible Deployments are down so don’t wait to redeploy Attackers are draining keys in real time, we didn’t lose much but can confirm this is still an active attack Stay safe friends
118
492
174
4,666
542,868
Raunak retweeted
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff "Based on this framework, we have implemented a high-throughput, low-latency large-scale inference service for DeepSeek V4.1 Flash. Currently, the service throughput of a single cluster is 155 trillion tokens/day, and the overall revenue is $38 per card per hour (based on off-peak prices)." it costs roughtly $5-10 per gpu hour so depseek is claiming 80% serving margin at THEIR prices lololololol
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 github.com/deepseek-ai/DeepI… 1/4
105
141
30
2,289
136,035
we built classify out of the pain of seeing customers use our extract endpoint to sort documents, which is an overkill when just need to find out what each document is. classify is a smaller, purpose-built endpoint that's: > faster > costs 0.5 credits per page > has already processed nearly 1m pages. around the same time, we also rolled out batch for less time-sensitive workloads, giving parse + extract jobs a 20% credit discount. in this video, our engineering team walks through how both came directly from patterns we saw in customer workflows!
6
5
33
1,596
Raunak retweeted
what happens in tulum stays in tulum (except the vlog)
6
11
3
64
6,436
disagree with a lot of his takes but this is a good one. a ton of the leaders in AI I’ve talked to consider gradual disempowerment/transhumanism an eventuality. it’s scary.
Here’s a radical idea: Let’s not let Big Tech Oligarchs replace the human race.
6
6
2
98
2,653
hello we need some more b200s/b300s for training looking to get ~4-12 more nodes (ik not a ton) happy to lock in for 1-3 years if the price is good pls feel free to dm what price you can do based on commit length 🙏
60
5
3
191
31,515
some additional context: region doesn’t matter a ton since it’s training nvlink required infiniband would be really nice (would only consider without at a steep discount) some kind of fast shared storage would be great (e.g. VAST) happy to do 20% down
8
2,488
changed the default model for my main agent thread in raubot (my personal agent) to muse glimmer! very unexpected subagents still do most of the coding and are kept as opus
1
5
720
muse writes so well damn
1
1
6
803
with r-1, we've replaced a long pipeline of specialized models with one model that sees the whole page. that ultimately translates into fewer handoffs where context can get lost. we invited @ani_0203_ and @chuyishang to walk through a few of the edge cases they worked on, from watermarks and handwriting to figure summaries that use the surrounding page for context. really proud of what the team built here!
7
5
35
1,623
I wish there was a subscription I could pay for that gave me access to try SaaS that is locked behind “Contact Sales” - really useful especially for sales demos where I could tell my agent to point out flaws within their existing product experience that could be fixed by my software
5
10
1,482
cloudflare is too good
6
53
16,962
The cambrian explosion of internal apps after releasing this should be studied. Every customer can get a unique demo page or benchmark. A dashboard for every product rollout etc. All done without compromising security. Insane work @abhiarya!!
2
1
26
2,196
“Why not do this for everything?” is exactly the founding question for our company We know what the verification loop is for HTML parsers, but what is it for… tax software? robotics control systems? UX researcher agents? Construction AR? niteshift.dev
Replying to @charliermarsh
I think parsers are uniquely good for this kind of thing since they (often, not always) have clear specifications and available conformance suites, plus they can be heavily fuzzed and differentially tested. But like, should we just do this for everything? Why or why not?
1
4
666