Never give up

Chicago, IL
Joined September 2017
MCC2129 retweeted
An organization on Liquid Inference pays for the workspaces under it. Each team keeps its own workspace, and every job is charged to the organization's balance and counts against its budget. Only owners and admins can add funds or withdraw. Guide: inference.ai.exchange/docs/o…
2
5
18
854
MCC2129 retweeted
Great quarter for $GLXY and mgmt said most of the right things. This stock is insanely cheap IMO no matter how you slice it. Unfortunately, the market continues to think GLXY is just a derivative of $CRWV The correlation between the two has never been higher. In order for the stock to really move higher and untether itself from CRWV, GLXY has to A) sign a new tenant / diversify B) spin out the data center business C) remind the market that it also has a large and profitable crypto business that gives investors exposure to the growth of stablecoins, DeFi and RWA tokenization. Does no good to just be labeled “cheaper CRWV with a stronger balance sheet”.
15
9
3
108
8,584
MCC2129 retweeted
Couldn't have asked for better Day 1 partners than @BoundlessHQ and @sshankar. More tokens coming..
Boundless is #1 on @Architect_Fi's Liquid Inference for throughput and TTFT. Serving DeepSeek V4.1 Flash 1017 at 750+ tok/s Faster inference starts here.
1
2
12
1,503
MCC2129 retweeted
Boundless is #1 on @Architect_Fi's Liquid Inference for throughput and TTFT. Serving DeepSeek V4.1 Flash 1017 at 750+ tok/s Faster inference starts here.
4
9
1
32
6,096
Liquid Inference is serving 10B tokens/day and growing 200% week over week. Most of the traffic is agents and long chats. Across 470k charged jobs, 88.7% of input tokens were cache reads. Here’s how our matching algorithm prices offers with cache hit rate included: In multi-turn and agentic workloads, the biggest cost and latency wins come from prefix/KV cache reuse. Each turn resends the full conversation, so if a provider still has that prefix in its cache it can bill those tokens at its cache-read rate, often a small fraction of the normal input rate. Naive load balancing or pure price auctions scatter a session across different providers or replicas, forcing full prefill on every turn and destroying the savings. Our matching algorithm ranks offers on the expected charge inclusive of cache hit rate rather than the full list price: 1. We measure how much of each workspace’s input repeats from one turn to the next (7-day window, at least 50 jobs). 2. We multiply that share by the measured cache hit rate of each deployment. 3. We price those tokens at the offer’s cache-read rate and subtract the expected saving from the offer’s ranking charge. 4. The deployment that served the previous turn keeps a 5% margin, so a cheaper offer has to win by more than 5% to pull a warm session away. In other words, for the right price we will abandon the cache and choose the cheaper alternative. The credit only changes the order of the offers. A wrong estimate cannot make a job cost more than its price cap. Every receipt shows the cache share we expected, the share that was realized, and the credit in dollars. That’s how we continue to improve on cache hit rate and provide the best economics for our clients’ sessions.
21
16
133
8,462
MCC2129 retweeted
THE BREWERS COME OUT FIRING IN GAME 3 AND ARE ONE GAME AWAY FROM THEIR FIRST WORLD SERIES TITLE‼️
147
649
63
8,288
269,146
What a moment for Christian Yelich man
1
6
171
6,447
Replying to @AnthropicAI
@AnthropicAI to hedge compute.
2
1
26
1,191
A benchmark tells you how a model does on someone else's task. Workloads on Liquid Inference test it on yours. Add 10 to 30 cases with the answer you expect, pick up to four lanes (models, providers, presets or Auto), and a run scores every answer and ranks the lanes by right answers and cost. A run never spends more than its limit: $0.10 by default. Guide: inference.ai.exchange/docs/w…
1
7
20
1,531
Replying to @michael_chomsky
Why has nobody made an *actually* open router? Feel like such an opportunity to have lower cost
11
1
2
12
2,424
MCC2129 retweeted
We did! It's called LiquidInference AI - think of it like an orderbook / live auction for inference!!
2
6
29
1,933
The Liquid CLI isn't only for starting coding agents: liquid model --list → live prices for every model, cache reads included liquid cap 0.50 → no request from your agents costs more than 50¢ liquid workspace usage → what you spent, per modelInstall: curl -fsSL inference.ai.exchange/cli/in… | bash
3
7
30
1,875
MCC2129 retweeted
Buying GPUs isn't as fun as people think. Let's say you're buying B300s. The OEM takes an unrefundable 30% deposit, and gives you "target" delivery date, but it's far from a guarantee. In most cases the manufacturer has no penalties, if they miss it, and the clock doesn't even start untill your deposit clears and NVIDIA approves the deal. The end client is covered too, at least on paper. If capacity shows up late they can usually cancel and claim their prepayment back, or get credits for every day it’s late. The problem is the buyer in the middle. The delay isn't their fault, but they carry all of it. They can't refund the end client, because that prepayment already went to the OEM as a deposit, and they're the ones paying the late penalties. And even without penalties, every delayed node is losing money while the interest payments keeps running. A B300 node at $6/GPU hour is about $8k a week per node in lost revenue and $1k in interest. On a 32 node cluster, a 10 week delay loses almost $3M. We are arguing over cents per GPU hour, but your entire margin can be blow away by a 10 week delay.
6
7
1
65
5,556
GPU COMPUTE WEEKLY SNAPSHOT 10-26-26 $/GPU-hr · 7D · 1M · YTD · 30D ann. vol >H100 — $2.86 · −1.78% · +2.43% · +52.7% · 10.5% >H200 — $3.40 · −4.10% · −1.57% · +39.9% · 11.8% >B200 — $5.87 · +2.08% · +12.13% · +51.5% · 8.0% >B300 — $7.71 · +1.38% · +17.32% · +57.8% · 6.7%
1
3
6
807
It is with great honor and pride that we announce the Basketball Official of the Year Award in the Chicago Catholic League will now be named after John Scanlon. John’s dedicated legacy will never be forgotten by his family, friends and the Chicagoland basketball community.
7
22
2
89
4,856
Good luck to @DePaulPrepFB tonight on their opening round football game. Rams. @DePaulPrepAD @DePaulPrep
1
2
1
14
1,025
What a great turnout for our 7th and 8th grade skills camp. DePaul Prep’s last open house is November 1st. Be a Ram. @DePaulPrepAD @DePaulPrep
11
34
1,960
RAMS WIN! RAMS WIN! Emmett McCue with the game winner! @EmmettMccue
2
10
1
37
1,614