John Smith (@john_jc_smith) profile picture

Building @inferablehq

Adelaide, Australia.
Joined March 2013
Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)Photo by John Smith (@john_jc_smith)
We unbundled and released our structured results provider as a standalone project. Introducing L1M (pronounced el-one-em) 🚀
1
1
1
2
506
John Smith retweeted
We just launched durable workflows! Read our announcement post 👇
1
2
2
315
By popular demand, we're also launching pgchat as a single executable! npx pgchat postgresql://user:pass@host:5432/db 👆 is all you need to chat with your postgres.
1
2
4
253
Oh btw, we're on product hunt today! Link 👇
3
3
6
295
When a human-facing system becomes sufficiently complex, "vibes" become a perfectly valid evaluation methodology
51
86
24
977
66,161
We've just refreshed our console to feature the adapters! Let @trpcio, @apollographql, @PostgreSQL or @ValDotTown be the tooling runtime for your agents.
1
3
4
367
John Smith retweeted
Framework for distributed agents
5
97
5
724
48,267
these new captchas are getting way too difficult
28
92
14
2,004
77,436
Replying to @marcklingen @swyx
An OSS maintainer who has built an integration with Langfuse for @inferablehq -- love to see how everyone can "focus on what makes their beer taste better" by working on integrations
1
1
1
4
234
John Smith retweeted
its has come to my attention that many of you aren't actually sure what an ai actually agent is So here is a little diagram explaining an agent (simplest form) vs api call + tool
62
63
16
794
96,039
Build conversational LLM applications with Inferable and assistant-ui inferable.ai/blog/posts/assi…
1
3
5
141
John Smith retweeted
A secure bridge between your data systems and Inferable, enabling natural language queries while keeping your data private inferable.ai/blog/posts/anno…
2
76
John Smith retweeted
→ @inferablehq is a managed developer platform designed to simplify the creation of secure and reliable AI applications powered by LLMs. It provides a managed solution for developers who want to focus on building their applications without managing complex LLM infrastructure. 🔴 Live on DevHunt → devhunt.org/tool/inferable
4
4
149
We just dropped a blog post about doing on-device local RAG using Ollama, sqlite, sqlite-vec and mxbai-embed-large.
1
3
3
147
👉 Something we found interesting about "needle threading" in LLMs. 🎯 LLMs can perform inference on inputs up to their context limits, their effective context limit is much shorter and their performance decreases as the context window grows.
1
4
4
116
Never seen this alert before – Apple now tells you if an app you're deleting has a subscription still active. Good move. (Taken on iOS 13 beta 2.)
33
390
83
2,122
John Smith retweeted
@twolivesleft Just brought his new #OculusQuest into the office.
2
2
11
I appreciate that @AppleMusic has a lyrics section. Probably not necessary for dance tracks though. – at Malvern, Adelaide
1
8