@jitllm

Java Inference Tornado toolkit | Powered by @TornadoVM | https://xitter.cf/t.co/24V0XxmPMD

Joined September 2026
  • Tweets15
  • Following6
  • Followers8
1Media
jitLLM retweeted
TornadoVM@tornadovm2h
TornadoVM 8.0.0 is out 🌪️ After 10 years: thank you, Graal. Java kernels are now compiled by TC, our own pure-Java compiler to CUDA, OpenCL and Metal. • AOT ready • No JVMCI • Now Apache 2.0 • Your code doesn't change 👉 tornadovm.org/blogs/tornadov… #OpenSource #Java #AI #GPU
2
8
5
40
1,962
Great to see @tornadovm on the top of the @ycombinator today! The article has all of the latest work on accessing @nvidia libraries from Java!
1
5
12
448
Had so much fun at @JDD_Krakow 2026 in Kraków yesterday. I presented “Java Goes CUDA-Native”: new @tornadovm features that let @jitLLM run LLM inference at GPU-native speed, from Java. tornadovm.org jitllm.io #opensource #Java #TornadoVM #GPU #AI
7
1
12
235
The Devoxx Greece 2027 Call for Papers is OPEN! Join us in Athens (Apr 15-17). Propose a session across 8 tracks—from 15m bytes to 3h deep dives. First-time speakers welcome! Submit by end of Nov: dvgr27.cfp.dev/ #devoxxgr #dvgr27
5
2
14
1,744
LLM Inference on GPU in Java? @tornadovm and @jitllm at @Devoxx Belgium! * Java writing Java that runs on the GPU. Java for the GPU, on the GPU!. * A @QuarkusIO @langchain4j application reviewing it's future port to Quarkus 4 locally, all in Java on GPU! youtu.be/HO5CpETzywk?is=_ws2…

Building LLM Inference Engines in Java with TornadoVM and the NVIDIA...

Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.

youtube.com
2
7
12
297
96.65 tokens/sec for #Llama 3.2 1B – running through a pure-#Java GPU inference engine. @mikepapadim explores GPULlama3.java & #TornadoVM and how they bring GPU-accelerated #LLM inference to the #JVM. See the code: javapro.io/2026/10/13/buildi… #AI @langchain4j @QuarkusIO
1
8
1
12
354
#LangChain4j 1.22.0 is out! Highlights: - OpenAI Decisions API support - AWS Bedrock batch inference - Automatic prompt caching for Anthropic Thanks to all contributors! github.com/langchain4j/langc…

Release 1.22.0 and 1.22.0-beta32 · langchain4j/langchain4j

Notable Changes Decision Models: Add OpenAI Decisions API support: OpenAiDecisionModel and OpenAiOfficialDecisionModel by @dliubarskyi in #6611 Decision Services: images as parameters, and @desc...

github.com
1
11
1
36
1,473
Yesterday my colleagues @MXekalaki and @mikepapadim showed live demos about using @nvidia cuFFT and cuBLAS with @tornadovm for signal filtering and @jitllm! NVIDIA performance is a jar away from Java. #Java #CUDA #TornadoVM
TornadoVM@tornadovmOct 7
Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by @nvidia, now one jar away for your Java - without caring about JNI. We also show demos with @ApacheFlink and @jitllm. Watch our talk in @Devoxx 👇 youtu.be/6SPnBmQrYEk?si=3DI_… #opensource #AI #TornadoVM #Java #GPU

Tap into the NVIDIA Ecosystem from Java with TornadoVM's Hybrid API by Thanos Stratikopoulos, Micha

Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.

youtube.com
5
7
111
jitLLM retweeted
TornadoVM@tornadovmOct 7
Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by @nvidia, now one jar away for your Java - without caring about JNI. We also show demos with @ApacheFlink and @jitllm. Watch our talk in @Devoxx 👇 youtu.be/6SPnBmQrYEk?si=3DI_… #opensource #AI #TornadoVM #Java #GPU

Tap into the NVIDIA Ecosystem from Java with TornadoVM's Hybrid API by Thanos Stratikopoulos, Micha

Enjoy the videos and music you love, upload original content, and share it all with friends, family, and the world on YouTube.

youtube.com
8
1
12
686
We are @Devoxx, getting ready for our first hands-on #GPU lab for #Java! We will be in BOF2 room at 16:50, with live demos! @tornadovm @jitllm
1
4
12
194
We passed 100K downloads of @DevoxxGenie 🔥🤩
1
5
21
723
jitLLM is part of the @langchain4j 1.21.0 release! 🚀 Read more here: docs.langchain4j.dev/integra… #opensource #LLM #GPU #Java #LangChain4j #Inference

jitLLM | LangChain4j

jitLLM runs LLMs in GGUF format inside the JVM.

docs.langchain4j.dev
LangChain4j@langchain4jOct 2
#LangChain4j 1.21.0 is out! 🚀 Meet Decision Models: instant yes/no, choice and scale answers with probabilities. Decision Services turn any Java interface into a classifier. Plus model routing, re-ranking, tool selection, guardrails and agentic routing! github.com/langchain4j/langc…

Release 1.21.0 and 1.21.0-beta31 · langchain4j/langchain4j

Decision Models (experimental) This release introduces decision models: a new model type that answers questions about an input with typed answers and probabilities instead of generated text. They a...

github.com
5
7
108
Excited to see our work reaching this point. ⚡ Pure Java LLM inference, seriously fast. Approaching - and in some cases exceeding - llama.cpp performance.
jitLLM@jitllmSep 30
Can Java compete with llama.cpp/@ollama? YES! With @jitLLM! jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO. github.com/beehive-lab/jitll…
4
7
219
Can Java compete with llama.cpp/@ollama? YES! With @jitLLM! jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO. github.com/beehive-lab/jitll…
5
2
10
592
jitLLM retweeted
TornadoVM@tornadovmSep 30
Next week we will be in @Devoxx and speak about @tornadovm, @jitllm and how we accelerate Java on GPUs, using @nvidia native libraries! Come and talk to us, to learn more! #opensource #Java #AI #TornadoVM #jitLLM #GPU
7
1
10
465
Load more