jitLLM @jitllm

Great to see @tornadovm on the top of the @ycombinator today! The article has all of the latest work on accessing @nvidia libraries from Java!

Had so much fun at @JDD_Krakow 2026 in Kraków yesterday. I presented “Java Goes CUDA-Native”: new @tornadovm features that let @jitllm run LLM inference at GPU-native speed, from Java. tornadovm.org jitllm.io #opensource #Java #TornadoVM #GPU #AI

keyboard_arrow_left Previous keyboard_arrow_right Next

The Devoxx Greece 2027 Call for Papers is OPEN! Join us in Athens (Apr 15-17). Propose a session across 8 tracks—from 15m bytes to 3h deep dives. First-time speakers welcome! Submit by end of Nov: dvgr27.cfp.dev #devoxxgr #dvgr27

LLM Inference on GPU in Java? @tornadovm and @jitllm at @Devoxx Belgium! * Java writing Java that runs on the GPU. Java for the GPU, on the GPU!. * A @QuarkusIO @langchain4j application reviewing it's future port to Quarkus 4 locally, all in Java on GPU! youtu.be/HO5CpETzywk?is…

96.65 tokens/sec for #Llama 3.2 1B – running through a pure-#Java GPU inference engine. @mikepapadim explores GPULlama3.java & #TornadoVM and how they bring GPU-accelerated #LLM inference to the #JVM. See the code: javapro.io/2026/10/13/bui… #AI @langchain4j @QuarkusIO

#LangChain4j 1.22.0 is out! Highlights: - OpenAI Decisions API support - AWS Bedrock batch inference - Automatic prompt caching for Anthropic Thanks to all contributors! github.com/langchain4j/la…

Yesterday my colleagues @MXekalaki and @mikepapadim showed live demos about using @nvidia cuFFT and cuBLAS with @tornadovm for signal filtering and @jitllm! NVIDIA performance is a jar away from Java. #Java #CUDA #TornadoVM

keyboard_arrow_left Previous keyboard_arrow_right Next

TornadoVM @tornadovm

2 weeks ago

Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by @nvidia, now one jar away for your Java - without caring about JNI. We also show demos with @ApacheFlink and @jitllm. Watch our talk in @Devoxx 👇 youtu.be/6SPnBmQrYEk?si… #opensource #AI #TornadoVM #Java #GPU

0 8 12 669 0

Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by @nvidia, now one jar away for your Java - without caring about JNI. We also show demos with @ApacheFlink and @jitllm. Watch our talk in @Devoxx 👇 youtu.be/6SPnBmQrYEk?si… #opensource #AI #TornadoVM #Java #GPU

We are @Devoxx, getting ready for our first hands-on #GPU lab for #Java! We will be in BOF2 room at 16:50, with live demos! @tornadovm @jitllm

We passed 100K downloads of @DevoxxGenie 🔥🤩

jitLLM is part of the @langchain4j 1.21.0 release! 🚀 Read more here: docs.langchain4j.dev/integrations/l… #opensource #LLM #GPU #Java #LangChain4j #Inference

LangChain4j @langchain4j

3 weeks ago

#LangChain4j 1.21.0 is out! 🚀 Meet Decision Models: instant yes/no, choice and scale answers with probabilities. Decision Services turn any Java interface into a classifier. Plus model routing, re-ranking, tool selection, guardrails and agentic routing! github.com/langchain4j/la…

2 12 38 2K 7

Excited to see our work reaching this point. ⚡ Pure Java LLM inference, seriously fast. Approaching - and in some cases exceeding - llama.cpp performance.

jitLLM @jitllm

3 weeks ago

Can Java compete with llama.cpp/@ollama? YES! With @jitllm! jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO. github.com/beehive-lab/ji…

0 5 10 587 0

Can Java compete with llama.cpp/@ollama? YES! With @jitllm! jitLLM uses @nvidia CUDA libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm and will be soon in @langchain4j and @QuarkusIO. github.com/beehive-lab/ji…

Next week we will be in @Devoxx and speak about @tornadovm, @jitllm and how we accelerate Java on GPUs, using @nvidia native libraries! Come and talk to us, to learn more! #opensource #Java #AI #TornadoVM #jitLLM #GPU