Distantmagic @distantmagic
We are simplifying the deployment and use of LLMs and ML models in production for developers and MLOps/LLMOps. distantmagic.com Warsaw, Poland Joined December 2019-
Tweets15
-
Followers5
-
Following5
-
Likes0
GPU cloud instances capable of hosting Large Language Models are costly. That was one of my motivations for starting Paddler (an open-source load balancer for `llama.cpp`). It scales from zero instances, so you do not have to pay for GPU instances when your environment is idle.
llama.cpp in server prod? 👀 github.com/distantmagic/p…
Paddler is a llama.cpp load balancer with agents that monitor the health of individual llama.cpp instances. Paddler aggregates the /health endpoints of llama.cpp and reports the total number of available and processing slots. Learn more: github.com/distantmagic/p…
Meet Paddler: an open-source, production-ready load balancer & reverse proxy for llama.cpp servers. It scales from zero hosts, buffers requests, and has agents that monitor the health of individual llama.cpp instances. Learn more: github.com/distantmagic/p…
Highlighting project paddler - a load-balancer for llama.cpp servers by mcharytoniuk@gh github.com/distantmagic/p…
A nice repo - paddler - open-source load balancer and reverse proxy designed specifically for optimizing servers running llama.cpp.
Resonance PHP Framework includes validation constraints similar to JSON Schema but written in PHP. You can also convert them into JSON Schema. Read more about using different constraints in our docs: resonance.distantmagic.com/docs/features/…
Swoole Server Tasks in Resonance help you handle long-running tasks efficiently. Tasks run on the same server but in separate processes, boosting your app's performance. Learn more: resonance.distantmagic.com/docs/features/…
New project! Structured data extractor with Golang github.com/distantmagic/s…
"#AI is changing how we build apps — moving from click-based #UIs to #conversationalUI, from hard-coded logic to semantic #LLMs, and from limited structured data to unified data layers leveraging structured and unstructured data in decision-making." @AliceSteinglass, @salesforce…
PHP Resonance Framework + Swoole + Open-Source AI = You Can Talk to Your App @php_swoole @openswoole @phparch @deminy youtube.com/watch?v=pCyEBu…
I just released a new PHP framework. PHP is changing and it can easily adapt to the new challenges in the modern software development. hackernoon.com/introducing-re…
Alex Cheema - e/acc @alexocheema
38K Followers 2K Following Building @exolabs | prev @UniOfOxford We're hiring: https://t.co/UlkApFndnH
Frode Børli @frodeborli
65 Followers 112 Following Synser og mener mye om mangt - og liker å lære av, og belære andre som synser og mener mye om mangt.
Georgi Gerganov @ggerganov
52K Followers 289 Following 24th at the Electrica puzzle challenge | https://t.co/baTQS2bdia
Openswoole @openswoole
3K Followers 51 Following Open Swoole®: Secure, Reliable, High performance. Open Source High Performance Programmatic Server for #opensource #php Follow, RT, like are not endorsements
Swoole @php_swoole
548 Followers 1 Following The Official Swoole® account. Swoole is now OpenSwoole, please follow our main account @openswoole https://t.co/F9DbOmrRwd
Roman Pronskiy @pronskiy
4K Followers 816 Following Product Lead for @PhpStorm, Executive Director and Board Member at @ThePHPF.
Demin Yin @deminy
531 Followers 223 Following PHP veteran. Official evangelist of Swoole (@phpswoole). Sometime conference speaker.Trends for United States
You might like
