@LiteLLM v1.77.4-nightly brings support for the new Anthropic web fetch tool
The web fetch tool allows LLMs to retrieve full content from specified web pages and PDF documents
Get started here: docs.litellm.ai/docs/completio…
List of improvements here:
If you want to quickly and efficiently integrate an LLM into your "Internet Of Agents" hackathon project, @LiteLLM is your best friend.
→ Switch between any LLM provider with a single line of code
→ Experiment and deploy models without rewriting your functions
→ Keep code…
In startups, you are constantly migrating.
From fast & simple to complex, custom and scalable.
In the last 4 months we’ve migrated:
1. NextJS on Vercel -> React-Router on DigitalOcean
2. Custom agent code & @LiteLLM -> @pydantic AI
3. @digitalocean -> @awscloud
4.…
I once again learned something new from @kweinmeister.
@LiteLLM looks like a nice proxy in front of multiple LLMs in @googlecloud Vertex AI. Karl shows how you could invoke this directly, in Cline or Roo Code, and as a persistent background service.
I once again learned something new from @kweinmeister.
@LiteLLM looks like a nice proxy in front of multiple LLMs in @googlecloud Vertex AI. Karl shows how you could invoke this directly, in Cline or Roo Code, and as a persistent background service.
@LiteLLM v1.77.0-nightly brings major security upgrades - from this release there will be 0 CVSS Vulnerabilities with a 4.0 or higher score
We plan on guaranteeing this baseline for all future releases of LiteLLM Images
Other improvements on this release 👇
@nvidia Integration made simple ⚡
Thanks to @LiteLLM , we support:
- 100+ LLM providers
- Your own custom chatbots
- Seamless testing across different AI systems
Want to use models from Google's Vertex AI Model Garden with an OpenAI-compatible API?
My new video shows how to set up @LiteLLM as a local proxy to do just that. Simplify your workflow and call models like Qwen, DeepSeek, and more through a unified interface.
#AI#LLM…
LangChain is a 10,000 line wrapper for a 3-line API call.
Many layers of abstraction. x dependencies.
To do what? Call LLMs.
Deleted everything. Switched to @LiteLLM.
Same functionality. Actually faster. And I can see what's happening.
The "Agent Framework" grift is selling…
@LiteLLM v1.76.1-nightly brings support for the new OpenAI gpt-realtime model family
You can now use remote MCP servers, image inputs with gpt-realtime
Other improvements on this release:
Fix Next.js Security Vulnerabilities in UI Dashboard
You can use @xai Grok-4 for Claude Code simply with @LiteLLM 👋🏻
[Terminal 1]
1. export keys
2. run
claude --model grok-4
[Terminal 2]
1. edit config.yaml
```
general_settings:
master_key: your-master-key
proxy_user_auth: false
model_list:
- model_name: grok-4…
@LiteLLM v1.76.1-nightly brings support + cost tracking for Google gemini-2.5-flash-image models
From this release you can use gemini-2.5-flash-image-preview on Google AI Studio and Vertex AI
Other improvements on this release 👇
Claude Code 为什么这么好用?背后的“魔法”是什么?是它精心设计的提示工程和上下文管理,一起看看 👇
Claude Code 为什么“就是好用”?
许多开发者对它“几乎无脑好用”的体验赞不绝口。作者通过设置 @LiteLLM 代理,拦截 Claude Code 与 Anthropic API…
@LiteLLM v1.75.10-nightly brings support for using VertexAI @Alibaba_Qwen models
From this release you'll be able to use this model family + LiteLLM will track the cost per request
Get started here: docs.litellm.ai/docs/providers…
Other improvements on this release:
@LiteLLM v1.75.9-nightly brings major improvements to our @datadoghq LLM Observability integration. These improvements are great for AI Platform Teams deploying LiteLLM x Datadog into production.
Datadog-related improvements in this release 👇
@LiteLLM v1.75.7-nightly brings support for using reasoning_effort with vllm models through LiteLLM (h/t Andrés Carrillo López) for this request
Get started with vLLM here: docs.litellm.ai/docs/providers…
Other improvements on this release:
@LiteLLM v1.75.6-nightly brings support for Azure @bfl_ml FLUX models for Image Generation with cost tracking
With this release you can use FLUX models with OpenAI /images/generations API spec
Get started here: docs.litellm.ai/docs/providers…
Other improvements on this release 👇
@LiteLLM v1.75.6-nightly brings support for @awscloud Bedrock gpt-oss models
From this release you can streaming with bedrock gpt-oss models on LiteLLM
Get started here: docs.litellm.ai/docs/providers…
Other improvements on this release 👇
Today we're launching support for Responses API Session management across all @LiteLLM models
Use Gemini, Claude models families with /responses API, LiteLLM manages session context (including multimedia content)
loom.com/share/362cb6e9…
331 Followers 776 FollowingIts time to build. AI Product Specialist (GTM) @databricks. Prev. MLE & DS @shopify, DS @GrabSG, opinions and reposts are my own
2K Followers 903 FollowingFounder of ProSights (YC W24), AI finance automations trusted by over half of the 25 largest PE firms. Former IB/PE and @harvardswimdive
1K Followers 3K Following🛖 https://t.co/LyIhQqvh7Y, a software engineer and IT consultant who mostly talked about @dotnet, @nodejs, @electronjs before #RussiaInvadedUkraine.
15K Followers 6K FollowingI build tough benchmarks for LMs and then I get the LMs to solve them. SWE-bench & SWE-agent. Postdoc @Princeton. PhD @nlpnoah @UW.
96K Followers 1K FollowingCEO @HyperWriteAI, @OthersideAI, creator of https://t.co/PSUlubx5bb (Github for prompts), investor in @GroqInc @Etched @Rork_App @OpenRouterAI + many more
13K Followers 692 FollowingResearch @Meta Superintelligence Labs, RL/post-training/agents; Previously Research @OpenAI on multimodal and RL; Opinions are my own.
17K Followers 2K Followingbuilding @thinkbuddyai for real pros🥷 top 1% of users living in the chat apps
put all AIs side-by-side +🔌 plug them into tools by world's first MCP app store
21K Followers 24 FollowingA cutting-edge framework for orchestrating role-playing, autonomous AI agents that work together seamlessly to tackle complex tasks.
189 Followers 400 FollowingFounder @tight_studio - impressive product demos in minutes.
Founding engineer at Klarity (70m funding by NFDG), Covariant (acq'ed by Amazon), and Meta
22K Followers 2K FollowingFounder of @crewAIInc / prev @clearbit (acc by @hubspot)
Open Source enthusiast | Creator of Machinery | Public Speaker | My views
No recent Favorites. New Favorites will appear here.