LiteLLM v1.106.1 fixes proxy and vector store issues

News LLM Inference Infrastructure

  • LiteLLM fixed multi-turn Anthropic requests dropping signed thinking blocks and `thinking.block_binding`.
  • For gpt-5.4+ models, tool calls in Chat completions could appear under `choices[1]`; this release corrects that behavior.
  • Team-key users can now retrieve, cancel, and download their own batches without the reported 403 error.
  • The release fixes HTTP 400 errors during vector store metadata updates, and requires a cleanup script for stores created before this version.
  • Token counting fixes cover PDFs, system prompts, and tools, and address rejected Google `countTokens` requests.

Our take

This upgrade involves more than replacing the LiteLLM image: existing vector stores need a repair step. The release notes do not say whether that script requires downtime or describe a rollback path, so validate it against a test store and plan an appropriate maintenance window.

Sources

  1. litellm v1.106.1 · LiteLLM Releases

The summary and analysis were generated by AI. The original sources are authoritative. AI content policy