AI Agent Infrastructure

22 posts

News AI Agent InfrastructureLLM Training Infrastructure

ThinkingBox Turns Database-State Checks into Agent Training Rewards

Microsoft and Hugging Face have released ThinkingBox-Training on GitHub, including the data-selection, rollout, reward, and Verl integration used in their Qwen3.8-27B experiment.

News AI Agent Infrastructure

OpenAI Python SDK expands Decisions types

Live response models now allow question.instructions to contain structured text, image, or JSON parts as well as a string.

News LLM Training InfrastructureAI Agent Infrastructure

SageMaker AI adds customizable serverless training sessions

SageMaker AI serverless model customization training sessions are generally available, with teams writing their own post-training loops while AWS manages GPU allocation, distributed execution, recovery, and checkpoint storage.

News AI Agent Infrastructure

LangChain Core 1.7.0 changes streamed tool-call arguments

LangChain Core 1.7.0 sends streamed tool-call arguments as `tool-call-delta` slices instead of `block-delta` snapshots.

News AI Agent InfrastructureSpeech RecognitionLLM Inference Infrastructure

Streaming Kokoro TTS for AI agents on SageMaker AI

AWS demonstrates sending each completed agent sentence to Kokoro-82M on a SageMaker AI endpoint, so speech synthesis can begin before the full reply is ready.

News LLM Inference InfrastructureLLM Training InfrastructureAI Agent Infrastructure

NVIDIA Demonstrates Eight-Node DGX Spark Clusters

Eight DGX Spark nodes combine for 1 TB of unified memory, enough to load the full GLM 5.3 753B checkpoint locally.

News AI Agent Infrastructure

Connecting Amazon Quick to Corporate Networks with AWS PrivateLink

Amazon Quick uses separate network paths for user access and data retrieval: AWS PrivateLink VPC endpoints serve the first, while VPC connections handle the second.

News AI Agent Infrastructure

Deep Insight: Taking Multi-Agent Systems to Production

Deep Insight is an open-source data analysis system that turns a CSV file and a natural-language request into analysis results and a cited DOCX report.

News AI Agent Infrastructure

LangChain 1.4.7 adds streaming and tracing updates

LangChain 1.4.7 enables stream consumers to read tool-call-delta events.

News AI Agent InfrastructureLLM Inference Infrastructure

Strands Agents demo for routing work between local and cloud models

AAIF uses a local llama3.2:1b model as a request classifier in a Strands Agents setup, directing work to local tools or Amazon Bedrock instead of sending every request to one cloud model.

News AI Agent Infrastructure

LangChain Perplexity 1.4.2 fixes Agent API search handling

This release refreshes the model profile data.

News AI Agent InfrastructureLLM Inference Infrastructure

Ollama v0.40.8 adds Recursive’s Flint model

Ollama v0.40.8 makes Recursive’s Flint coding model available to run through Ollama.

News AI Agent Infrastructure

GitHub scales Git storage with per-reference quorum

Most GitHub repositories now keep two of their five replicas in Azure, which handles about half of Git traffic.

News LLM Inference InfrastructureAI Agent Infrastructure

NVIDIA Introduces Training-Free Relational Predictions

NVIDIA’s Kumo Relational runs predictive queries directly on relational databases, without task-specific training or manual feature engineering.

News AI Agent Infrastructure

NVIDIA Sentry adds hardware-isolated controls for AI agents

NVIDIA Sentry is part of the OpenShell reference architecture and uses BlueField-4 to monitor agents and enforce access policies outside the host software domain.

News AI Agent Infrastructure

NVIDIA OpenShell Adds Policy Controls to AI Agent Workloads

NVIDIA describes OpenShell as an open-source runtime that limits agents’ access to systems and data, while treating agent workloads as untrusted during execution.

News AI Agent InfrastructureLLM Inference Infrastructure

NVIDIA outlines an agent-assisted workflow for AI factory digital twins

NVIDIA’s Omniverse DSX Blueprint provides reference assets and workflows for building AI factory digital twins on OpenUSD and Omniverse libraries.

News AI Agent Infrastructure

Pydantic AI 2.59.0 fixes web_fetch security issue and adds agent features

Pydantic AI 2.59.0 fixes a high-severity issue in which converting attacker-controlled HTML with many elements through web_fetch_tool could delay unrelated work in the same process; the fix is also in v1.107.9.

News LLM Inference InfrastructureLLM Training InfrastructureAI Agent Infrastructure

i14 Trains and Serves Laplace 3B on AWS Trainium2

i14’s Laplace 3B uses Gated Linear Attention, keeping its recurrent state at 29.5 MB per sequence regardless of context length.

News AI Agent Infrastructure

Smartsheet MCP Server Connects Amazon Quick and Kiro

Smartsheet's generally available MCP Server provides more than 40 tools for reading, creating, and managing sheets, rows, columns, and automations through MCP.

News AI Agent Infrastructure

Anthropic Python SDK v1.16.0 adds API and client updates

Analytics report pages now include fields for when data was refreshed and whether more results are available.

News AI Agent Infrastructure

AWS Agent Registry enables runtime tool discovery for agents

AWS Agent Registry is a managed catalog for registering and discovering MCP servers, agents, and agent skills.