NVIDIA Introduces Personal AI Router for Distributed Home Inference
NVIDIA has launched the Personal AI Router (PAIR), a new software solution designed to distribute AI inference tasks across multiple compatible devices within a local home network. PAIR acts as a local inference router, discovering participating nodes, managing supported inference engines like Ollama and LM Studio, and presenting OpenAI-compatible and Ollama-compatible proxy endpoints to applications. This system allows independent AI requests to be routed to eligible nodes based on engine and model availability, as well as current workload. The primary goal of PAIR is to keep prompts and responses within the local network, enhancing privacy and enabling concurrent local AI workloads, particularly for multi-agent applications. It supports Windows 11, Linux, and macOS operating systems, with installers available for easy setup. Users can add models, such as 'qwen4:12b', and send requests, with PAIR intelligently distributing the processing across available devices. 
