Upscale AI posits that traditional data center networking is a round peg in a square hole for AI, as existing infrastructures were designed for general-purpose web traffic rather than the massive, synchronized communication required by billions of parameters and trillion-token models. By focusing exclusively on AI traffic and removing the bloat of legacy enterprise features, Upscale AI aims to provide a reliable, predictive substrate that treats the entire cluster as a single, coordinated engine.

The technical strategy addresses the evolution of AI workloads from dense training to inference-centric agentic AI and persistent states. As models outgrow the memory capacity of single GPUs, parallelism, like slicing math problems across thousands of processors, becomes mandatory, creating a massive data movement problem. Upscale AI advocates for a distributed ecosystem where the network must be technology-agnostic to support a plethora of specialized ASICs, including GPUs, TPUs, and custom hyperscaler XPUs. This architecture moves away from reactive TCP-based recovery toward a lossless, RDMA-driven environment where the network proactively manages congestion to prevent computational stalls, ensuring that every GPU cycle is utilized to maximize tokens per watt.

To future-proof these investments, Upscale AI is developing a portfolio of scale-up and scale-out systems built on open standards like Ethernet, SONiC, and UA Link. Their scale-out systems leverage a partnership with NVIDIA's Spectrum-X, while their scale-up innovation involves purpose-built silicon and trays to support heterogeneous compute and memory pooling. By utilizing a unified software stack based on SONiC, the company provides a common substrate that simplifies operational onboarding for neoclouds and enterprises. Ultimately, Upscale AI's mission is to move beyond the current homogeneous nature of AI clusters, providing an open, standards-based fabric that allows diverse hardware to interoperate seamlessly for the next decade of AI innovation.

Presented by Deepti Chandra, VP Product and Marketing. Recorded live at Networking Field Day 40 in San Jose on April 9, 2026. Watch the entire presentation at https://techfieldday.com/appearance/upscale-ai-presents-at-networking-field-day-40/ or visit https://TechFieldDay.com/event/nfd40 or https://upscale.ai for more information.