This roundtable discussion at AI Infrastructure Field Day 5 brings together the delegate panel to reflect on the event's presentations and discussions. Alastair Cooke opened by noting a significant shift in focus from AI training infrastructure to AI inference infrastructure, emphasizing that inference is where businesses generate revenue and derive tangible value. Delegates echoed this, noting increased complexity for customers, a strong trend towards optimization, a preference for S3 over POSIX for data access, and the growing popularity of RDMA for efficient data transfer.
A notable surprise for several delegates was the often-low utilization of GPUs, challenging the popular perception of these resources being constantly overwhelmed. This highlighted a need for better resource allocation, with discussions emphasizing the importance of mapping diverse tasks to appropriate CPUs and GPUs and of efficient memory management. Gina drew parallels between the current AI landscape and the early days of virtualization, highlighting the technical achievements ("nerding out") while urging vendors to translate these innovations into clear business value. The "industrialization of AI" was a key theme, pushing discussions towards comprehensive system optimization, security, data protection, and management, rather than just isolated component-level improvements.
Emerging themes included the critical role of the AI ecosystem and deep integrations, particularly as more individuals become "developers" through API consumption, leading to concerns about "Shadow AI" and its security implications. Delegates stressed the necessity of evolving beyond mere storage devices to comprehensive "data platforms" encompassing security, lifecycle management, backup, and disaster recovery. There was also a perceived gap in understanding among new AI consumers about the underlying technological complexities, posing significant compliance and security risks. While standards bodies like SNIA are adapting to the rapid pace of change, a strong sentiment has emerged in favor of real-world workload-based performance evaluations over traditional, easily manipulated benchmarks.

Hosted by Alastair Cooke, Event Lead, Tech Field Day. Recorded live at AI Infrastructure Field Day in Millbrae, California, on June 11th, 2026. Watch the entire presentation at https://techfieldday.com/video/delegate-roundtable-at-ai-infrastructure-field-day-5/ or visit https://techfieldday.com/event/aiifd5/ for more information.