Live stream preview
How KV Cache Changes AI Performance: Solidigm Explains the Hidden Path of Every Prompt - Tech Talks
6m 48s
What really happens after you hit enter on an AI prompt? At AI Field Day 8, Stephen Foskett sits down with Solidigm’s Scott Shadley to break down the journey of AI data from user prompt to hardware infrastructure. Learn how tokens move through memory, storage, and KV cache, why GPUs spend so much time waiting, and how modern SSDs are helping reduce costs while improving AI performance. This discussion explores AI infrastructure, memory optimization, storage as a memory layer, GPU utilization, and the real-world impact of architectural decisions on large language models, AI agents, and enterprise AI deployments.