Multi-Terabyte GPUs the Only Answer for AI Scaling - Tech Field Day Podcast
Tech Field Day Podcast
•
26m
Are multi-terabyte GPUs and massive frontier models really the answer to enterprise AI, or are we hitting a hard wall of soaring memory costs and power constraints? In this episode of the Tech Field Day Podcast, host Alastair Cooke sits down with technical experts Ron Pagani Jr., Andy Banta, and Brian Martin to examine whether brute-force hardware scaling remains sustainable. The panel debates scale-up vs. scale-out architectures, emphasizing how smart software optimizations—such as persistent KV caching (MinIO MemKV, Solidigm) and intelligent data layers (CTERA)—can eliminate redundant GPU computation and lower costs. They also explore agentic microservices, power and cooling bottlenecks, and why right-sizing AI models for production is critical for achieving real-world enterprise ROI.
Up Next in Tech Field Day Podcast
-
Data Centers Need to be Multi-Tenant ...
As the explosive rise of AI workloads brings massive GPU clusters back to on-premises environments and surging neo-clouds, the race to maximize hardware utilization has made multi-tenancy an absolute necessity.
In this episode of the Tech Field Day Spotlight Podcast, host Tom Hollingsworth sits ...
-
Networks Need to Drive Themselves pre...
Imagine walking into the office, grabbing your morning coffee, and realizing your network dashboard is perfectly green because an AI agent silently resolved every issue while you slept. In this episode of the Tech Field Day Podcast, host Tom Hollingsworth sits down with network practitioners Keit...
-
Enterprise Networks Are Embracing Ope...
Enterprises are increasingly turning to open networking and they need guidance to ensure the right choices are being made. A great partner can ease the transition. In this episode of the Tech Field Day podcast, brought to you by Cisco, Tom Hollingsworth is joined by Scott Robon, Ryan Booth, and C...
