AI data infrastructure is facing demands unlike anything before. For 30 years, systems were designed for humans. AI agents put a very different kind of pressure on networks, systems and databases.
Couchbase SVP of AI Tim Finley examines that shift with Alan Shimel at KubeCon + CloudNativeCon in Salt Lake City.
Righting the One-Trick Ponies
Finley spent years as a customer before moving to Oracle and AWS. He joined Couchbase because it already had the components he would want in an AI system.
Over the years, specialized databases emerged for graph, time series, cache and vector workloads. Each did one job well. But AI runs on context, and scattering data across many systems scatters that context too.
Couchbase has pursued convergence from the start. Fewer systems means fewer integrations and a smaller security surface to manage.
The Pendulum Swings Back
For 15 years, modernization meant moving to the cloud. Now token costs, latency and hardware scarcity have some enterprises bringing workloads home.
Finley sees the pendulum settling in the middle. Analysts expect much of the data from agents to be generated at the edge. Couchbase customers already run projects on oil fields, airplanes, cruise ships and coffee shops.
Since no one knows exactly how AI will evolve, flexibility matters. Your AI data infrastructure should follow you wherever customers are.
Semantic Caching and What Comes Next
At its Catalyst conference, Couchbase made Agent Memory and an MCP server available as managed services. It also added an Amazon Bedrock integration with semantic caching.
Couchbase says that cache can cut LLM calls by 40% to 60%. Teams can keep using more capable models longer before costs force a trade-off.
Finley also previewed the next Couchbase Server release. He says it brings much faster cluster rebalancing and new vector index options. A conversational query assistant will let users ask questions in natural language.
After years of being seen as utilitarian, he says, databases are cool again.
Up Next in KubeCon 2026 Salt Lake City
-
Multi-Cloud Migration Moves From Mont...
Multi-cloud migration has long been slow, costly and risky. Moving workloads between clouds, or even between accounts, can take the better part of a year. Demand for faster portability keeps growing.
FluidCloud Co-founder and CEO Sharad Kumar examines that challenge with Alan Shimel at KubeCon +...
-
Nix Brings Reproducible Software to t...
Reproducible software used to be a niche concern for build engineers. AI agents have changed that. Teams now generate more code than ever, and every package must run the same way everywhere.
Flox CEO and co-founder Ron Efroni examines that shift with Alan Shimel at KubeCon + CloudNativeCon in Sa...
-
WebAssembly Sandboxes a Million AI Ag...
AI agent sandboxing has become one of the hottest topics in cloud native computing. Every booth seems to offer a way to isolate agents. Yet not every sandbox offers the same protection or the same performance.
Cosmonic CTO Bailey Hayes examines that challenge with Mike Vizard at KubeCon + CloudN...