Cloud Field Day 23
S3 Object Storage for Real-Time Compliance Analytics at a Large US Global Bank with Scality
7m 21s
Ben Morge, VP of Customer Success at Scality, presented a deployment of Scality RING for a large US bank that needed to store 40 petabytes of Splunk SmartStore data across two sites. The bank required active-active replication and a one-year data retention period. RING’s S3 compatibility enabled seamless integration with Splunk, allowing the indexers to tier data from hot, fast flash storage to the warm Scality RING, which consisted of 80 servers. The data is immutable on the ring for one year, with the Splunk application handling data deletion.
The Scality deployment leverages S3 for data storage. The solution employs a two-site architecture, where each site features Splunk indexers and a hot storage cluster. The indexers are responsible for replicating indexes and references to objects stored on the ring. Scality manages object replication, utilizing cross-region replication, which is the S3 standard. The system addresses network issues by employing infinite replay to ensure reliable replication and decoupling storage from compute.
The presentation highlighted a couple of challenges and their solutions. The initial ingest exceeding firewall throughput was resolved with infinite replay. The initial difficulties with the read traffic exceeding CPU capabilities, leading to overwhelmed flash caches, were addressed by decoupling the architecture and adding compute resources to handle the metadata layer and S3 stateless services, resulting in simultaneous 75 gigabytes throughput on both sites and a fully replicated cluster with all the objects replicated in under two minutes. The customer's active production has been running successfully for over five years.
Presented by Ben Morge — World-wide VP, Customer Success, Scality. Recorded live in Millbrae, California, on June 4, 2025, as part of Cloud Field Day 23. Watch the entire presentation at https://techfieldday.com/appearance/scality-presents-at-cloud-field-day-23/ or https://techfieldday.com/event/cfd23/ for more information.
Up Next in Cloud Field Day 23
-
Leading Space Agency’s Long-Term Scie...
Scality's presentation at Cloud Field Day 23 focused on their collaboration with a major European space agency, which utilizes Scality RING to manage massive scientific datasets in a hybrid storage model. The agency, dealing with data from approximately 200 satellites, faced challenges with legac...
-
Major European Bank’s Enterprise Clou...
Aurelien Gelbart's presentation at Cloud Field Day 23 highlighted a major European bank's successful deployment of a private cloud built on Scality RING and S3 APIs. The bank sought to consolidate disparate storage solutions, aiming for a lower cost per terabyte and easier adoption for its users....
-
Scality RING Powers Iron Mountain’s 5...
Jeff Mach's presentation at Cloud Field Day 23 focused on Iron Mountain's implementation of Scality RING for its Iron Cloud 2.0 offering. Iron Mountain, a long-standing provider of storage solutions, transitioned to cloud storage to meet the growing demand for secure data storage. The presentatio...