recentpopularlog in

scalability

« earlier   
Millions of Tiny Databases
Starting in 2013, we set out to build a new database to act as the configuration store for a high-performance cloud block storage system (Amazon EBS).This database needs to be not only highly available, durable, and scalable but also strongly consistent. We quickly realized that the constraints on avail-ability imposed by the CAP theorem, and the realities of operating distributed systems, meant that we didn’t want one database. We wanted millions. Physalia is a transactional key-value store, optimized for use in large-scale cloud control planes, which takes advantage of knowledge of transaction patterns and infrastructure design to offer both high availability and strong consistency to millions of clients. Physalia uses its knowledge of datacenter topology to place data where it is most likely to be available. Instead of being highly available for all keys to all clients, Physalia focuses on being extremely available for only the keys it knows each client needs, from the perspective of that client.

This paper describes Physalia in context of Amazon EBS and some other uses within Amazon Web Services. We believe that the same patterns, and approach to design, are widely applicable to distributed systems problems like control planes configuration management, and service discovery.
ebs  databases  consistency  distributed  availability  scalability 
6 days ago by drmeme
Scaling to 100k Users | Alex Pareto
Many startups have been there - what feels like legions of new users are signing up for accounts every day and the engineering team is scrambling to keep things running.
performance  scalability 
13 days ago by dakull
Scaling to 100k Users | Alex Pareto
Many startups have been there - what feels like legions of new users are signing up for accounts every day and the engineering team is scrambling to keep things running.
architecture  performance  devops  scalability 
14 days ago by synergyfactor

Copy this bookmark:





to read