recentpopularlog in

ignatz : s3   9

AWS S3 Event Notifications have "probably once" delivery
you get the following

Messages that are delivered once;
Messages that are delivered multiple times;
Messages that are not delivered

This is in fact equivalent to "no guarantees at all" but the phrase "probably once" has a certain appeal to it. In my case I have an application that writes files to S3 at a regular interval. These files are processed by a lambda so they can be loaded into a database. This database is ultimately used in a customer facing application, so any duplicates gets noticed very quickly. Somehow I needed to come up with a way to deal with this pecuilar behavior of S3 Event Notifications.

Christ, what a mess. Sounds like S3 Event Notifications are best ignored for production use. Disappointing :(
aws  s3  event-notifications  consistency  durability  reliability  ops  via:jm 
20 days ago by ignatz
BitNami Cloud Tools for Amazon Web Services (AWS)
The BitNami Cloud Tools installer packages the Amazon Web Services command line tools together with preconfigured Java, Ruby, Python and Perl language runtimes.
aws  amazon  tools  ec2  s3 
january 2013 by ignatz
Backup
A RubyGem that among other things handles RDS mysql backup to S3
backup  ruby  s3  aws  rds 
august 2012 by ignatz
Amazon Web Services Blog: Amazon S3 Performance Tips & Tricks
Doug Grismore provides a very useful S3 performance tip; monotonically increasing keys will hurt performance, and describes a clean-enough way to avoid the problem
s3  performance  aws  via:jm 
march 2012 by ignatz
S3rsync
rsync to s3. commercial product.
s3  backup  rsync  amazon  storage 
october 2008 by ignatz

Copy this bookmark:





to read