recentpopularlog in

ignatz : via:jm   29

AWS S3 Event Notifications have "probably once" delivery
you get the following

Messages that are delivered once;
Messages that are delivered multiple times;
Messages that are not delivered

This is in fact equivalent to "no guarantees at all" but the phrase "probably once" has a certain appeal to it. In my case I have an application that writes files to S3 at a regular interval. These files are processed by a lambda so they can be loaded into a database. This database is ultimately used in a customer facing application, so any duplicates gets noticed very quickly. Somehow I needed to come up with a way to deal with this pecuilar behavior of S3 Event Notifications.

Christ, what a mess. Sounds like S3 Event Notifications are best ignored for production use. Disappointing :(
aws  s3  event-notifications  consistency  durability  reliability  ops  via:jm 
21 days ago by ignatz
Details of the Cloudflare outage on July 2, 2019
Great writeup from jgc. Worth noting some important lessons:

* config changes should be rolled out carefully and gradually, just like code;

* particularly regexps, which are effectively code anyway;

* emergency-use rollback systems need to work, of course!;

* having emergency-only systems is a risk, too, since infrequently-used code paths are likely to atrophy and break without anyone noticing (as nsheridan said);

* /.*/ in a regexp is pretty much always bad news, and would have been worth a linter to catch before commit.
cloudflare  outages  regex  postmortems  regexps  deployment  rollback  via:jgc  via:jm 
28 days ago by ignatz
The Codeless Code: Case 234 Ozymandias
Love this:
I chanced upon an ancient cache of code:
a stack of printouts, tall as any man,
that in decaying boxes had been stowed.
Ten thousand crumbling pages long it ran.
Abandoned in the blackness to erode,
what steered a ship through blackness to the moon.
The language is unused in this late year.
The target hardware, likewise, lies in ruin.
Entombed within one lone procedure’s scope,
a line of code and then these words appear:

# TEMPORARY, I HOPE HOPE HOPE

The code beside persisting to the last—
as permanent as aught upon this sphere—
while overhead, a vacant moon flies past.
moon  apollo  coding  history  hacks  comments  funny  poetry  poems  ozymandias  via:jm 
28 days ago by ignatz
Humans Are Growing Weird, Bone Spikes on Their Skulls. Smartphones May Be the Culprit
The strange story of the external occipital protuberance --

'A cause-and-effect relationship hasn't been identified, but it's possible that the spike comes from constantly bending one's neck at uncomfortable angles to look at smart devices. The human head is heavy, weighing about 10 lbs. (4.5 kilograms), and tilting it forward to look at funny cat photos (or however you spend your smartphone time) can strain the neck — hence the crick people sometimes get, known as "text neck." Text neck can increase pressure on the juncture where the neck muscles attach to the skull, and the body likely responds by laying down new bone, which leads to that spiky bump, Shahar told the BBC. This spike distributes the weight of the head over a larger area, he said.'
text-neck  bones  skull-spike  smartphones  future  medicine  via:jm 
9 weeks ago by ignatz
Carnival Cruise Line to pay a $20M fine over pollution
Carnival’s pollution problem is so bad that across its fleet, the large boats pollute 10 times more than all 260 million of Europe’s cars. That tidbit comes courtesy of a study by the European think tank Transport & Environment, which looked at 203 cruise ships sailing European waters in 2017.

The report also found that besides over-tourism and crashing into ports, there’s a good reason for European cities to dislike cruise ships: they are emitting sulfur dioxide all over the place. If you can’t keep your pollutants straight, sulfur dioxide causes both acid rain and lung cancer. Cruise lines, it turns out, have been dropping the gas all over Europe; the report says Barcelona, Palma Mallorca, and Venice were the cities worst affected by sulfur dioxide emissions. Per the FT, “sulfur dioxide emissions from cars was 3.2m kt versus 62m kt from cruise ships, with Carnival accounting for half that, the study found.”
travel  doom  cruiseships  pollution  europe  environment  climatechange  via:jm 
10 weeks ago by ignatz
An update on Sunday’s service disruption | Google Cloud Blog
postmortem on google outage. note that once again it's a config error, which is how it happen now
gcp  google  odd  outages  post-mortems  networking  config  sysadmin  ops  via:jm 
10 weeks ago by ignatz
Underground Utility Colour Codes Explained
Underground utility colour codes are used to differentiate and identify underground utilities to protect it from damage during excavation. There are different types of utilities and in order to tell them apart coloured lines, flags or sometimes both are used. They help mark the location and indicate the type of utility that is buried underground.

I had no idea! (via Tony Finch)
utilities  power  underground  excavation  digging  repair  urban  infrastructure  via:jm 
november 2018 by ignatz
OVH suffer 24-hour outage (The Register)
Choice quotes:

‘At 6:48pm, Thursday, June 29, in Room 3 of the P19 datacenter, due to a crack on a soft plastic pipe in our water-cooling system, a coolant leak causes fluid to enter the system';
‘This process had been tested in principle but not at a 50,000-website scale’
postmortems  ovh  outages  liquid-cooling  datacenters  dr  disaster-recovery  ops  via:jm 
july 2017 by ignatz
Netgear PR2000 Trek Travel Router and Range Extender
802.11n, compact, can be used as a router, range extender, AP or bridge; very handy when travelling. Recommended by a FOAF
recommendations  toget  routers  netgear  wireless  wifi  travel  via:jm 
may 2017 by ignatz
Ubuntu on AWS gets serious performance boost with AWS-tuned kernel
interesting -- faster boots, CPU throttling resolved on t2.micros, other nice stuff
aws  ubuntu  ec2  kernel  linux  ops  via:jm 
april 2017 by ignatz
Instapaper Outage Cause & Recovery
Hard to see this as anything other than a pretty awful documentation fail by the AWS RDS service:
Without knowledge of the pre-April 2014 file size limit, it was difficult to foresee and prevent this issue. As far as we can tell, there’s no information in the RDS console in the form of monitoring, alerts or logging that would have let us know we were approaching the 2TB file size limit, or that we were subject to it in the first place. Even now, there’s nothing to indicate that our hosted database has a critical issue.
limits  aws  rds  databases  mysql  filesystems  ops  instapaper  risks  via:jm 
february 2017 by ignatz
Artist Tricks Tourists With Elaborate Monument To Staten Island Ferry Octopus Attack
'You probably don't know much about the Staten Island Ferry Disaster Memorial Museum, which honors the 400 victims who died when a giant octopus attacked the Cornelius G. Kolff, a Staten Island Ferry boat, on Nov. 22, 1963. That isn't because the event was overshadowed by the assassination of JFK that same day—it's because, as you may have guessed based on the word "tricks" in the headline, there was no such octopus-induced tragedy.'
ferries  staten-island  octopi  ha  pranks  tourism  via:jm 
september 2016 by ignatz
Royal Negroni cocktail recipe
'Build Negroni over ice, top with sparkling wine, stir briefly. They'll get you messed up quick, but it's a great way to go.' aka. the Double Sbagliato. yum
negroni  cocktails  recipes  campari  prosecco  sparkling-wine  red-vermouth  gin  via:jm 
september 2016 by ignatz
Google Translate of "Lorem ipsum"
The perils of unsupervised machine learning... here's what GTranslate reckons "lorem ipsum" translates to:
We will be sure to post a comment. Add tomato sauce, no tank or a traditional or online. Until outdoor environment, and not just any competition, reduce overall pain. Cisco Security, they set up in the throat develop the market beds of Cura; Employment silently churn-class by our union, very beginner himenaeos. Monday gate information. How long before any meaningful development. Until mandatory functional requirements to developers. But across the country in the spotlight in the notebook. The show was shot. Funny lion always feasible, innovative policies hatred assured. Information that is no corporate Japan
lorem-ipsum  boilerplate  machine-learning  translation  google  translate  probabilistic  tomato-sauce  cisco  funny  via:jm 
june 2013 by ignatz
BBC Test Card image (1080p HD version)
via colinwh. The de-facto standard HTPC desktop background
htpc  desktops  hd  1080p  bbc  test-card  tv  scary-clowns  via:jm 
march 2013 by ignatz
drug cartel-controlled mobile comms networks
“The Mexican military has recently broken up several secret telecommunications networks that were built and controlled by drug cartels so they could coordinate drug shipments, monitor their rivals and orchestrate attacks on the security forces. A network that was dismantled just last week provided cartel members with cellphone and radio communications across four northeastern states. The network had coverage along almost 500 miles of the Texas border and extended nearly another 500 miles into Mexico’s interior. Soldiers seized 167 antennas, more than 150 repeaters and thousands of cellphones and radios that operated on the system. Some of the remote antennas and relay stations were powered with solar panels.”
mexico  drugs  networks  mobile-phones  crime  via:jm 
february 2013 by ignatz
Heroku finds out that distributed queueing is hard
Stage 3 of the Rap Genius/Heroku blog drama. Summary (as far as I can tell): Heroku gave up on a fully-synchronised load-balancing setup ("intelligent routing"), since it didn't scale, in favour of randomised queue selection; they didn't sufficiently inform their customers, and metrics and docs were not updated to make this change public; the pessimal case became pretty damn pessimal; a customer eventually noticed and complained publicly, creating a public shit-storm.

Comments: 1. this is why you monitor real HTTP request latency (scroll down for crazy graphs!). 2. include 90/99 percentiles to catch the "tail" of poorly-performing requests. 3. Load balancers are hard.

http://aphyr.com/posts/277-timelike-a-network-simulator has more info on the intricacies of distributed load balancing -- worth a read.
heroku  rap-genius  via:hn  networking  distcomp  distributed  load-balancing  ip  queueing  percentiles  monitoring  via:jm 
february 2013 by ignatz
Literate Jenks Natural Breaks and How The Idea Of Code is Lost
A crazy amount of code archaeology to discover exactly an algorithm -- specifically 'Jenks natural breaks", works, after decades of cargo-cult copying (via Nelson):

'I spent a day reading the original text and decoding as much as possible of the code’s intention, so that I could write a ‘literate’ implementation. My definition of literate is highly descriptive variable names, detailed and narrative comments, and straightforward code with no hijinks.

So: yes, this isn’t the first implementation of Jenks in Javascript. And it took me several times longer to do things this way than to just get the code working.

But the sad and foreboding state of this algorithm’s existing implementations said that to think critically about this code, its result, and possibilities for improvement, we need at least one version that’s clear about what it’s doing.'
jenks-natural-breaks  algorithms  chloropleth  javascript  reverse-engineering  history  software  copyright  via:nelson  via:jm 
february 2013 by ignatz
Microsoft’s Downfall: Inside the Executive E-mails and Cannibalistic Culture That Felled a Tech Giant
"They had a great lead, they were years ahead. And they completely blew it. And they completely blew it because of the bureaucracy."
microsoft  bureaucracy  stack-ranking  hr  culture  via:jm 
july 2012 by ignatz
Amazon Web Services Blog: Amazon S3 Performance Tips & Tricks
Doug Grismore provides a very useful S3 performance tip; monotonically increasing keys will hurt performance, and describes a clean-enough way to avoid the problem
s3  performance  aws  via:jm 
march 2012 by ignatz
Online censorship now bordering on the ridiculous in Turkey - Reporters Without Borders
'access to websites containing words on the list would in theory be suspended and it would be impossible to create new ones containing them. However, it is not clear how and to what extent the directive will be implemented in practice. The TIB could decide to suppress or block pages for just one blacklisted word. ... The list, which borders on the ridiculous, includes words such as “etek” (skirt), “baldiz” (sister-in-law) and “hayvan” (animals).
via:jm  turkey  censorship  oppression  internet  filtering  failure  buttbuttination 
april 2011 by ignatz
kaputtendorf » Hibernation Tool for Mac OS
hibernate your mac instead of suspending it
osx  mac  power  sleep  hacks  hibernate  via:jm 
june 2009 by ignatz
Post-mortem of writing an O'Reilly book
Mr. Earbrass Writes a MySQL Book, or the perils of tech writing work.
via:jm  ora  writing  techwriting  mysql  oreilly 
june 2008 by ignatz

Copy this bookmark:





to read