Of Wine and Bullhorns - Social Media for Authors and Publishers
Thursday, 12/18/08 | 4 Comments

Full credit for the idea behind both the headline and content of this post is owed to (soon to be) Wiley Author Chris Brogan. This week I attended Chris’s Social Media For Publishers webinar presented …

Read the full story »
Books and Writing

Interesting books, authors, and advice for writers including tips for writing a great book proposal, working with agents, publishing contracts and more.

Internet and Technology

Geek Alert! Here is where I write about technology trends and things I find just plain cool. These may or may not have much to do with publishing.

Marketing and Promotion

Advice, ideas, and tools for building a platform that can help you promote your personal brand, and your work.

Publishing and Business

Thoughts on the publishing industry, changes in content creation and delivery, and business and management topics.

Social Networks and Media

How the social web is changing business, and ways we can build relationships that can promote, support, and add value to our products.

Home » Internet and Technology

Partly Cloudy: Amazon’s S3 Service Goes Down

Submitted by Chris on Friday, 02/15/084 Comments

King CloudWe’ve been hearing for some time that the future of our data storage is “in the cloud.” Many of us already use cloud storage for email (GMail), files (XDrive) and backup (Mozy) among many others. But what happens when you can no longer reach your data?

Several companies found out today when Amazon.com’s S3 service experienced an outage and left applications without their data tier. I first experienced it this morning about 8:30 EST when those of us on Twitter noticed that avatars were not loading. Later reports of missing images on Facebook, and other applications started rolling in as startups and application developers realized their apps were broken due to the Amazon S3 outage.

So, what to do when you rely on the cloud? Simple - don’t rely on the cloud completely.

SmugMug’s Don MacAskil has it right, and discussed his approach on TechCrunch’s report of the outage:

We do rely on S3 for our primary storage, but we do maintain our own “hot cache” of data in our datacenters, too, which is less than 10% of our total storage. Our customers weren’t affected by this morning’s outage.

PBwiki’s Nathan Schmidt agrees:

Never build your architecture to require low-latency, high-availability access to S3 or its competitors, because you won’t get those - that’s not what it’s for, that’s not what it’s optimized for, and you’re never going to be able to peel back those layers of abstraction and long-haul network.

(Photo credit akakumo)

Related Posts

4 Comments »

  • Ade said:

    I’m not sure I completely understand SmugMug’s response from a technical perspective. You have to make a decision about which 10% you’re going to store locally, and I’m going to assume that it’s at least files that were used more recently. But what happens when someone pulls up a photo that was uploaded years ago and it’s not part of that 10%?

    Or even if they store high-res photos on S3 and store thumbnails and previews locally, if someone requests a print of that photo, they’ll need to wait until S3 is back up to fetch the high-res files.

    Logic just seems to dictate that if you’re storing content there that isn’t being stored anywhere else, then either you don’t need that content in the first place, or you’re going to be affected in some way if it goes down.

  • Chris (author) said:

    Ade,

    Thanks for commenting.

    I would not want to speak for Don, but you raise some good questions. Since I don’t know the ins and outs of his infrastructure, I cant answer for him.

    Don’s an avid blogger over at SmugMug, so you might want to ask him over there, or perhaps he will comment here. Don, you want to chime in here?

  • Interesting reaction to Amazon S3 failure today around the web « Accidental Technologist said:

    [...] Partly Cloudy: Amazon’s S3 Service Goes Down [...]

  • Andrew said:

    Nice picture)

Leave a comment!

Add your comment below, or trackback from your own site. You can also subscribe to these comments via RSS.

Be nice. Keep it clean. Stay on topic. No spam.

You can use these tags:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

This is a Gravatar-enabled weblog. To get your own globally-recognized-avatar, please register at Gravatar.