Twitter - one of the latest and hottest Web 2.0 trends used by millions of users around the world every day. How does it manage the enormous data produced by its users? This article reviews the technical aspects of the Twitter service, how it handles such a tremendous amount of tweets and other data, and looks at what we can learn from the findings.

InfoQ has released a video of Twitter's Kevin Weil speaking at Strange Loop earlier this year on how the company uses NoSQL. Weil is quick to point out that Twitter is heavily dependent on MySQL. However, Twitter does employ NoSQL solutions for many purposes for which MySQL isn’t ideal. According to Weil, Twitter users generate 12 terrabytes of data a day - about four petabytes per year. And that amount is multiplying every year. Read on for our notes on Weil’s talk.

nosql:

Alexandre Porcelli has a great post for NoSQL beginners:

one of the most frequent question that people use to ask me about nosql is: what is the best nosql tool that enables me start with using my programming language (java, .net, php, python, etc..)? its almost impossible to have a quick answer ‘cos it involves many things like: data-model, durability and usage scenario (single node, qty of nodes or cloud setup), language binding and easy to setup.

NoSQL guide for beginners

It’s a great addition to the guide on getting started with NoSQL, expanding on some of the principles I’ve mentioned in the role of data modeling with NoSQL.

Original title and link for this post: NoSQL Guide for Beginners (published on the NoSQL blog: myNoSQL)

15 notes

I don’t consider myself the right person to write detailed tutorials as I usually tend to omit a lot of details . But I’d like to try out a different approach: I’ll share with you the best materials I have found and used myself to learn about a specific feature. Please do let me know if you’ll…

4 notes

nosql:

Interesting post from Steve Francia on the NoSQL hype cycle[1]:

Technology trigger

As Facebook, Twitter and others saw them as solutions to their massive scalability solutions (and because they were using relational databases for things they shouldn’t have) people began to see NoSQL as a golden hammer

Peak of inflated expectations

Unfortunately knowing when to use the technology requires actual experience with it, which never seems to catch up to the hype engine quickly enough, so consequently the technology transforms into a “golden hammer”. Better at everything and ready to displace everything that existed before.

Trough of Disillusionment

Current technologies exist because they do something well. when a new technology emerges it will likely be good at a different thing meaning the two will co-exist.

and so on:

hype cycle

References

6 notes

nosql:

A discussion on the MongoDB group about EBS snapshot backups of journaled MongoDB reminded me of a Jared Rosoff’s slides “MongoDB on EC2 and EBS” covering many important aspects of running MongoDB on the Amazon cloud:

  • MongoDB components and their requirements

    MongoDB components

  • deployment options…

5 notes

michaelhoeweler:

George Orwell for TIME Magazine, sumi ink and pen.

michaelhoeweler:

George Orwell for TIME Magazine, sumi ink and pen.

664 notes