• Preface
• Big Data Basics
• Cloud Computing
• NoSQL
• Multi-tenancy
• Database-as-a-Service
• Scalability Options
• CAP Theorem
• Parallel Databases
• Big Data Storage
• Google BigTable/HBase
• Amazon Dynamo
• Amazon SimpleDB
• Amazon S3
• Windows Azure Table and Blob Storages
• Cassandra
• HyperTable
• MongoDB
• CouchDB
• Voldermot
• Database-as-a-Service
• Amazon RDS
• Microsoft SQL Azure
• Google Data Store
• Google Cloud SQL
• Heroku Postgress
• Salesforce
• Big Data Batch Processing
• MapReduce/Hadoop
• HaLoop
• iMapReduce
• Twister
• Pig
• Hive
• Dryad/DryadLinq
• Jaql
• HadoopDB
• Spark
• Stratosphere
• SpatialHadoop
• Dremel/BigQuery
• Amazon Redshift
• Apache Mahout
• Hadoop Online
• Twitter Storm
• Pregel
• GraphLab
• Pegasus
• Trinity
• Echo System
• Apache ZooKeeper
• Apache Sqoop
• Apache Flume
• Apache Oozie
• Apache Thrift
• Cascading
• Google Fusion Tables
• InfoSphere BigInsights

Twister

Twister is a MapReduce runtime with an extended programming model that supports iterative MapReduce computations efficiently. It uses a publish/subscribe messaging infrastructure for communication and data transfers, and supports long running MapReduce tasks. In particular, it provides programming extensions to MapReduce with broadcast and scatter type data transfers. The below figure illustrates the runtime architecture of Twister framework.

Microsoft has also developed a project that provides an iterative MapReduce runtime for Windows Azure called Daytona.