Storm

Distributed and fault-tolerant realtime computation

Storm integrates with any queueing system and any database system. Storm's spout abstraction makes it easy to integrate a new queuing system. Example queue integrations include:

  1. Kestrel
  2. RabbitMQ / AMQP
  3. Kafka
  4. JMS

Likewise, integrating Storm with database systems is easy. Simply open a connection to your database and read/write like you normally would. Storm will handle the parallelization, partitioning, and retrying on failures when necessary.