Infrastructure at Scale: Apache Kafka, Twitter Storm & Elastic Search (ARC303) | AWS re:Invent 2013

"This is a technical architect's case study of how Loggly has employed the latest social-media-scale technologies as the backbone ingestion processing for our multi-tenant, geo-distributed, and real-time log management system. This presentation describes design details of how we built a second-generation system fully leveraging AWS services including Amazon Route 53 DNS with heartbeat and latency-

[bopperjp]

Kafka/Storm/ElasticSearch を使ったスケールするCEP

[kimutansk]

Kafkaを多段パイプラインとしてStormで処理、ElasticSearchを保存先とした高信頼高性能スケーラビリティに優れたログ解析基盤と。これ、すごいですね。