Exactly-once Support in Apache Kafka
On Thursday we released a new version of Apache Kafka that dramatically strengthens the semantic guarantees it provides. This release came at the tail end of several years of thinking through how to do reliable stream processing in a way that is fast, practical, and correct. The implementation effort itself was on the order of about a year, including an extended period in which about a hundred pag
Apache Kafka 0.11 の Exactly Once Semantics
Apache Kafka Meetup Japan #3 https://kafka-apache-jp.connpass.com/event/58619/ LT発表（突発）資料
Questioning the Lambda Architecture
The Lambda Architecture has its merits, but alternatives are worth exploring. Nathan Marz wrote a popular blog post describing an idea he called the Lambda Architecture (“How to beat the CAP theorem“). The Lambda Architecture is an approach to building stream processing applications on top of MapReduce and Storm or similar systems. This has proven to be a surprisingly popular idea, with a dedicate
can't connect to kafka server
I try to use Kafka with version 0.9.0 with port 9092. If I use telnet, I successfully connect to this address, but I fail to connect to Kafka server with Java API Here is my Java example exactly use the official supplied documentation: Properties props = new Properties(); props.put("bootstrap.servers", "192.168.174.128:9092"); props.put("acks", "all"); props.put("retries", 0); props.put("batch.siz
Trifecta by ldaniels528
Trifecta is a Command Line Interface (CLI) tool that enables users to quickly and easily inspect, publish and verify messages (or data) in Kafka, Storm and Zookeeper View project on GitHub Trifecta is a Command Line Interface (CLI) tool that enables users to quickly and easily inspect, verify and even query Kafka messages. In addition, Trifecta offers data import/export functions for transferring
Kinesis vs-kafka-and-kafka-deep-dive
Yifeng JiangSolutions Engineering Lead, North APAC, Hortonworks at Hortonworks
Event sourcing, CQRS, stream processing and Apache Kafka: What’s the connection? | Confluent
Event sourcing as an application architecture pattern is rising in popularity. Event sourcing involves modeling the state changes made by applications as an immutable sequence or “log” of events. Instead of modifying the state of the application in-place, event sourcing involves storing the event that triggers the state change in an immutable log and modeling the state changes as responses to the
Introducing the Kafka Consumer: Getting Started with the New Apache Kafka 0.9 Consumer Client | Confluent
When Apache Kafka® was originally created, it shipped with a Scala producer and consumer client. Over time we came to realize many of the limitations of these APIs. For example, we had a “high-level” consumer API which supported consumer groups and handled failover, but didn’t support many of the more complex usage scenarios. We also had a “simple” consumer client which provided full control, but
How to Build a Scalable ETL Pipeline with Kafka Connect | Confluent
Apache Kafka is a high-throughput distributed message system that is being adopted by hundreds of companies to manage their real-time data. Companies use Kafka for many applications (real time stream processing, data synchronization, messaging, and more), but one of the most popular applications is ETL pipelines. Kafka is a perfect tool for building data pipelines: it’s reliable, scalable, and eff
More data, more data
"multas per gentes et multa per aequora" [1] The life of a request to CloudFlare begins and ends at the edge. But the afterlife! Like Catullus to Bithynia, the log generated by an HTTP request or a DNS query has much, much further to go. This post comes from CloudFlare's Data Team. It reports the state of processing these sort of edge logs, including what's worked well for us and what remains a ch
リリース、障害情報などのサービスのお知らせ
最新の人気エントリーの配信
j次のブックマーク
k前のブックマーク
lあとで読む
eコメント一覧を開く
oページを開く
GitHub - uber/uReplicator: Improvement of Apache Kafka Mirrormaker
GitHub - IBM/sarama: Sarama is a Go library for Apache Kafka.
Exactly-once, once more
Exactly-once or not, atomic broadcast is still impossible in Kafka - or anywhere - Paper Trail
Reactive Kafka
I Can't Believe It's Not a Queue: Using Kafka with Spring
ETL Is Dead, Long Live Streams
[Kafka-users] Is AWS Kinesis Kafka? - Grokbase
Spark in Action Book Review & Interview
Netflix Keystone - How We Built a 700B/day Stream Processing Cloud Platform in a Year