kimutanskのブックマーク - はてなブックマーク

Kafka on Kubernetes - using etcd

The content of this page hasn't been updated for years and might refer to discontinued products and projects. At Banzai Cloud we are building a cloud agnostic, open source next generation CloudFoundry/Heroku-like PaaS, Pipeline, while running several big data workloads natively on Kubernetes. Apache Kafka is one of the cloud native workloads we support out-of-the-box, alongside Apache Spark and Ap

kimutansk 2018/04/23

K8s上でKafkaを用いるためにはKafkaをZKでなくetcd上で動作させたいというのはわかりますが、Kafkaの機能的に依存してるので、どこまでできますかね。現状チケットは進んではいないと。

リンク

The anatomy of Spark applications on Kubernetes

The content of this page hasn't been updated for years and might refer to discontinued products and projects. Apache Spark on Kubernetes series: Introduction to Spark on Kubernetes Scaling Spark made simple on Kubernetes The anatomy of Spark applications on Kubernetes Monitoring Apache Spark with Prometheus Spark History Server on Kubernetes Spark scheduling on Kubernetes demystified Spark Streami

kimutansk 2018/03/06

Sparkのk8s上動作環境と。k8sで様々なものが動く前提であれば、そちらに乗せてしまった方が統一できますから、それはそれでいい構成ではあると。

spark
k8s

リンク

Monitoring Apache Spark with Prometheus on Kubernetes

kimutansk 2018/03/06

Spark用のPrometheusExporter（要PushGateway）と。この手の、後付けで起動できるかについてはSparkのメトリクス出力機構側の方も確認しておく必要がありますか。

リンク

Application monitoring with Prometheus and Pipeline

The content of this page hasn't been updated for years and might refer to discontinued products and projects. Monitoring series: Monitoring Apache Spark with Prometheus Monitoring multiple federated clusters with Prometheus - the secure way Application monitoring with Prometheus and Pipeline Building a cloud cost management system on top of Prometheus Monitoring Spark with Prometheus, reloaded At