In Praise of Digag, an Alternative to Airflow

At Culture Amp, we’ve been customers of Treasure Data for about a year. We’ve been able to get some great momentum around product analytics with their stack of tools, which includes solutions for data ingestion, data querying, workflow management, and data export. Treasure Data are very good open-source citizens, and many of the tools that power their stack are open-sourced. Their most popular is

[kent-where-the-light-is]

“Airflow’s included operators are buggy and immature. We ended having two data engineers sending pull requests to Airflow to fix a couple of bugs. While having Airflow contributors is something we are proud of, it reduced our confidence in the codebase.”

[el7]

「昔airflowを使っていたけどdigdagに移行した。airflowはoperatorがいっぱいあるけど、バグがあるし、digdagから専用のソフトウェア(ex. spark)を呼んだほうが楽だった」