Back at my old job in ~2016, we built a cheap homegrown data warehouse via Postg... | Hacker News

Back at my old job in ~2016, we built a cheap homegrown data warehouse via Postgres, SQLite and Lambda.Basically, it worked like this: - All of our data lived in compressed SQLite DBs on S3. - Upon receiving a query, Postgres would use a custom foreign data wrapper we built. - This FDW would forward the query to a web service. - This web service would start one lambda per SQLite file. Each lambda

[rgfx]

via:"圧縮したSQLiteのファイルをS3にいれて、Lambdaで検索してPostgresに返してアグリゲートすると安くて速いDWHに∕MapReduceの再発明？" https://mobile.twitter.com/niw/status/1529274344253206528