Oct 19, 2023Liked by timo dechau ๐Ÿ•น๐Ÿ› 

I've also been thinking about orchestrators but I've come to a different conclusion. In my mind the current metadata is so underutilized that once it starts being utilized the orchestration layer becomes much more automated and maybe at some point entirely "disappear" and either get absorbed into the data warehouse layer or the BI layer. You don't need a lot of people writing dbt or creating various metric definitions when those can be derived by looking at the queries that are already running on the data warehouse.

Expand full comment