Great summary.
It is interesting to see the data dependency driven coordination on top of Airflow/Prefect.
https://eric-sun.medium.com/data-dependency-driven-orchestration-d1bd8e1d695f
Advocate best practice of big data technologies. Challenge the conventional wisdom. Peel off the flashy promise in architecture and scalability.
