Idempotency is cheaper than reconciliation
Every pipeline eventually runs twice. Designing loads so that a second run is a no-op costs a day up front and saves weeks of arguing about numbers later.
Notes
Occasional writing about the work.
Your warehouse bill is mostly failed experiments
In four recent audits, the largest single line item was scheduled queries nobody had read in over six months. Deleting them is not an optimisation project.
Against the platform purchase
Teams under twenty people rarely need a managed orchestration platform. A scheduler, a warehouse and version control cover the ground for a fraction of the cost.