Posts tagged "outcomes"

There's a ton of focus on reducing token costs or using cheaper models. These are directionally correct but not focused on the right north star. Cost per task, particularly successful tasks that don't get reworked, is the only thing that matters.

Model routing doesn't work if you only measure cost-per-token. It only works if you measure cost-per-task. Uber measured this and provides some great data points.