Measuring AI performance on real-world work

evals.thriveholdings.com

Written by AI

TLDR
Thrive Holdings compares AI models on real tax preparation, measuring accuracy, speed, cost, and token use across practitioner-ready returns.
Best for
Comparing models for individual tax preparation on accuracy, time, and cost.
The tip
Compare reasoning levels, not just model names, because cost and runtime vary by effort.
What you need
  • Parsed client tax documents
  • A practitioner review step
Start here
  1. Open the Individual tax prep benchmark
  2. Compare accuracy, minutes, and cost per return
  3. Choose a model and reasoning level for a pilot
Filed note
Thrive Holdings benchmarks AI models on real work from 75+ businesses, pairing task performance with time and cost instead of treating capability as one score.

articleThe source

Read the full article