New Finance Agent Benchmark Released
openai/o3-2025-04-16 o3

Released Date: 4/16/2025

Avg. Accuracy:

79.2%

Latency:

50.03s

Performance by Benchmark

Benchmarks

Accuracy

Rankings

FinanceAgent

48.3%

( 1 / 24 )

CorpFin

71.0%

( 2 / 39 )

CaseLaw

82.8%

( 19 / 62 )

ContractLaw

66.0%

( 37 / 69 )

TaxEval

79.0%

( 1 / 49 )

MortgageTax

78.4%

( 5 / 29 )

Math500

94.6%

( 2 / 45 )

AIME

85.3%

( 3 / 39 )

MGSM

91.4%

( 15 / 43 )

LegalBench

82.5%

( 3 / 67 )

MedQA

96.1%

( 2 / 47 )

GPQA

83.6%

( 1 / 40 )

MMLU Pro

85.6%

( 2 / 40 )

LiveCodeBench

63.2%

( 2 / 40 )

MMMU

80.1%

( 2 / 26 )

Academic Benchmarks
Proprietary Benchmarks (contact us to get access)

Cost Analysis

Input Cost

$10.00 / M Tokens

Output Cost

$40.00 / M Tokens

Input Cost (per char)

$7.72 / M chars

Output Cost (per char)

N/A

Join our mailing list to receive benchmark updates on

Stay up to date as new benchmarks and models are released.