Performance Summary
45%
Fewer LLM Calls
46%
Fewer Tokens
41%
Cost Reduction
51%
Faster Execution
Total Cost Comparison
With MCP
$0.55
Without MCP
$0.92
With MCP
Without MCP
Detailed Metrics
LLM Calls per Scenario
Tokens per Scenario
Cost per Scenario ($)
Execution Time (seconds)
Scenario Breakdown
| Scenario | LLM Calls | Tokens | Cost | Savings | |||
|---|---|---|---|---|---|---|---|
| With | Without | With | Without | With | Without | ||
|
Find Callers
Find all functions that call a specific function
|
5.0 | 7.0 | 1 183 | 1 276 | $0.0662 | $0.0726 | +9% |
|
Find Implementations
Find all classes that implement a specific interface
|
3.0 | 9.7 | 402 | 1 509 | $0.0434 | $0.0695 | +38% |
|
Impact Analysis
Analyze the impact of modifying a class or function
|
12.3 | 23.3 | 2 606 | 5 408 | $0.1873 | $0.3373 | +44% |
|
Dependency Analysis
Analyze all dependencies of a class (incoming and outgoing)
|
9.7 | 28.7 | 2 095 | 4 244 | $0.1139 | $0.1929 | +41% |
|
Call Chain
Trace the call chain between two functions
|
11.7 | 7.7 | 1 737 | 2 534 | $0.1355 | $0.2521 | +46% |
Scenario Breakdown
LLM Calls
5.0
vs
7.0
Tokens
1 183
vs
1 276
Cost
$0.07
vs
$0.07
Time
26s
vs
27s
LLM Calls
3.0
vs
9.7
Tokens
402
vs
1 509
Cost
$0.04
vs
$0.07
Time
16s
vs
26s
LLM Calls
12.3
vs
23.3
Tokens
2 606
vs
5 408
Cost
$0.19
vs
$0.34
Time
58s
vs
149s
LLM Calls
9.7
vs
28.7
Tokens
2 095
vs
4 244
Cost
$0.11
vs
$0.19
Time
47s
vs
82s
LLM Calls
11.7
vs
7.7
Tokens
1 737
vs
2 534
Cost
$0.14
vs
$0.25
Time
44s
vs
105s
Test Configuration
Target
Quarkus/Kotlin Backend
Runs with MCP
3 iterations
Runs without MCP
3 iterations