AgentOptimizationJobLatency interface
Average latency for one optimization stage and model.
Properties
| avg_latency_ms | Average per-call latency, rounded to milliseconds. |
| call_count | Total number of calls contributing to this entry. |
| model | Model name or deployment name measured by this entry. |
| stage | Optimization stage measured by this entry. |
Property Details
avg_latency_ms
Average per-call latency, rounded to milliseconds.
avg_latency_ms: number
Property Value
number
call_count
Total number of calls contributing to this entry.
call_count: number
Property Value
number
model
Model name or deployment name measured by this entry.
model?: string
Property Value
string
stage
Optimization stage measured by this entry.
stage: AgentOptimizationStage