RoutingConfiguration Class

  • java.lang.Object
    • com.azure.ai.agents.models.RoutingConfiguration

Implements

public final class RoutingConfiguration
implements JsonSerializable<RoutingConfiguration>

Per-request configuration for Model Router inference calls. Supported on Model Router endpoints (deployed or instant if supported). Returns a 400 (Bad Request) error when the target is not a Model Router endpoint.

Constructor Summary

Constructor Description
RoutingConfiguration()

Creates an instance of RoutingConfiguration class.

Method Summary

Modifier and Type Method and Description
static RoutingConfiguration fromJson(JsonReader jsonReader)

Reads an instance of RoutingConfiguration from the JsonReader.

SessionAffinityConfiguration getSessionAffinity()

Get the sessionAffinity property: Session affinity configuration for reusing an eligible model across requests in the same conversation.

RoutingConfiguration setSessionAffinity(SessionAffinityConfiguration sessionAffinity)

Set the sessionAffinity property: Session affinity configuration for reusing an eligible model across requests in the same conversation.

JsonWriter toJson(JsonWriter jsonWriter)

Methods inherited from java.lang.Object

Constructor Details

RoutingConfiguration

public RoutingConfiguration()

Creates an instance of RoutingConfiguration class.

Method Details

fromJson

public static RoutingConfiguration fromJson(JsonReader jsonReader)

Reads an instance of RoutingConfiguration from the JsonReader.

Parameters:

jsonReader - The JsonReader being read.

Returns:

An instance of RoutingConfiguration if the JsonReader was pointing to an instance of it, or null if it was pointing to JSON null.

Throws:

IOException

- If an error occurs while reading the RoutingConfiguration.

getSessionAffinity

public SessionAffinityConfiguration getSessionAffinity()

Get the sessionAffinity property: Session affinity configuration for reusing an eligible model across requests in the same conversation. If omitted, sticky affinity is used when a supported conversation identifier is available.

Returns:

the sessionAffinity value.

setSessionAffinity

public RoutingConfiguration setSessionAffinity(SessionAffinityConfiguration sessionAffinity)

Set the sessionAffinity property: Session affinity configuration for reusing an eligible model across requests in the same conversation. If omitted, sticky affinity is used when a supported conversation identifier is available.

Parameters:

sessionAffinity - the sessionAffinity value to set.

Returns:

the RoutingConfiguration object itself.

toJson

public JsonWriter toJson(JsonWriter jsonWriter)

Parameters:

jsonWriter

Throws:

Applies to