InferenceProviderTargetConfiguration

The configuration for a provider-based inference target. This configuration explicitly defines the endpoint, model mapping, and operations used to route requests to a large language model (LLM) provider.

Types

Link copied to clipboard
class Builder
Link copied to clipboard
object Companion

Properties

Link copied to clipboard

The HTTPS endpoint of the inference provider that the gateway forwards requests to.

Link copied to clipboard

The configuration that translates client-facing model IDs to the model IDs expected by the provider.

Link copied to clipboard

A list of per-operation configurations that map request paths to the models supported for each operation.

Functions

Link copied to clipboard
Link copied to clipboard
open operator override fun equals(other: Any?): Boolean
Link copied to clipboard
open override fun hashCode(): Int
Link copied to clipboard
open override fun toString(): String