Enum CompiledRoutingPolicy 

pub enum CompiledRoutingPolicy {
    FallbackChain {
        name: String,
        cheap: Box<RouteTarget>,
        escalate_to: Box<RouteTarget>,
        classifier_url: String,
        classifier_model: String,
        threshold: f64,
        timeout_ms: u64,
        api_key: Option<String>,
    },
    LatencyCost {
        name: String,
        candidates: Vec<RouteTarget>,
        candidate_models: Vec<String>,
        candidate_costs: Vec<u32>,
        candidate_latencies: Vec<u32>,
        preference: AiLatencyPreference,
        live_tracker: Option<Arc<LiveLatencyTracker>>,
    },
}

A compiled routing policy (DW-085). Built at AiRuntime compile time from the config block; immutable once built. The evaluate method returns the candidate list to walk (the same shape as AiRuntime::route) plus a PolicyDecision the dataplane records as a metric.

Variants

FallbackChain

Cheap-first with complexity-signal escalation. The evaluate call POSTs the prompt to the external classifier service and picks the cheap or escalate-to target by the returned score.

Fields

name: String

The routing-policy name (for metrics attribution).

cheap: Box<RouteTarget>

The primary target of the cheap alias.

escalate_to: Box<RouteTarget>

The primary target of the escalate_to alias.

classifier_url: String

The classifier service URL.

classifier_model: String

The model name passed to the classifier service.

threshold: f64

The complexity score threshold (>= escalates).

timeout_ms: u64

The classifier HTTP timeout in milliseconds.

api_key: Option<String>

Optional resolved API key for the classifier service.

LatencyCost

Latency-vs-cost static selection. Candidates are pre-sorted at compile time by the configured preference; evaluate returns the best one (no I/O).

Fields

name: String

The routing-policy name (for metrics attribution).

candidates: Vec<RouteTarget>

Candidates sorted best-first by the preference (the first is the pick).

candidate_models: Vec<String>

AI-15 (#203): the model alias for each candidate (for live latency tracking). Parallel to candidates.

candidate_costs: Vec<u32>

AI-15 (#203): the static cost scores for each candidate.

candidate_latencies: Vec<u32>

AI-15 (#203): the static latency scores for each candidate.

preference: AiLatencyPreference

AI-15 (#203): the selection preference.

live_tracker: Option<Arc<LiveLatencyTracker>>

AI-15 (#203): live latency tracker. None when live is false (static selection).

Implementations

impl CompiledRoutingPolicy

pub fn compile( name: &str, policy: &AiRoutingPolicy, models: &BTreeMap<String, CompiledModel>, ) -> Option<Self>

Compile from config. Resolves each named alias to its primary RouteTarget against the first-pass compiled model map (plain chain/canary aliases only — a policy alias cannot reference another policy alias, so nested policies are rejected by returning None). Returns None when a referenced alias is missing or is itself a policy alias (a validate-vs-build race or an authoring error validation missed).

pub async fn evaluate( &self, prompt_text: &str, ) -> (Vec<RouteTarget>, PolicyDecision)

Evaluate the policy for one request. Returns the candidate list to walk (the same shape as AiRuntime::route) plus a PolicyDecision the dataplane records as a metric. For FallbackChain, this calls the external classifier service (async). For LatencyCost, the candidates are pre-sorted at compile time, so this is effectively synchronous.

pub fn name(&self) -> &str

The routing-policy name (for metrics attribution).

pub fn live_tracker(&self) -> Option<&Arc<LiveLatencyTracker>>

AI-15 (#203): Get the live latency tracker for this policy. Returns None when live tracking is not enabled.

Trait Implementations

impl Clone for CompiledRoutingPolicy

fn clone(&self) -> CompiledRoutingPolicy

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CompiledRoutingPolicy

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.