GcraRateLimiter

Struct GcraRateLimiter 

Source
pub struct GcraRateLimiter { /* private fields */ }
Expand description

Sharded GCRA limiter over one or more stacked windows (DW-017).

Implements the RateLimiter trait: check(key, cost) reserves cost units in every stacked window for key (see the module docs for the stop-at-first-denial consumption semantics). Keys are opaque strings; the caller composes them (see RateLimitEngine).

Clocks: the GCRA math runs on governor’s own quanta monotonic clock; there is deliberately no clock injection for it. The EVICTION bookkeeping (per-key last-touch stamps) has a separate, injectable millisecond clock: new uses elapsed monotonic time, tests use GcraRateLimiter::with_clock to advance deterministically. The two clocks only meet in the idle-eviction threshold (one full refill of the window’s bucket), where both advance with wall time.

Implementations§

Source§

impl GcraRateLimiter

Source

pub fn new(specs: Vec<GcraWindowSpec>) -> Option<Self>

New limiter over the given window specs (any order; internally sorted shortest window first). Returns None for an empty spec list — a limiter with no windows cannot make decisions.

Source

pub fn with_clock( specs: Vec<GcraWindowSpec>, now_ms: fn() -> u64, ) -> Option<Self>

New limiter using a caller-supplied millisecond clock for the per-key eviction bookkeeping (NOT the GCRA decisions — see the clocks note in the type docs).

Intended for tests and other time-controlled setups; production code should prefer GcraRateLimiter::new. now_ms must return non-decreasing milliseconds and is called once per window per check (cheap).

Source

pub fn live_keys(&self) -> usize

Live per-key cell count across all stacked windows (sum of the shard maps; approximate under concurrent checks). Bounded by GCRA_STORE_SHARDS * crate::config::limits::MAX_RATE_LIMITER_KEYS_PER_SHARD per window — the bound the spray tests assert.

Source

pub fn evictions(&self) -> u64

Cells dropped by eviction sweeps across all stacked windows (monotonic for the limiter’s lifetime; a reload builds a fresh limiter, so the counter resets with the generation).

Source

pub fn check(&self, key: &str, cost: u32) -> GcraOutcome

Check-and-reserve cost units for key across all stacked windows (see module docs). cost 0 is treated as 1 (a request always costs at least one unit); a cost larger than any window’s bucket is always denied.

Trait Implementations§

Source§

impl Debug for GcraRateLimiter

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl RateLimiter for GcraRateLimiter

Source§

fn check<'life0, 'life1, 'async_trait>( &'life0 self, key: &'life1 str, cost: u32, ) -> Pin<Box<dyn Future<Output = Result<RateDecision, ExtensionsError>> + Send + 'async_trait>>
where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Atomically decide-and-reserve cost units for key.

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
§

impl<T> AnyExt for T
where T: Any + ?Sized,

§

fn downcast_ref<T>(this: &Self) -> Option<&T>
where T: Any,

Attempts to downcast this to T behind reference
§

fn downcast_mut<T>(this: &mut Self) -> Option<&mut T>
where T: Any,

Attempts to downcast this to T behind mutable reference
§

fn downcast_rc<T>(this: Rc<Self>) -> Result<Rc<T>, Rc<Self>>
where T: Any,

Attempts to downcast this to T behind Rc pointer
§

fn downcast_arc<T>(this: Arc<Self>) -> Result<Arc<T>, Arc<Self>>
where T: Any,

Attempts to downcast this to T behind Arc pointer
§

fn downcast_box<T>(this: Box<Self>) -> Result<Box<T>, Box<Self>>
where T: Any,

Attempts to downcast this to T behind Box pointer
§

fn downcast_move<T>(this: Self) -> Option<T>
where T: Any, Self: Sized,

Attempts to downcast owned Self to T, useful only in generic context as a workaround for specialization
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
§

impl<T, X> CoerceTo<T> for X
where T: CoerceFrom<X> + ?Sized,

§

fn coerce_rc_to(self: Rc<X>) -> Rc<T>

§

fn coerce_box_to(self: Box<X>) -> Box<T>

§

fn coerce_ref_to(&self) -> &T

§

fn coerce_mut_to(&mut self) -> &mut T

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

§

impl<T> Instrument for T

§

fn instrument(self, span: Span) -> Instrumented<Self>

Instruments this type with the provided [Span], returning an Instrumented wrapper. Read more
§

fn in_current_span(self) -> Instrumented<Self>

Instruments this type with the current Span, returning an Instrumented wrapper. Read more
Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> IntoEither for T

Source§

fn into_either(self, into_left: bool) -> Either<Self, Self>

Converts self into a Left variant of Either<Self, Self> if into_left is true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
Source§

fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
where F: FnOnce(&Self) -> bool,

Converts self into a Left variant of Either<Self, Self> if into_left(&self) returns true. Converts self into a Right variant of Either<Self, Self> otherwise. Read more
§

impl<T> Pointable for T

§

const ALIGN: usize

The alignment of pointer.
§

type Init = T

The type for initializers.
§

unsafe fn init(init: <T as Pointable>::Init) -> usize

Initializes a with the given initializer. Read more
§

unsafe fn deref<'a>(ptr: usize) -> &'a T

Dereferences the given pointer. Read more
§

unsafe fn deref_mut<'a>(ptr: usize) -> &'a mut T

Mutably dereferences the given pointer. Read more
§

unsafe fn drop(ptr: usize)

Drops the object pointed to by the given pointer. Read more
Source§

impl<T> Same for T

Source§

type Output = T

Should always be Self
§

impl<T> ServiceExt for T

§

fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>
where Self: Sized,

Apply a transformation to the response body. Read more
§

fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>
where Self: Sized,

High level tracing that classifies responses using HTTP status codes. Read more
§

fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>
where Self: Sized,

High level tracing that classifies responses using gRPC headers. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.
§

impl<V, T> VZip<V> for T
where V: MultiLane<T>,

§

fn vzip(self) -> V

§

impl<T> WithSubscriber for T

§

fn with_subscriber<S>(self, subscriber: S) -> WithDispatch<Self>
where S: Into<Dispatch>,

Attaches the provided Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

fn with_current_subscriber(self) -> WithDispatch<Self>

Attaches the current default Subscriber to this type, returning a [WithDispatch] wrapper. Read more
§

impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
where ST: ?Sized, DT: ?Sized,

§

impl<T> Read<Exclusive, BecauseExclusive> for T
where T: ?Sized,