Class TokenBucketRateLimiter

Namespace

IntentSharp.Resilience

Assembly

IntentSharp.dll

Token-bucket limiter: steady refill rate with burst capacity, one bucket per provider.

public sealed class TokenBucketRateLimiter : IRateLimiter

Inheritance

object

TokenBucketRateLimiter

Implements

IRateLimiter

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

IntentExtensions.RunIntentAsync(object?, IntentRuntime, string, CancellationToken)

IntentExtensions.RunIntentAsync(object?, string, CancellationToken)

IntentExtensions.RunIntentAsync<T>(object?, IntentRuntime, string, CancellationToken)

IntentExtensions.RunIntentAsync<T>(object?, string, CancellationToken)

AIExtensions.AIAsync(object?, IntentClient, string, AIRequestOptions?, CancellationToken)

AIExtensions.AIAsync<T>(object?, IntentClient, string, AIRequestOptions?, CancellationToken)

AIExtensions.AIClassifyAsync<TEnum>(object?, IntentClient, string?, AIRequestOptions?, CancellationToken)

AIExtensions.AIConvertAsync<T>(object?, IntentClient, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIAsync(object?, string, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIAsync<T>(object?, string, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIClassifyAsync<TEnum>(object?, string?, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIConvertAsync<T>(object?, AIRequestOptions?, CancellationToken)

Constructors

TokenBucketRateLimiter(double, int)

Creates a limiter. Each provider's bucket starts full, so the first burst requests never wait.

Methods

AcquireAsync(string, TimeSpan, CancellationToken)

Waits until a request to the provider is permitted, or throws AIRateLimitException when the wait would exceed maxWait.

GetSnapshot(string)

Returns the provider's bucket after refilling it to now. A provider not seen before reports a full bucket.