Class MemoryRequestCache

Namespace

IntentSharp.Resilience

Assembly

IntentSharp.dll

In-process cache with TTL and least-recently-used eviction.

public sealed class MemoryRequestCache : IRequestCache

Inheritance

object

MemoryRequestCache

Implements

IRequestCache

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

IntentExtensions.RunIntentAsync(object?, IntentRuntime, string, CancellationToken)

IntentExtensions.RunIntentAsync(object?, string, CancellationToken)

IntentExtensions.RunIntentAsync<T>(object?, IntentRuntime, string, CancellationToken)

IntentExtensions.RunIntentAsync<T>(object?, string, CancellationToken)

AIExtensions.AIAsync(object?, IntentClient, string, AIRequestOptions?, CancellationToken)

AIExtensions.AIAsync<T>(object?, IntentClient, string, AIRequestOptions?, CancellationToken)

AIExtensions.AIClassifyAsync<TEnum>(object?, IntentClient, string?, AIRequestOptions?, CancellationToken)

AIExtensions.AIConvertAsync<T>(object?, IntentClient, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIAsync(object?, string, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIAsync<T>(object?, string, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIClassifyAsync<TEnum>(object?, string?, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIConvertAsync<T>(object?, AIRequestOptions?, CancellationToken)

Constructors

MemoryRequestCache(int)

Creates an empty cache that holds at most capacity entries. Storing a new key in a full cache removes the least recently used entry.

Methods

ClearAsync(CancellationToken)

Removes every entry and resets the hit and miss counts to zero.

GetAsync(string, CancellationToken)

Returns the response stored under key, or null when there is none or it has expired; an expired entry is removed.

GetStats()

Returns the hit, miss and entry counts.

SetAsync(string, AIResponse, TimeSpan, CancellationToken)

Stores response under key for ttl, replacing any entry with the same key.