Interface IRequestCache

Namespace

IntentSharp.Resilience

Assembly

IntentSharp.dll

Caches provider responses by request content so identical requests do not call the model twice.

public interface IRequestCache

Extension Methods

IntentExtensions.RunIntentAsync(object?, IntentRuntime, string, CancellationToken)

IntentExtensions.RunIntentAsync(object?, string, CancellationToken)

IntentExtensions.RunIntentAsync<T>(object?, IntentRuntime, string, CancellationToken)

IntentExtensions.RunIntentAsync<T>(object?, string, CancellationToken)

AIExtensions.AIAsync(object?, IntentClient, string, AIRequestOptions?, CancellationToken)

AIExtensions.AIAsync<T>(object?, IntentClient, string, AIRequestOptions?, CancellationToken)

AIExtensions.AIClassifyAsync<TEnum>(object?, IntentClient, string?, AIRequestOptions?, CancellationToken)

AIExtensions.AIConvertAsync<T>(object?, IntentClient, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIAsync(object?, string, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIAsync<T>(object?, string, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIClassifyAsync<TEnum>(object?, string?, AIRequestOptions?, CancellationToken)

AmbientAIExtensions.AIConvertAsync<T>(object?, AIRequestOptions?, CancellationToken)

Methods

ClearAsync(CancellationToken)

Removes every entry.

GetAsync(string, CancellationToken)

Returns the response stored under key, or null when there is none or it has expired.

GetStats()

Returns the hit, miss and entry counts.

SetAsync(string, AIResponse, TimeSpan, CancellationToken)

Stores response under key for ttl, replacing any entry with the same key.