ai-mocks-core/dev.mokksy.aimocks.core/AbstractInferenceRequestSpecification

AbstractInferenceRequestSpecification

abstract class AbstractInferenceRequestSpecification(var temperature: Double? = null, var maxTokens: Long? = null, var topK: Long? = null, var topP: Double? = null, model: String? = null, requestBody: MutableList<Matcher<P?>> = mutableListOf(), requestBodyString: MutableList<Matcher<String?>> = mutableListOf()) : ModelRequestSpecification (source)

Abstract class for defining specifications for inference requests. Provides functionality for configuring parameters and specifying conditions related to system and user messages within the request.

Parameters

model

Optional model identifier.

requestBody

A mutable list of matchers representing conditions on the request body.

requestBodyString

A mutable list of matchers representing conditions on the request body string.

Type Parameters

The type of the request body.

Constructors

AbstractInferenceRequestSpecification

constructor(temperature: Double? = null, maxTokens: Long? = null, topK: Long? = null, topP: Double? = null, model: String? = null, requestBody: MutableList<Matcher<P?>> = mutableListOf(), requestBodyString: MutableList<Matcher<String?>> = mutableListOf())

Properties

maxTokens

var maxTokens: Long?

Optional maximum number of tokens to generate in the response.

model

var model: String?

requestBody

val requestBody: MutableList<Matcher<P?>>

requestBodyString

val requestBodyString: MutableList<Matcher<String?>>

temperature

var temperature: Double?

Optional temperature parameter to control randomness in the inference process.

topK

var topK: Long?

Optional top-k sampling parameter specifying how many top tokens to consider during sampling.

topP

var topP: Double?

Optional top-p (nucleus) sampling parameter to control the probability mass of tokens to consider.

Functions

maxTokens

fun maxTokens(value: Long): AbstractInferenceRequestSpecification

fun maxTokens(value: Number): AbstractInferenceRequestSpecification

model

fun model(model: String): ModelRequestSpecification

requestBodyContains

fun requestBodyContains(substring: String): ModelRequestSpecification

Adds a matcher to require that the request body string contains the specified substring.

requestBodyContainsIgnoringCase

fun requestBodyContainsIgnoringCase(substring: String): ModelRequestSpecification

Adds a condition to ensure the request body contains the specified substring, ignoring case sensitivity.

requestBodyDoesNotContains

fun requestBodyDoesNotContains(substring: String): ModelRequestSpecification

Adds a condition to ensure the request body does not contain the specified substring.

requestBodyDoesNotContainsIgnoringCase

fun requestBodyDoesNotContainsIgnoringCase(substring: String): ModelRequestSpecification

Adds a condition to ensure the request body does not contain the specified substring, ignoring case sensitivity.

requestBodyEquals

fun requestBodyEquals(requestObject: P): ModelRequestSpecification

Adds a matcher to require the request body object to be exactly equal to the specified object.

fun requestBodyEquals(payload: String): ModelRequestSpecification

Adds a matcher to require the request body string to be exactly equal to the specified value.

requestBodyEqualsJson

fun requestBodyEqualsJson(payload: String): ModelRequestSpecification

Adds a matcher that requires the request body string to exactly match the specified JSON payload.

requestMatches

fun requestMatches(matcher: Matcher<P?>)

Adds a condition to verify that the request matches the specified matcher.

requestMatchesPredicate

fun requestMatchesPredicate(predicate: (P) -> Boolean)

Adds a condition to verify that the request matches the specified predicate.

requestSatisfies

fun requestSatisfies(description: String? = null, call: (P?) -> Unit)

Adds a condition to verify that the request satisfies the specified call.

systemMessageContains

inline fun systemMessageContains(builderAction: StringBuilder.() -> Unit)

Specifies that the system/developer message must contain a dynamically constructed string. The string can be built using a lambda with a StringBuilder receiver.

abstract fun systemMessageContains(substring: String)

Specifies that the system/developer message must contain the provided string.

temperature

fun temperature(temperature: Double): AbstractInferenceRequestSpecification

topK

fun topK(value: Long): AbstractInferenceRequestSpecification

fun topK(value: Number): AbstractInferenceRequestSpecification

topP

fun topP(value: Double): AbstractInferenceRequestSpecification

fun topP(value: Number): AbstractInferenceRequestSpecification

userMessageContains

inline fun userMessageContains(builderAction: StringBuilder.() -> Unit)

Specifies a condition that the user's message must contain a dynamically constructed string. The string can be built using a lambda with a StringBuilder receiver.

abstract fun userMessageContains(substring: String)

Specifies that the user's message must contain the provided substring.