Package-level declarations

Types

Link copied to clipboard
abstract class AbstractBuildingStep<P : Any, R : AbstractResponseSpecification<P, *>>(mokksy: MokksyServer, buildingStep: BuildingStep<P>)

Defines a building step for constructing a mock response based on specific request scenarios within a mock server for large language model interactions.

Link copied to clipboard
abstract class AbstractInferenceRequestSpecification<P>(var temperature: Double? = null, var maxTokens: Long? = null, var topK: Long? = null, var topP: Double? = null, model: String? = null, requestBody: MutableList<Matcher<P?>> = mutableListOf(), requestBodyString: MutableList<Matcher<String?>> = mutableListOf()) : ModelRequestSpecification<P>

Abstract class for defining specifications for inference requests. Provides functionality for configuring parameters and specifying conditions related to system and user messages within the request.

Link copied to clipboard
abstract class AbstractMockLlm(port: Int = 0, configuration: ServerConfiguration, applicationConfigurer: Application.() -> Unit? = {})

Abstract class representing a mock Language Model (LLM) server. This serves as a base class for creating a mock server used for testing Language Model interactions. It is built upon the MokksyServer framework for configuring and managing mock servers.

Link copied to clipboard
Link copied to clipboard
abstract class AbstractStreamingBuildingStep<P : Any, R : AbstractResponseSpecification<P, *>>(mokksy: MokksyServer, buildingStep: BuildingStep<P>) : AbstractBuildingStep<P, R>
Link copied to clipboard
abstract class AbstractStreamingResponseSpecification<P : Any, T : Any, R : Any>(var responseFlow: Flow<T>?, var responseChunks: List<T>?, var delayBetweenChunks: Duration = Duration.ZERO, delay: Duration = Duration.ZERO) : AbstractResponseSpecification<P, R> , StreamingResponseSpecification<T>
Link copied to clipboard

Utility functions for working with embeddings.

Link copied to clipboard
abstract class ModelRequestSpecification<P>(var model: String? = null, val requestBody: MutableList<Matcher<P?>> = mutableListOf(), val requestBodyString: MutableList<Matcher<String?>> = mutableListOf())

Represents a specification model for processing and asserting certain conditions on a request body.

Link copied to clipboard
Link copied to clipboard

Functions

Link copied to clipboard