Module llm

Module llm 

Source

Structs§

EmbeddingsResult
Result of generating embeddings
EmbeddingsUsage
Usage related to an embeddings generation request
InferencingParams
Inference request parameters
InferencingResult
An inferencing result
InferencingUsage
Usage information related to the inferencing result

Enums§

Error
The set of errors which may be raised by functions in this interface

Traits§

Host
HostWithStore

Functions§

add_to_linker

Type Aliases§

EmbeddingModel
The model used for generating embeddings
InferencingModel
A Large Language Model.