Module llm

Source

Structs§

EmbeddingsResult
Result of generating embeddings
EmbeddingsUsage
Usage related to an embeddings generation request
InferencingParams
Inference request parameters
InferencingResult
An inferencing result
InferencingUsage
Usage information related to the inferencing result

Enums§

Error
The set of errors which may be raised by functions in this interface

Traits§

GetHost
Host

Functions§

add_to_linker
add_to_linker_get_host

Type Aliases§

EmbeddingModel
The model used for generating embeddings
InferencingModel
A Large Language Model.