Crate spin_factor_llm

Source

Modules§

spin

Structs§

AppState
The application state for the LLM factor.
InstanceState
The instance state for the LLM factor.
LlmFactor
The factor for LLMs.
RuntimeConfig
The runtime configuration for the LLM factor.

Constants§

ALLOWED_MODELS_KEY

Traits§

LlmEngine
The interface for a language model engine.
LlmEngineCreator
A creator for an LLM engine.