Documentation
Preparing search index...
@spinframework/spin-llm
InferenceUsage
Interface InferenceUsage
Interface representing usage statistics for inferencing. InferenceUsage
interface
InferenceUsage
{
generatedTokenCount
:
number
;
promptTokenCount
:
number
;
}
Index
Properties
generated
Token
Count
prompt
Token
Count
Properties
generated
Token
Count
generatedTokenCount
:
number
prompt
Token
Count
promptTokenCount
:
number
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Properties
generated
Token
Count
prompt
Token
Count
Documentation
Loading...
Interface representing usage statistics for inferencing. InferenceUsage