Documentation
Preparing search index...
@spinframework/spin-llm
InferencingOptions
Interface InferencingOptions
Interface representing options for inferencing. InferencingOptions
interface
InferencingOptions
{
maxTokens
?:
number
;
repeatPenalty
?:
number
;
repeatPenaltyLastNTokenCount
?:
number
;
temperature
?:
number
;
topK
?:
number
;
topP
?:
number
;
}
Index
Properties
max
Tokens?
repeat
Penalty?
repeat
Penalty
Last
N
Token
Count?
temperature?
top
K?
top
P?
Properties
Optional
max
Tokens
maxTokens
?:
number
Optional
repeat
Penalty
repeatPenalty
?:
number
Optional
repeat
Penalty
Last
N
Token
Count
repeatPenaltyLastNTokenCount
?:
number
Optional
temperature
temperature
?:
number
Optional
top
K
topK
?:
number
Optional
top
P
topP
?:
number
Settings
Member Visibility
Protected
Inherited
External
Theme
OS
Light
Dark
On This Page
Properties
max
Tokens
repeat
Penalty
repeat
Penalty
Last
N
Token
Count
temperature
top
K
top
P
Documentation
Loading...
Interface representing options for inferencing. InferencingOptions