Abstract
Optional
fields: ChatGoogleBaseInput<AuthOptions>Maximum number of tokens to generate in the completion.
Prefer modelName
This feature is deprecated and will be removed in the future.
It is not recommended for use.
Model to use
Sampling temperature to use
Top-k changes how the model selects tokens for output.
A top-k of 1 means the selected token is the most probable among all tokens in the model’s vocabulary (also called greedy decoding), while a top-k of 3 means that the next token is selected from among the 3 most probable tokens (using temperature).
Top-p changes how the model selects tokens for output.
Tokens are selected from most probable to least until the sum of their probabilities equals the top-p value.
For example, if tokens A, B, and C have a probability of .3, .2, and .1 and the top-p value is .5, then the model will select either A or B as the next token (using temperature).
Protected
connectionProtected
streamedAbstract
buildOptional
fields: GoogleAIBaseLLMInput<AuthOptions>Optional
fields: GoogleAIBaseLLMInput<AuthOptions>Optional
fields: GoogleAIBaseLLMInput<AuthOptions>Generated using TypeDoc
Integration with a chat model.