NaturalLanguageSearchPredictionArguments

Prediction arguments for the NATURAL_LANGUAGE_SEARCH problem type

KEY TYPE Description
numCompletionTokens int Default for maximum number of tokens for chat answers.
systemMessage str The generative LLM system message.
searchScoreCutoff float Cutoff for the document retriever score. Matching search results below this score will be ignored.
temperature float The generative LLM temperature.
ignoreDocuments bool If True, will ignore any documents and search results, and only use the messages to generate a response.
llmName str Name of the specific LLM backend to use to power the chat experience.