Skip to main content

Parameters

ParameterTypeDefaultDescription
supports_toolsboolTrueWhether the model supports tools
supports_json_schema_outputboolFalseWhether the model supports JSON schema output
supports_json_object_outputboolFalseWhether the model supports JSON object output
default_structured_output_modeStructuredOutputMode'tool'The default structured output mode to use for the model
prompted_output_templatestr"Always respond with a JSON object that's compatible with this schema:\n\n{schema}\n\nDon't include any text or Markdown fencing before or after.\n"The instructions template to use for prompted structured output. The '' placeholder will be replaced with the JSON schema for the output.
json_schema_transformertype[JsonSchemaTransformer] | NoneNoneThe transformer to use to make JSON schemas for tools and structured output compatible with the model
thinking_tagstuple[str, str]('<think>', '</think>')The tags used to indicate thinking parts in the model’s output. Defaults to ('', '').
ignore_streamed_leading_whitespaceboolFalseWhether to ignore leading whitespace when streaming a response
groq_always_has_web_search_builtin_toolboolFalseWhether the model always has the web search built-in tool available

Functions

groq_model_profile

Get the model profile for a Groq model. Parameters:
  • model_name (str): The name of the Groq model
Returns:
  • ModelProfile: The model profile for the Groq model
Description: This function returns the model profile for a Groq model. It creates a GroqModelProfile instance with specific configurations based on the model name. Models that start with ‘compound-’ are configured to always have the web search built-in tool available.
I