Chat with Large Language Models
Submit multiple chats in one batch
Chat with an Anthropic Claude model
Chat with an AWS bedrock model
Chat with a model hosted on Azure OpenAI
Chat with a model hosted on CloudFlare
Create a chatbot that speaks to the Snowflake Cortex Analyst
Chat with a model hosted on Databricks
Chat with a model hosted on DeepSeek
Chat with a model hosted on the GitHub model marketplace
Chat with a Google Gemini or Vertex AI model
Chat with a model hosted on Groq
Chat with a model hosted on Hugging Face Serverless Inference API
Chat with a model hosted on Mistral's La Platforme
Chat with a local Ollama model
Chat with an OpenAI model
Chat with one of the many models hosted on OpenRouter
Chat with a model hosted on perplexity.ai
Chat with a model hosted on PortkeyAI
Chat with a model hosted on Snowflake
Chat with a model hosted by vLLM
Chat with any provider
The Chat object
Encode images for chat input
Encode PDFs content for chat input
Content types received from and sent to a chatbot
Record and replay content
Format contents into a textual representation
Create metadata for a tool
Deprecated functions
ellmer: Chat with Large Language Models
Upload a file to gemini
Are credentials avaiable?
Helpers for interpolating data into prompts
Open a live chat application
Submit multiple chats in parallel
Standard model parameters
A chatbot provider
Report on token usage in the current session
Tool annotations
Reject a tool call
Define a tool
A user or assistant turn
Type specifications
Type definitions for function calling and structured data extraction.
Chat with large language models from a range of providers including 'Claude' <https://claude.ai>, 'OpenAI' <https://chatgpt.com>, and more. Supports streaming, asynchronous calls, tool calling, and structured data extraction.
Useful links