Providers
Install only what you need:
| Provider | Package | Models |
|---|---|---|
| OpenAI | pytest-llmtest[openai] | GPT-5.x, GPT-4.1, o3, o4-mini |
| Anthropic | pytest-llmtest[anthropic] | Claude Opus 4.6, Sonnet 4.6, Haiku 4.5 |
| Ollama | pytest-llmtest[ollama] | Any model running locally |
Provider selection
@llm_test(
expect.is_not_empty(),
provider="openai",
model="gpt-5-mini",
)
def test_openai(llm): ...Default provider
If no provider is specified, llmtest checks for available API keys:
OPENAI_API_KEY→ OpenAIANTHROPIC_API_KEY→ Anthropic- Ollama (localhost) → Ollama
Last updated on