Promptfoo

Promptfoo CLI

The Promptfoo CLI is the primary entry point for running prompt and model evaluations from the command line or CI. It is installable via npm, Homebrew, pip, or npx and reads a YAML configuration to fan out evaluations across providers including OpenAI, Anthropic, Azure, Bedrock, Google, and local Ollama models. Outputs include a local web viewer, JSON reports, and CI-friendly exit codes.

Promptfoo CLI is one of 6 APIs that Promptfoo publishes on the APIs.io network.

Tagged areas include CLI, LLM Evaluation, Open Source, and Testing. The published artifact set on APIs.io includes a getting-started guide and API documentation.

GitHub

Documentation

📖
GettingStarted
https://www.promptfoo.dev/docs/getting-started/
📖
Documentation
https://www.promptfoo.dev/docs/usage/command-line/

Other Resources

🔗
SourceCode
https://github.com/promptfoo/promptfoo

API entry from apis.yml

apis.yml Raw ↑ 
aid: promptfoo:promptfoo-cli
name: Promptfoo CLI
tags:
- CLI
- LLM Evaluation
- Open Source
- Testing
humanURL: https://www.promptfoo.dev/docs/getting-started/
properties:
- url: https://www.promptfoo.dev/docs/getting-started/
  type: GettingStarted
- url: https://www.promptfoo.dev/docs/usage/command-line/
  type: Documentation
- url: https://github.com/promptfoo/promptfoo
  type: SourceCode
description: The Promptfoo CLI is the primary entry point for running prompt and model evaluations from
  the command line or CI. It is installable via npm, Homebrew, pip, or npx and reads a YAML configuration
  to fan out evaluations across providers including OpenAI, Anthropic, Azure, Bedrock, Google, and local
  Ollama models. Outputs include a local web viewer, JSON reports, and CI-friendly exit codes.