Evals

Helicone

Helicone is an open-source observability and monitoring platform for LLM applications. The homepage states "The world's fastest-growing AI companies rely on Helicone to route, debug, and analyze their applications." Beyond observability dashboards (requests, segments, sessions, users), it offers prompt management, datasets, a playground, rate-limit tracking, and alerts. LLM-as-a-judge style evaluation runs against captured request logs.

GitHub

Documentation

📖
Documentation
https://docs.helicone.ai/

SDKs

📦
GitHubRepository
https://github.com/Helicone/helicone

Other Resources

🔗
Pricing
https://www.helicone.ai/pricing

API entry from apis.yml

apis.yml Raw ↑ 
name: Helicone
description: Helicone is an open-source observability and monitoring platform for LLM applications. The
  homepage states "The world's fastest-growing AI companies rely on Helicone to route, debug, and analyze
  their applications." Beyond observability dashboards (requests, segments, sessions, users), it offers
  prompt management, datasets, a playground, rate-limit tracking, and alerts. LLM-as-a-judge style evaluation
  runs against captured request logs.
humanURL: https://www.helicone.ai/
baseURL: https://api.helicone.ai
tags:
- Open Source
- Observability
- Proxy
- Prompt Management
- Y Combinator
properties:
- type: Documentation
  url: https://docs.helicone.ai/
- type: GitHubRepository
  url: https://github.com/Helicone/helicone
- type: Pricing
  url: https://www.helicone.ai/pricing