OpenLLMetry LLM Provider Instrumentations

Drop-in OpenTelemetry instrumentations for the major LLM providers including OpenAI, Anthropic, AWS Bedrock, Google Generative AI / Vertex AI, Cohere, Mistral AI, Ollama, Groq, Together AI, Replicate, SageMaker, Watsonx, Aleph Alpha, HuggingFace Transformers, Voyage AI, and Writer. Each package monkey-patches the provider SDK to emit standardized gen_ai.* spans without code changes.

OpenLLMetry LLM Provider Instrumentations is one of 6 APIs that OpenLLMetry publishes on the APIs.io network.

Tagged areas include Instrumentation, LLM Providers, and Tracing. The published artifact set on APIs.io includes API documentation, a GitHub repository, and SDKs.

Documentation

SDKs

API entry from apis.yml

apis.yml Raw ↑
aid: openllmetry:openllmetry-llm-instrumentations
name: OpenLLMetry LLM Provider Instrumentations
tags:
- Instrumentation
- LLM Providers
- Tracing
image: https://kinlane-productions.s3.amazonaws.com/apis-json/apis-json-logo.jpg
humanURL: https://www.traceloop.com/docs/openllmetry/integrations/exporters
properties:
- url: https://www.traceloop.com/docs/openllmetry/integrations/exporters
  type: Documentation
- url: https://github.com/traceloop/openllmetry/tree/main/packages
  type: GitHubRepository
- url: https://pypi.org/project/opentelemetry-instrumentation-openai/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-anthropic/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-bedrock/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-google-generativeai/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-cohere/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-mistralai/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-ollama/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-groq/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-together/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-replicate/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-vertexai/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-sagemaker/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-watsonx/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-alephalpha/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-transformers/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-voyageai/
  type: SDK
- url: https://pypi.org/project/opentelemetry-instrumentation-writer/
  type: SDK
description: Drop-in OpenTelemetry instrumentations for the major LLM providers including OpenAI, Anthropic,
  AWS Bedrock, Google Generative AI / Vertex AI, Cohere, Mistral AI, Ollama, Groq, Together AI, Replicate,
  SageMaker, Watsonx, Aleph Alpha, HuggingFace Transformers, Voyage AI, and Writer. Each package monkey-patches
  the provider SDK to emit standardized gen_ai.* spans without code changes.