OpenLLMetry LLM Provider Instrumentations
Drop-in OpenTelemetry instrumentations for the major LLM providers including OpenAI, Anthropic, AWS Bedrock, Google Generative AI / Vertex AI, Cohere, Mistral AI, Ollama, Groq, Together AI, Replicate, SageMaker, Watsonx, Aleph Alpha, HuggingFace Transformers, Voyage AI, and Writer. Each package monkey-patches the provider SDK to emit standardized gen_ai.* spans without code changes.
OpenLLMetry LLM Provider Instrumentations is one of 6 APIs that OpenLLMetry publishes on the APIs.io network.
Tagged areas include Instrumentation, LLM Providers, and Tracing. The published artifact set on APIs.io includes API documentation, a GitHub repository, and SDKs.
Documentation
SDKs
GitHubRepository
https://github.com/traceloop/openllmetry/tree/main/packages
SDK
https://pypi.org/project/opentelemetry-instrumentation-openai/
SDK
https://pypi.org/project/opentelemetry-instrumentation-anthropic/
SDK
https://pypi.org/project/opentelemetry-instrumentation-bedrock/
SDK
https://pypi.org/project/opentelemetry-instrumentation-google-generativeai/
SDK
https://pypi.org/project/opentelemetry-instrumentation-cohere/
SDK
https://pypi.org/project/opentelemetry-instrumentation-mistralai/
SDK
https://pypi.org/project/opentelemetry-instrumentation-ollama/
SDK
https://pypi.org/project/opentelemetry-instrumentation-groq/
SDK
https://pypi.org/project/opentelemetry-instrumentation-together/
SDK
https://pypi.org/project/opentelemetry-instrumentation-replicate/
SDK
https://pypi.org/project/opentelemetry-instrumentation-vertexai/
SDK
https://pypi.org/project/opentelemetry-instrumentation-sagemaker/
SDK
https://pypi.org/project/opentelemetry-instrumentation-watsonx/
SDK
https://pypi.org/project/opentelemetry-instrumentation-alephalpha/
SDK
https://pypi.org/project/opentelemetry-instrumentation-transformers/
SDK
https://pypi.org/project/opentelemetry-instrumentation-voyageai/
SDK
https://pypi.org/project/opentelemetry-instrumentation-writer/