You can track your AI agents and their use of large language models with Sentry. This setup helps you see how many tokens each call uses and how long it takes. It works with popular AI tools like OpenAI and Anthropic.
The skill checks which AI software you already have and adds the right monitoring code. It also asks if you want to record the prompts and outputs. That data may contain personal information, so you must confirm first.
You can set up sampling to capture all AI traces while keeping other traffic at a lower rate. This gives you full visibility without slowing everything down.
Global
mkdir -p ~/.claude/skills/sentry-setup-ai-monitoringProject
mkdir -p .claude/skills/sentry-setup-ai-monitoringSource Repository
Appinsights Instrumentationmicrosoft/azure-skills
Learn how to add Azure Application Insights monitoring to your web app
Azure Kustomicrosoft/azure-skills
Run fast KQL queries on Azure Data Explorer for log and telemetry analysis
Caveman Statsjuliusbrussee/caveman
See real token usage and estimated savings directly from your session log
Azure Observabilitymicrosoft/azure-skills
Track Azure app errors, performance, and infrastructure with monitoring tools
Convex Performance Auditget-convex/agent-skills
Find and fix Convex performance problems with step-by-step diagnostic guidance
Google Agents Cli Observabilitygoogle/agents-cli
Set up tracing, logging, and analytics for your ADK agents easily
Golang Observabilitysamber/cc-skills-golang
Monitor your Go services with logs metrics traces and profiling
Golang Samber Slogsamber/cc-skills-golang
Compose, sample, and route Go logs to multiple backends with ease