Jwrede/llmprobe
Synthetic monitoring for LLM inference endpoints. Measure TTFT, latency, throughput, and errors across OpenAI, Anthropic, Google, Azure, Bedrock, and local servers (vLLM, SGLang, Ollama). CLI + MCP server with Prometheus and OpenTelemetry export.
Installation
Install with Go
go install github.com/Jwrede/llmprobe@latestRelated in Monitoring
netdata/netdata
Discovery, exploration, reporting and root cause analysis using all observability data, including metrics, logs, systems, containers, processes, and network connections
grafana/mcp-grafana
Search dashboards, investigate incidents and query datasources in your Grafana instance
VictoriaMetrics-Community/mcp-victoriametrics
Provides comprehensive integration with your [VictoriaMetrics instance APIs](https://docs.victoriametrics.com/victoriametrics/url-examples/) and [documentation](https://docs.victoriametrics.com/) for monitoring, observability, and debugging tasks related to your VictoriaMetrics instances
dynatrace-oss/dynatrace-mcp
Leverage AI-driven observability, security, and automation to analyze anomalies, logs, traces, events, metrics.
pydantic/logfire-mcp
Provides access to OpenTelemetry traces and metrics through Logfire
getsentry/sentry-mcp
Sentry.io integration for error tracking and performance monitoring