Awesome ClickHouseMetrics and Monitoring

burningalchemist/sql_exporter

⭐ 585 Go repository created 2019-10-25

SQL Exporter for Prometheus is a versatile, configuration-driven exporter designed to collect and expose metrics from various database management systems (DBMSs) for monitoring with Prometheus. It supports multiple databases out of the box, including MySQL, PostgreSQL, Microsoft SQL Server, Oracle Database, Clickhouse, Snowflake, and Vertica. The exporter can be extended to support any DBMS with a Go driver by rebuilding the binary with the appropriate driver included. The core functionality revolves around defining SQL queries grouped into logical collectors, which map the query results to Prometheus metrics. These collectors can be DBMS-specific or custom, allowing users to tailor metrics to their specific needs, such as monitoring data quality or system performance. The exporter operates synchronously with Prometheus scrapes, collecting metrics on each /metrics endpoint poll. To manage load, it supports configurable minimum collection intervals per collector, caching metrics when scrapes occur more frequently than the set interval. Deployment typically involves running the exporter alongside the database server, sharing the same failure domain. If the database is unreachable, the exporter returns an HTTP 500 error, signaling Prometheus to mark the target as down. Configuration is flexible, allowing global settings for connection management and scrape timing, as well as target-specific settings including the database connection string and the collectors to run. Collector definitions can be embedded in the main configuration or stored in separate files for reuse and sharing. The project provides examples and documentation to facilitate setup and customization. It also supports building minimal binaries with selected drivers to reduce size. Overall, SQL Exporter for Prometheus is a powerful tool for database monitoring, enabling detailed, customizable metric collection from a wide range of database systems, including Clickhouse, making it suitable for diverse monitoring environments.

https://github.com/burningalchemist/sql_exporter

cachingclickhousecollectorsconfiguration-drivenconnection-managementcustom-collectorsdatabasedatabase-monitoringdbmsdeploymentgo-drivermetrics-collectionmicrosoft-sql-servermonitoringmonitoring-systemmssqlmysqloracle-databasepostgresqlprometheussnowflakesqlsql-exportersynchronous-scrapesvertica

Also in Metrics and Monitoring

hyperdxio/hyperdx

HyperDX is an open source observability platform powered by Clickhouse and OpenTelemetry that centralizes and correlates logs, metrics, traces, errors, and session replays to help engineers quickly resolve production issues.

uptrace/uptrace

Uptrace is an open source APM platform that uses OpenTelemetry for data collection and ClickHouse for storage, providing unified monitoring of traces, metrics, and logs with powerful querying, dashboards, and alerting capabilities.

openlit/openlit

OpenLIT is an open-source AI engineering platform providing OpenTelemetry-native observability, monitoring, and management tools for large language models, GPUs, and vector databases, with data stored in ClickHouse for efficient telemetry analysis.

openmeterio/openmeter

OpenMeter is a flexible metering and billing platform for AI, API, and DevOps companies that collects and aggregates usage events in real-time to enable usage-based billing and real-time insights.

trickstercache/trickster

Trickster is an open-source HTTP reverse proxy cache and time series dashboard accelerator that improves performance and scalability for time series databases including ClickHouse, Prometheus, and InfluxDB.

metrico/gigapipe

Gigapipe is a lightweight, polyglot observability stack that supports logs, metrics, traces, and profiling with compatibility for Loki, Prometheus, Tempo, Pyroscope, and OpenTelemetry, powered by ClickHouse and Bun for efficient data ingestion and querying.

Swetrix/swetrix

Swetrix is an open source, privacy-focused, cookie-less web analytics platform that uses Clickhouse for efficient statistical data management and offers self-hosting or cloud deployment options.

flant/loghouse

Loghouse is an open-source log management solution for Kubernetes that uses ClickHouse for efficient log storage and provides a web UI for querying and monitoring logs.