Awesome ClickHouseMetrics and Monitoring

metrico/gigapipe

⭐ 1705 Go added to this list on 2025-04-13 repository created 2018-12-26

Gigapipe is a lightweight, polyglot observability stack designed to handle logs, metrics, traces, and profiling data efficiently. It serves as an all-in-one API compatible with popular observability tools such as Loki, Prometheus, Tempo, and Pyroscope, making it a versatile alternative to existing solutions like LGTM. The project emphasizes ease of integration and performance, powered by Bun, a fast JavaScript runtime, and the ClickHouse OLAP engine for data storage and querying. The platform supports ingestion from multiple sources including OpenTelemetry, Loki, Prometheus, Tempo, Influx, Datadog, and Elastic, allowing users to push and query data using various protocols and query languages like LogQL, PromQL, and TraceQL. This flexibility ensures that users can maintain their existing instrumentation without modification while benefiting from Gigapipe's capabilities. Gigapipe offers native API support for these protocols, enabling direct data ingestion and querying without the need for middleware or proxies. It integrates seamlessly with Grafana, providing native datasource compatibility without requiring plugins, and includes a built-in lightweight data explorer called "view" for logs, metrics, and traces. Security and data control are prioritized, with support for storage backends like ClickHouse, DuckDB, and InfluxDB IOx, combined with S3 object storage. The project is open source and community-driven, promoting independence from vendor lock-in and proprietary stacks. Overall, Gigapipe is a comprehensive observability solution that combines multiple standards and protocols into a single, efficient platform, making it easier for developers and operators to monitor and analyze their systems with familiar tools and languages.

https://github.com/metrico/gigapipe

apibunclickhousedata-ingestionduckdbgigapipegrafanainfluxdb-ioxlgtmlogqllogslokimetricsmonitoringobservabilityopen-sourceopentelemetrypolyglotprofilingprometheuspromqlpyroscopes3-storagesignozsqltempotimeseriestraceqltracestracingwasm

Also in Metrics and Monitoring

hyperdxio/hyperdx

HyperDX is an open source observability platform powered by Clickhouse and OpenTelemetry that centralizes and correlates logs, metrics, traces, errors, and session replays to help engineers quickly resolve production issues.

uptrace/uptrace

Uptrace is an open source APM platform that uses OpenTelemetry for data collection and ClickHouse for storage, providing unified monitoring of traces, metrics, and logs with powerful querying, dashboards, and alerting capabilities.

openlit/openlit

OpenLIT is an open-source AI engineering platform providing OpenTelemetry-native observability, monitoring, and management tools for large language models, GPUs, and vector databases, with data stored in ClickHouse for efficient telemetry analysis.

openmeterio/openmeter

OpenMeter is a flexible metering and billing platform for AI, API, and DevOps companies that collects and aggregates usage events in real-time to enable usage-based billing and real-time insights.

trickstercache/trickster

Trickster is an open-source HTTP reverse proxy cache and time series dashboard accelerator that improves performance and scalability for time series databases including ClickHouse, Prometheus, and InfluxDB.

Swetrix/swetrix

Swetrix is an open source, privacy-focused, cookie-less web analytics platform that uses Clickhouse for efficient statistical data management and offers self-hosting or cloud deployment options.

flant/loghouse

Loghouse is an open-source log management solution for Kubernetes that uses ClickHouse for efficient log storage and provides a web UI for querying and monitoring logs.

burningalchemist/sql_exporter

SQL Exporter for Prometheus is a configuration-driven tool that collects and exposes metrics from various databases, including Clickhouse, for monitoring with Prometheus.