Awesome ClickHouseMetrics and Monitoring

trickstercache/trickster

⭐ 2091 Go repository created 2018-03-29

Trickster is an open-source HTTP reverse proxy cache and time series dashboard accelerator designed to improve the performance and scalability of time series database (TSDB) environments and HTTP applications. It acts as a caching layer and query accelerator for dashboards that query TSDBs, significantly reducing redundant computations and improving chart rendering times for end users. Trickster supports multiple TSDBs including Prometheus, ClickHouse, and InfluxDB, making it versatile for various monitoring and analytics setups. The project offers a fully-featured HTTP reverse proxy cache that supports TLS and HTTP/2, multiple caching options such as in-memory, filesystem, Redis, and bbolt, and advanced features like application load balancing, negative caching to prevent outages, collapsed forwarding for high performance, and byte range request caching. It also includes built-in Prometheus metrics, customizable health checks, distributed tracing via OpenTelemetry, and a rules engine for custom request routing and rewriting. Trickster's time series acceleration is achieved through several innovative techniques. The Delta Proxy Cache inspects client query time ranges to request only the incremental data points not already cached, reducing load on the TSDB and speeding up dashboard refreshes. Step Boundary Normalization aligns data points to consistent intervals for better cacheability and user experience. The Fast Forward feature ensures real-time graphs always display the most recent data, even if it falls outside the normalized step boundaries. The project is hosted by the Cloud Native Computing Foundation (CNCF) as a sandbox-level project, emphasizing its focus on cloud-native, container-packaged, and microservices-oriented environments. It supports deployment via Docker, Kubernetes, and Helm, with comprehensive documentation and examples for easy setup and integration. Trickster is actively maintained with a roadmap for future enhancements and a strong community presence.

https://github.com/trickstercache/trickster

acceleratorapplication-load-balancerbboltbyte-range-request-cachingcachingcaching-layerclickhousecncfcollapsed-forwardingdashboardsdelta-proxy-cachedistributed-tracingdockerfast-forwardgolanghelmhttp-proxyhttp-reverse-proxy-cachehttp/2influxdbkubernetesnegative-cachingopentelemetryperformanceprometheusredisreverse-proxystep-boundary-normalizationtime-series-dashboard-acceleratortlstrickstertsdb

Also in Metrics and Monitoring

hyperdxio/hyperdx

HyperDX is an open source observability platform powered by Clickhouse and OpenTelemetry that centralizes and correlates logs, metrics, traces, errors, and session replays to help engineers quickly resolve production issues.

uptrace/uptrace

Uptrace is an open source APM platform that uses OpenTelemetry for data collection and ClickHouse for storage, providing unified monitoring of traces, metrics, and logs with powerful querying, dashboards, and alerting capabilities.

openlit/openlit

OpenLIT is an open-source AI engineering platform providing OpenTelemetry-native observability, monitoring, and management tools for large language models, GPUs, and vector databases, with data stored in ClickHouse for efficient telemetry analysis.

openmeterio/openmeter

OpenMeter is a flexible metering and billing platform for AI, API, and DevOps companies that collects and aggregates usage events in real-time to enable usage-based billing and real-time insights.

metrico/gigapipe

Gigapipe is a lightweight, polyglot observability stack that supports logs, metrics, traces, and profiling with compatibility for Loki, Prometheus, Tempo, Pyroscope, and OpenTelemetry, powered by ClickHouse and Bun for efficient data ingestion and querying.

Swetrix/swetrix

Swetrix is an open source, privacy-focused, cookie-less web analytics platform that uses Clickhouse for efficient statistical data management and offers self-hosting or cloud deployment options.

flant/loghouse

Loghouse is an open-source log management solution for Kubernetes that uses ClickHouse for efficient log storage and provides a web UI for querying and monitoring logs.

burningalchemist/sql_exporter

SQL Exporter for Prometheus is a configuration-driven tool that collects and exposes metrics from various databases, including Clickhouse, for monitoring with Prometheus.