Awesome ClickHouseMetrics and Monitoring

jaegertracing/jaeger-clickhouse

⭐ 270 Go repository created 2021-07-13

Jaeger ClickHouse is an experimental storage plugin implementation designed to integrate Jaeger, a popular distributed tracing system, with ClickHouse, an analytical column-oriented database management system. This plugin enables the storage of trace data collected by Jaeger into ClickHouse, leveraging ClickHouse's high-performance capabilities for analyzing streams of events, which are similar to Jaeger spans. The project is community-driven and welcomes contributions, issues, and feature requests. The plugin implements the gRPC storage plugin API, although it is noted that this API has been deprecated in Jaeger. Jaeger spans are stored in two main tables within ClickHouse: one table holds the entire span encoded in either JSON or Protobuf format, while the other stores key span information optimized for search operations, indexed by span duration and tags. Additionally, operation information is maintained in a materialized view. The system supports native replication and distribution of data across local and global tables, with span data buffered and flushed to the database based on configurable timer intervals or batch sizes. The project provides detailed documentation, including configuration options, Kubernetes deployment guides, sharding and replication strategies, and multi-tenancy support. Users can quickly start using the plugin with provided Docker examples or by configuring a custom ClickHouse database. The plugin's database schema is visually documented, and the project credits its origins to a previous ClickHouse plugin implementation. Overall, Jaeger ClickHouse aims to combine Jaeger's tracing capabilities with ClickHouse's analytical power to offer an efficient and scalable solution for trace data storage and querying, making it suitable for performance monitoring and observability in distributed systems.

https://github.com/jaegertracing/jaeger-clickhouse

analytical-databasebatch-processingbufferingclickhouseclickhouse-databasecolumn-oriented-databasedistributed-tracingexperimentalgrpcjaegerjaegertracingjsonkubernetesmaterialized-viewmulti-tenancyobservabilityperformance-monitoringprotobufreplicationshardingspansstorage-plugintrace-data

Also in Metrics and Monitoring

hyperdxio/hyperdx

HyperDX is an open source observability platform powered by Clickhouse and OpenTelemetry that centralizes and correlates logs, metrics, traces, errors, and session replays to help engineers quickly resolve production issues.

uptrace/uptrace

Uptrace is an open source APM platform that uses OpenTelemetry for data collection and ClickHouse for storage, providing unified monitoring of traces, metrics, and logs with powerful querying, dashboards, and alerting capabilities.

openlit/openlit

OpenLIT is an open-source AI engineering platform providing OpenTelemetry-native observability, monitoring, and management tools for large language models, GPUs, and vector databases, with data stored in ClickHouse for efficient telemetry analysis.

openmeterio/openmeter

OpenMeter is a flexible metering and billing platform for AI, API, and DevOps companies that collects and aggregates usage events in real-time to enable usage-based billing and real-time insights.

trickstercache/trickster

Trickster is an open-source HTTP reverse proxy cache and time series dashboard accelerator that improves performance and scalability for time series databases including ClickHouse, Prometheus, and InfluxDB.

metrico/gigapipe

Gigapipe is a lightweight, polyglot observability stack that supports logs, metrics, traces, and profiling with compatibility for Loki, Prometheus, Tempo, Pyroscope, and OpenTelemetry, powered by ClickHouse and Bun for efficient data ingestion and querying.

Swetrix/swetrix

Swetrix is an open source, privacy-focused, cookie-less web analytics platform that uses Clickhouse for efficient statistical data management and offers self-hosting or cloud deployment options.

flant/loghouse

Loghouse is an open-source log management solution for Kubernetes that uses ClickHouse for efficient log storage and provides a web UI for querying and monitoring logs.