Awesome ClickHouseMetrics and Monitoring

ClickHouse/kubenetmon

⭐ 187 Go added to this list on 2025-02-19 repository created 2024-10-09

kubenetmon is an open source Kubernetes network metering solution developed by ClickHouse. It is designed to meter data transfer within Kubernetes clusters across major cloud providers including AWS, GCP, and Azure. The project is packaged as a Helm chart with a Docker image, making it easy to deploy and integrate into Kubernetes environments. kubenetmon consists of two main components: kubenetmon-agent and kubenetmon-server. The kubenetmon-agent runs as a DaemonSet on each node, collecting connection data from Linux's conntrack and forwarding it to the kubenetmon-server via gRPC. The kubenetmon-server runs as a ReplicaSet, watching the Kubernetes cluster state, attributing connection records to workloads, and inserting the data into ClickHouse for storage and analysis. ClickHouse serves as the backend analytics engine, either self-hosted or via ClickHouse Cloud. kubenetmon enables detailed network traffic analysis such as measuring cross-Availability Zone traffic, outbound and inbound connections, traffic to cloud services like S3, load balancing of gRPC connections, and bandwidth usage relative to cloud service provider limits. The project provides detailed instructions for setup, including creating necessary tables in ClickHouse, deploying the Helm charts, and optionally setting up test Kubernetes clusters and workloads. kubenetmon is particularly useful for cloud-native environments where understanding network traffic patterns and metering data transfer is critical for cost management, performance optimization, and security monitoring. The project is actively maintained with continuous integration and testing, and it is licensed under Apache 2.0. kubenetmon represents a robust solution for Kubernetes network metering leveraging ClickHouse's powerful analytics capabilities.

https://github.com/ClickHouse/kubenetmon

analyticsapache-2.0awsazureclickhousecloud-nativecloud-providersconntrackdaemonsetdata-transferdockergcpgrpchelm-chartkubernetesnetwork-meteringnetwork-traffic-analysisopen-sourcereplicaset

Also in Metrics and Monitoring

hyperdxio/hyperdx

HyperDX is an open source observability platform powered by Clickhouse and OpenTelemetry that centralizes and correlates logs, metrics, traces, errors, and session replays to help engineers quickly resolve production issues.

uptrace/uptrace

Uptrace is an open source APM platform that uses OpenTelemetry for data collection and ClickHouse for storage, providing unified monitoring of traces, metrics, and logs with powerful querying, dashboards, and alerting capabilities.

openlit/openlit

OpenLIT is an open-source AI engineering platform providing OpenTelemetry-native observability, monitoring, and management tools for large language models, GPUs, and vector databases, with data stored in ClickHouse for efficient telemetry analysis.

openmeterio/openmeter

OpenMeter is a flexible metering and billing platform for AI, API, and DevOps companies that collects and aggregates usage events in real-time to enable usage-based billing and real-time insights.

trickstercache/trickster

Trickster is an open-source HTTP reverse proxy cache and time series dashboard accelerator that improves performance and scalability for time series databases including ClickHouse, Prometheus, and InfluxDB.

metrico/gigapipe

Gigapipe is a lightweight, polyglot observability stack that supports logs, metrics, traces, and profiling with compatibility for Loki, Prometheus, Tempo, Pyroscope, and OpenTelemetry, powered by ClickHouse and Bun for efficient data ingestion and querying.

Swetrix/swetrix

Swetrix is an open source, privacy-focused, cookie-less web analytics platform that uses Clickhouse for efficient statistical data management and offers self-hosting or cloud deployment options.

flant/loghouse

Loghouse is an open-source log management solution for Kubernetes that uses ClickHouse for efficient log storage and provides a web UI for querying and monitoring logs.