Awesome ClickHouse › Metrics and Monitoring

ClickHouse/kubenetmon

⭐ 190 Go added to this list on 2025-02-19 repository created 2024-10-09

kubenetmon is an open source Kubernetes network metering solution developed by ClickHouse. It is designed to meter data transfer within Kubernetes clusters across major cloud providers including AWS, GCP, and Azure. The project is packaged as a Helm chart with a Docker image, making it easy to deploy and integrate into Kubernetes environments. kubenetmon consists of two main components: kubenetmon-agent and kubenetmon-server. The kubenetmon-agent runs as a DaemonSet on each node, collecting connection data from Linux's conntrack and forwarding it to the kubenetmon-server via gRPC. The kubenetmon-server runs as a ReplicaSet, watching the Kubernetes cluster state, attributing connection records to workloads, and inserting the data into ClickHouse for storage and analysis. ClickHouse serves as the backend analytics engine, either self-hosted or via ClickHouse Cloud. kubenetmon enables detailed network traffic analysis such as measuring cross-Availability Zone traffic, outbound and inbound connections, traffic to cloud services like S3, load balancing of gRPC connections, and bandwidth usage relative to cloud service provider limits. The project provides detailed instructions for setup, including creating necessary tables in ClickHouse, deploying the Helm charts, and optionally setting up test Kubernetes clusters and workloads. kubenetmon is particularly useful for cloud-native environments where understanding network traffic patterns and metering data transfer is critical for cost management, performance optimization, and security monitoring. The project is actively maintained with continuous integration and testing, and it is licensed under Apache 2.0. kubenetmon represents a robust solution for Kubernetes network metering leveraging ClickHouse's powerful analytics capabilities.

https://github.com/ClickHouse/kubenetmon

analyticsapache-2.0awsazureclickhousecloud-nativecloud-providersconntrackdaemonsetdata-transferdockergcpgrpchelm-chartkubernetesnetwork-meteringnetwork-traffic-analysisopen-sourcereplicaset

Also in Metrics and Monitoring

ccfos/nightingale

Open-source alerting platform that evaluates rules against Prometheus, VictoriaMetrics, Elasticsearch, Loki, ClickHouse and PostgreSQL, then routes notifications to Slack, PagerDuty and other channels.

ClickHouse/ClickStack

Observability platform by the ClickHouse team for searching and visualizing logs, metrics, traces and session replays on any ClickHouse cluster.

uptrace/uptrace

Uptrace is an open source APM platform that uses OpenTelemetry for data collection and ClickHouse for storage, providing unified monitoring of traces, metrics, and logs with powerful querying, dashboards, and alerting capabilities.

openlit/openlit

OpenLIT is an open-source AI engineering platform providing OpenTelemetry-native observability, monitoring, and management tools for large language models, GPUs, and vector databases, with data stored in ClickHouse for efficient telemetry analysis.

openmeterio/openmeter

OpenMeter is a flexible metering and billing platform for AI, API, and DevOps companies that collects and aggregates usage events in real-time to enable usage-based billing and real-time insights.

trickstercache/trickster

Trickster is an open-source HTTP reverse proxy cache and time series dashboard accelerator that improves performance and scalability for time series databases including ClickHouse, Prometheus, and InfluxDB.

metrico/gigapipe

Gigapipe is a lightweight, polyglot observability stack that supports logs, metrics, traces, and profiling with compatibility for Loki, Prometheus, Tempo, Pyroscope, and OpenTelemetry, powered by ClickHouse and Bun for efficient data ingestion and querying.

Swetrix/swetrix

Swetrix is an open source, privacy-focused, cookie-less web analytics platform that uses Clickhouse for efficient statistical data management and offers self-hosting or cloud deployment options.