Awesome ClickHouseOps

duyet/clickhouse-monitoring

⭐ 293 TypeScript repository created 2023-11-16

ClickHouse Monitoring Dashboard is a simple and effective UI tool designed to monitor and provide an overview of ClickHouse clusters by leveraging the system tables inherent to ClickHouse. It offers a comprehensive set of features that allow users to track and analyze various aspects of their ClickHouse environment. Key functionalities include monitoring current and historical queries, assessing query resources such as memory usage, parts read, and file operations, and identifying the most expensive queries as well as the most frequently used tables and columns. The dashboard also provides cluster-wide monitoring capabilities, including total memory and CPU usage, distributed queue status, global and MergeTree-specific settings, and various performance metrics. In addition to query and cluster monitoring, the tool offers detailed insights into tables and parts, including size, row count, compression ratios, and part sizes down to the column level. It also includes useful utilities such as Zookeeper data exploration, query explanation (EXPLAIN), and the ability to kill running queries. Visualization is a strong aspect of this dashboard, with metric charts that display query and resource usage trends, merge and mutation counts, merge performance, and query performance over time. The project is built with Next.js and is designed for easy deployment with options including Vercel, Docker, and Kubernetes Helm charts. It is well-documented with guides for getting started, local development, user roles, enabling system tables, and deployment instructions. The dashboard is open to feedback and contributions, encouraging community involvement. Overall, this project serves as a valuable tool for database administrators and developers who need to maintain and optimize ClickHouse clusters efficiently.

https://github.com/duyet/clickhouse-monitoring

clickhousecluster-monitordashboarddeploymentdockerduyethelm-chartkill-querieskubernetesmetric-chartsmonitoringnext.jsnextjsparts-informationquery-explainquery-monitorsystem-tablestables-informationvercelvisualizationzookeeper

Also in Ops

Altinity/clickhouse-backup

Altinity/clickhouse-backup is a tool for easy backup and restore of ClickHouse databases using various cloud and local object storage systems.

ContentSquare/chproxy

Chproxy is an open-source HTTP proxy and load balancer designed to optimize and manage HTTP traffic for the ClickHouse database, enhancing scalability and fault tolerance.

PostHog/HouseWatch

HouseWatch is an open-source tool by PostHog for monitoring and managing ClickHouse clusters, providing detailed insights into query performance, cluster load, logs, and disk usage with operational controls.