Awesome ClickHouse › Documentation

jneo8/clickhouse-setup

⭐ 153 Makefile repository created 2018-12-07

This project is a tutorial for setting up a ClickHouse server, including both single server and cluster configurations using Docker containers. It provides step-by-step instructions to run a ClickHouse server and client in Docker, enabling users to verify the successful setup of the server. The tutorial further elaborates on setting up a ClickHouse cluster with 3 shards, each having 2 replica servers, utilizing ReplicatedMergeTree and Distributed tables for data management. The cluster setup is demonstrated through a detailed docker-compose.yml configuration that includes six ClickHouse server containers and one ZooKeeper container. ZooKeeper is highlighted as a critical component for enabling replication, ensuring data consistency across replicas, and automating restore procedures after failures. The tutorial advises deploying ZooKeeper on separate servers for production environments and explains the risks of not using ZooKeeper, such as the lack of guaranteed data consistency. Configuration files are also discussed, including modifications to the default ClickHouse config to include external substitution files, and detailed examples of the metrika.xml and macros.xml files that define cluster shards, replicas, ZooKeeper nodes, network settings, and compression methods. The macros.xml file is customized per instance to match the remote server settings, ensuring proper cluster operation. Overall, this project serves as a comprehensive guide for users looking to deploy and manage ClickHouse servers and clusters using Docker, with a focus on replication, configuration, and best practices for maintaining data integrity and availability.

https://github.com/jneo8/clickhouse-setup

clickhouseclusterconfigurationdata-consistencydata-replicationdistributed-tabledockerdocker-composemacros.xmlmetrika.xmlreplicasreplicatedmergetreeserver-setupshardstutorialzookeeper