Awesome ClickHouseExamples

AlexeyKupershtokh/clickhouse-maxmind-geoip

⭐ 123 Dockerfile repository created 2019-04-09

This project demonstrates the integration of ClickHouse, a high-performance columnar database management system, with MaxMind GeoIP2 databases for geolocation purposes. It provides dictionary definitions that enable the use of GeoLite2 or GeoIP2 data within ClickHouse, allowing users to perform geolocation queries efficiently. The repository includes table definitions based on these dictionaries, query examples showcasing how to utilize the geolocation data, and example results to illustrate the output. Additionally, it offers Dockerfile and docker-compose.yml files to facilitate quick setup of a ClickHouse instance preloaded with GeoLite2 dictionaries, enabling fast experimentation and testing. A notable feature is a workaround for loading the GeoLite2-City-Locations-en.csv file, which ClickHouse typically considers corrupted due to apostrophe symbols, ensuring smooth data ingestion. The project also provides insights into the structure and content of GeoLite2 and GeoIP2 dictionaries, linking to official MaxMind documentation for further reference. Users are guided to create a personal account on MaxMind and use a license key to build the Docker image successfully. The dictionaries loaded into ClickHouse include various data such as country locations, IP blocks for IPv4 and IPv6, ASN blocks, and city locations, all accessible through system dictionaries with detailed attributes and statistics. This integration enables enhanced geolocation capabilities within ClickHouse, making it suitable for applications requiring geographic data analysis, IP address mapping, and related queries. Overall, the project serves as a practical example and toolkit for leveraging MaxMind's geolocation data within the ClickHouse environment, streamlining the process of incorporating geographic intelligence into data workflows.

https://github.com/AlexeyKupershtokh/clickhouse-maxmind-geoip

asncity-locationsclickhouseclickhouse-serverdata-ingestiondatabase-integrationdictionariesdockergeographic-data-analysisgeoip2geolite2geolocationip-blocksmaxmindmaxmind-geoipmaxmind-geoip2-api

Also in Examples

toddwschneider/nyc-taxi-data

A comprehensive project for importing, processing, and analyzing over 3 billion NYC taxi and for-hire vehicle trip records using PostgreSQL or ClickHouse databases.

ClickHouse/examples

ClickHouse/examples is a repository providing a collection of data, SQL queries, and Docker Compose recipes to help users quickly deploy, experiment with, and integrate ClickHouse in various environments.

droher/boxball

Boxball provides prebuilt Docker images with Retrosheet's complete baseball history data for multiple analytical database frameworks including Clickhouse, enabling easy access and analysis of comprehensive baseball datasets.