Setting up a Kafka® connection
Defining the Kafka server to ClickHouse®
Connecting ClickHouse® to Apache Kafka®
How to connect a ClickHouse® cluster to a Kafka server
Apache Kafka is an open-source distributed event streaming platform used by millions around the world. In this section we’ll cover how to connect a ClickHouse® cluster to a Kafka server. With the connection configured, you can subscribe to topics on the Kafka server, store messages from the Kafka server in a ClickHouse database, then use the power of ClickHouse for real-time analytics against those messages.
ClickHouse has a Kafka table engine that lets you tie Kafka and ClickHouse together. As you would expect, the Altinity Cloud Manager (ACM) makes it extremely easy to configure the Kafka table engine.
We cover working with Kafka in these topics:
Configuring a Kafka® connection
Setting up connection parameters
Working with Kafka® data in ClickHouse®
Putting things together