This documentation is for the Kafka connector version 1.0.1. To see the latest connector documentation, go to our GitHub repository.
Kafka is a distributed publish-subscribe messaging system that maintains feeds of messages in topics. Producers write data to topics and consumers read from topics. For more information on Apache Kafka, see Apache Kafka documentation.
The Kafka connector allows you to access the Kafka Producer API through WSO2 ESB. It acts as a message producer that facilitates message publication. The Kafka connector creates a connection to Kafka and sends messages to the Kafka brokers.
The Kafka inbound endpoint acts as a message consumer. It creates a connection to Zookeeper and requests messages for a topic.
To start publishing messages to the Kafka brokers, see Configuring the Kafka Operations.
To start consuming the messages produced by the kafka producer via a topic, see.
For general information on using connectors and their operations in your ESB configurations, see Using a Connector.
To download the connector, go to https://store.wso2.com/store/assets/esbconnector/kafka, click Download Connector, and then add and enable the connector in your ESB instance.
To download the inbound JAR file, go to https://store.wso2.com/store/assets/esbconnector/kafka, and click Download Streaming Connector. To use the inbound endpoint with ESB, copy the downloaded JAR file to the
<ESB_HOME>/repository/components/dropins directory and restart your ESB server.