The Apache Kafka input adapter reads the tail of a given file and inputs that to the WSO2 product engine. This feature is donated by Andres Gomez Ferrer. For more information, go to Apache Kafka documentation.
Set up the below prerequisites to start configuring an input Apache Kafka event adapter.
Download Apache Kafka server.
<KAFKA_HOME>/lib/
directory to <CEP_HOME>/repository/components/lib/
directory.kafka_2.10-0.8.1.jar
zkclient-0.3.jar
scala-library-2.10.1.jar
zookeeper-3.3.4.jar
<KAFKA_HOME>/lib/
directory to <CEP_HOME>/samples/lib/
directory.You can configure input Kafka event adapter using the management console or using a configuration file.
Follow the instructions below to configure input Kafka event adapter using the management console. This deploys the event adapter in the <PRODUCT_HOME>
/
repository/
deployment/
server/
inputeventadaptors/
directory.
Enter details as shown in the below example.
Click Add Event Adaptor.
Follow the instructions below to configure input Kafka event adapter using a configuration file.
Create an XML file with the following Kafka input event adapter configurations. Input event adapter implementation must start with <inputEventAdaptor>
as the root element.
<inputEventAdaptor name="kafkaInputAdaptor" statistics="disable" trace="disable" type="kafka" xmlns="http://wso2.org/carbon/eventadaptormanager"> <property name="optional.configuration">zk.connectiontimeout.ms:6000,zk.sessiontimeout.ms:7000</property> <property name="group.id">test-group</property> <property name="zookeeper.id">127.0.0.1:2181</property> <property name="threads">5</property> </inputEventAdaptor>
Add the XML file to the <PRODUCT_HOME>/repository/deployment/server/inputeventadaptors/
directory. Since hot deployment is enabled, you can simply add/remove files to deploy/undeploy to/from the server.
After an adapter is successfully added, it gets added to the list of adapters displayed under Event Processor Configs in the Configure menu of the product's management console. Click Edit to change its configuration and redeploy it. This opens an XML-based editor allowing you to edit the event adapter configurations from the UI. Do your modifications and click Update. You can also delete it, enable/disable statistics or enable/disable tracing on it using the provided options in the UI.
The configured input event adapters are used in Event Builders. With input event adapter message properties, event builders are able to extract data from the incoming events to build the event streams. Message properties specific to input event adapters of the kafka
type can be configured as follows.
Click the name of the event builder to which the relevant input event adapter is connected. This opens the Event Builder Details page.
kafka
input event adapter are described below.
Property | Description |
---|---|
Topic Kafka | Name of the Kafka topic to which, input messages are published |
Input Mapping Type | The incoming event type to be mapped |