Apache Kafka Requirementslink
This section describes the requirements, access privileges, and other features of Fivetran HVR when using Apache Kafka for replication.
For information about compatibility and supported versions of Kafka with HVR platforms, see Supported Platforms.
For the Capabilities supported by HVR on Kafka, see Capabilities for Apache Kafka.
For information about the supported data types and mapping of data types in source DBMS to the corresponding data types in target DBMS or file format, see Data Type Mapping.
Installation Dependencieslink
On Linux, to use either of the Kafka authentication methods (User Name and Password or Kerberos), HVR requires the library libsasl2.so.2 to be installed. This library is part of Cyrus SASL and can be installed as follows:
$ yum install cyrus-sasl # On Red Hat Linux, CentOS $ zypper install cyrus-sasl # On SUSE Linux
There are no installation dependency for using Kafka authentication methods on Windows.
Known Issuelink
When using Kafka broker version 0.9.0.0 or 0.9.0.1, an existing bug (KAFKA-3547) in Kafka causes timeout error in HVR.
The workaround to resolve this issue is to define action Environment for the Kafka location as mentioned below:
Group | Table | Action | Parameter(s) |
---|---|---|---|
KAFKA | * | Environment | Name=HVR_KAFKA_BROKER_VERSIONValue=0.9.0.1 |
If the Kafka broker version used is 0.9.0.0 then set Value=0.9.0.0