Apache Kafka

Apache Kafka is a scalable, fault-tolerant event streaming platform for real-time data transmission and analytics, supporting high-throughput and low-latency data feeds between systems and applications.

Default hierarchy

In the chart below, you will find the organizational structure of Apache Kafka objects. Objects are represented in green and folders are in yellow.

Object types

Dawiso ingests the following objects from Apache Kafka:

Cluster

Source Attribute	Target Attribute in Dawiso
cluster_id	Cluster ID

Broker

Source Attribute	Target Attribute in Dawiso
node_id	Node ID
host	Host
port	Port
rack	Rack Awareness

Topic

Source Attribute	Target Attribute in Dawiso
Topic	Name
TopicId	Topic ID
PartitionCount	Partition Count
ReplicationFactor	Replication Factor
size	Size (in Bytes)
isFuture	Is Future
cleanup.policy	Cleanup Policy
messageCount	Message Count

Consumer group

Source Attribute	Target Attribute in Dawiso
GROUP	Name
TOPIC	Topic Name
CURRENT-OFFSET	Current Offset
LOG-END-OFFSET	Log End Offset
LAG	Topic Lag
PARTITION	Partition
memberCount	Member Count