Object types, hierarchy, and attribute mappings for the Apache Kafka integration.
Apache Kafka is a scalable, fault-tolerant event streaming platform for real-time data transmission and analytics, supporting high-throughput and low-latency data feeds between systems and applications.
Default hierarchy
In the chart below, you will find the organizational structure of Apache Kafka objects. Objects are represented in green and folders are in yellow.
Object types
Dawiso ingests the following objects from Apache Kafka:
Cluster
| Source Attribute | Target Attribute in Dawiso |
|---|
| cluster_id | Cluster ID |
Broker
| Source Attribute | Target Attribute in Dawiso |
|---|
| node_id | Node ID |
| host | Host |
| port | Port |
| rack | Rack Awareness |
Topic
| Source Attribute | Target Attribute in Dawiso |
|---|
| Topic | Name |
| TopicId | Topic ID |
| PartitionCount | Partition Count |
| ReplicationFactor | Replication Factor |
| size | Size (in Bytes) |
| isFuture | Is Future |
| cleanup.policy | Cleanup Policy |
| messageCount | Message Count |
Consumer group
| Source Attribute | Target Attribute in Dawiso |
|---|
| GROUP | Name |
| TOPIC | Topic Name |
| CURRENT-OFFSET | Current Offset |
| LOG-END-OFFSET | Log End Offset |
| LAG | Topic Lag |
| PARTITION | Partition |
| memberCount | Member Count |