Internal documentation only
This page has been marked as draft.
Publishing to Kafka but certain dataviews are not publishing anything
Your Answer here Copied
-
The views are two of the Kafka monitoring samplers provided by ITRS; Kafka-Broker and Kafka-Cluster.
Geneos will not publish any data if there are no changes detected in the Kafka-Broker dataview, even if the configured sampling interval is reached.
-
For example:
Only two entries for the Kafka-Broker dataview during our testing. The first entry was created upon the initial creation of the dataview, and the second entry occurred when there was an update in the “State” column from “3” to “3 - Running as Broker”.
Kafka-Broker.Kafka-Broker.Kafka-Broker.kafka.netprobe.Kafka Gateway GA5.4 {"data":{"sampleTime":"2023-05-17T09:13:56.613Z","target":{"gateway":"Kafka Gateway GA5.4","probe":"netprobe","managedEntity":"kafka","type":"Kafka-Broker","sampler":"Kafka-Broker","dataview":"Kafka-Broker","filter":{"osType":"Linux","pluginName":"JMX-SERVER"}},"name":"Kafka","row":{"Version":"2.1.1","State":"3","PartitionCount":"64","LeaderCount":"64","UnderReplicatedPartitions":"0","ActiveControllerCount":"1","OfflinePartitionsCount":"0","PreferredReplicaImbalanceCount":"0","IsrExpandCount":"0","IsrExpandMeanRate":"0","IsrShrinkCount":"0","IsrShrinkMeanRate":"0"}},"operation":"create"} Kafka-Broker.Kafka-Broker.Kafka-Broker.kafka.netprobe.Kafka Gateway GA5.4 {"data":{"sampleTime":"2023-05-17T09:13:56.640Z","target":{"gateway":"Kafka Gateway GA5.4","probe":"netprobe","managedEntity":"kafka","type":"Kafka-Broker","sampler":"Kafka-Broker","dataview":"Kafka-Broker","filter":{"osType":"Linux","pluginName":"JMX-SERVER"}},"name":"Kafka","row":{"Version":"2.1.1","State":"3 - Running as Broker","PartitionCount":"64","LeaderCount":"64","UnderReplicatedPartitions":"0","ActiveControllerCount":"1","OfflinePartitionsCount":"0","PreferredReplicaImbalanceCount":"0","IsrExpandCount":"0","IsrExpandMeanRate":"0","IsrShrinkCount":"0","IsrShrinkMeanRate":"0"}},"operation":"update"}An intentional approach when there is a requirement to publish data based on intervals/schedules whereby client needs to use scheduled publishing to refresh data for dataviews that change infrequently.