ksqlDB

ksqlDB is a streaming database purpose-built for real-time data processing and analytics on top of Apache Kafka®. It allows users to perform continuous, stateful operations on Kafka topics using SQL-like queries.

Adding ksqlDB Cluster

A ksqlDB cluster is a distributed deployment of ksqlDB servers that work together to process and manage real-time streaming data from Apache Kafka®. The cluster provides scalability, fault tolerance, and high availability for running continuous SQL-like queries on Kafka topics.

To add a connection to your ksqlDB cluster, click on the Add-button on the ksqlDB screen. This will bring up a dialog where you can enter the information required to connect to your ksqlDB environment. If your ksqlDB environment is using Basic Authentication (optional), you also need to enter the basic auth username and password in the API Key and API Password fields, respectively.

Viewing ksqlDB Streams

ksqlDB Streams are abstractions representing a continuous flow of real-time data from an underlying Kafka topic. Each event in a stream corresponds to a message in the Kafka topic, and streams are used to process and analyze this data in real time using SQL-like queries in ksqlDB.

In gradient fox you can view the streams of your ksqlDB cluster under the Streams-tab. The following data points are available for each stream.

Viewing ksqlDB Tables

ksqlDB Tables are abstractions in ksqlDB that represent the current state of data derived from streams or Kafka topics. A table is a materialized view of data, where each key in the table corresponds to the latest value associated with that key. Unlike streams, which are continuous flows of immutable events, tables are mutable and reflect the latest state of the data as updates occur.

In gradient fox you can view the tables of your ksqlDB cluster under the Tables-tab. The following details are available for each table.

Viewing ksqlDB Queries

ksqlDB queries are SQL-like statements that allow users to process, transform, analyze, and manipulate streaming data in real time using ksqlDB. Queries interact with streams and tables to perform operations such as filtering, aggregations, joins, and transformations on data flowing through Apache Kafka® topics.

In gradient fox you can view the queries of your ksqlDB cluster under the Queries-tab. The following sub-categories are available for each query.

Executing ksqlDB queries

ksqlDB queries can be run under the SQL-tab of the selected cluster. Simply enter the query you want to execute into the text area and click on the Execute-button. The query results will appear in a grid at the bottom of the screen.