Amazon Kinesis Overview
Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin.
Decodable + Amazon Kinesis
Decodable regards Amazon Kinesis as both a source which can send a stream of data, and a sink which can receive one or more streams of data from a pipeline. You could use Decodable to take data from Kinesis and send to an analytical database or machine learning model, or even send back to another Kinesis topic after transformation. With Kinesis as a sink, Decodable can take a stream of data from a messaging system such as Kafka, a REST API or even a standard database like MySQL or Postgres running in CDC (change data capture) mode. Transforming data between Kinesis topics can be the basis for building sophisticated event-driven microservice applications without writing a single line of code.
In the following video you'll see how to use Kinesis as a source, streaming data into Decodable which transforms it and outputs to Apache Pulsar.