AWS S3 Lambda Overview
Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. Customers of all sizes and industries can use Amazon S3 to store and protect any amount of data for a range of use cases, such as data lakes, websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics. Amazon S3 provides management features so that you can optimize, organize, and configure access to your data to meet your specific business, organizational, and compliance requirements.
- Storage and access management
- Storage logging and monitoring
- Analytics and insights
- Strong consistency
Decodable + AWS S3 Lambda
Decodable can take input from Amazon S3 storage as a source using an AWS lambda function which converts table changes into a stream of change records. Decodable can be a super convenient means to replicate the contents of S3 storage into a range of systems including messaging such as Kafka, analytical databases such as Apache Pinot, or machine learning feature stores. Decodable's SQL-on-the-stream transformation process also includes data virtualization on change streams so you're processing against the table, not the change records.