Loading AI tools
Amazon Kinesis is a family of services provided by Amazon Web Services (AWS) for processing and analyzing real-time streaming data at a large scale. Launched in November 2013, it offers developers the ability to build applications that can consume and process data from multiple sources simultaneously.[2] Kinesis supports multiple use cases, including real-time analytics, log and event data collection, and real-time processing of data generated by IoT devices.
| Developer(s) | Amazon Web Services |
|---|---|
| Initial release | November 2013[1] |
| Operating system | Amazon Web Services |
| Platform | Cloud computing |
| Type | Big data and Streaming data |
| License | Proprietary software |
| Website | aws |
Amazon Kinesis was launched by Amazon Web Services (AWS) in November 2013 as a managed service for processing and analyzing real-time streaming data at a large scale.[3] The service was introduced to address the growing need for businesses to process and analyze data as it was generated, rather than in batches, allowing for real-time insights and decision-making.
Since its launch, the Amazon Kinesis family of services has expanded to include four main components: Kinesis Data Streams, Kinesis Data Firehose, Kinesis Data Analytics, and Kinesis Video Streams.[4] Each of these components serves a specific purpose in the processing and analysis of real-time streaming data.
In August 2015, AWS announced the availability of Kinesis Data Firehose, a fully managed service for delivering real-time streaming data to destinations such as Amazon S3, Amazon Redshift, and Amazon Elasticsearch.[5] A year later in August 2016, AWS launched Kinesis Data Analytics, enabling customers to analyze streaming data in real time using standard SQL queries.[6]
AWS introduced Kinesis Video Streams, a fully managed service for securely capturing, processing, and storing video streams for analytics and machine learning applications, was introduced by AWS in November 2017.[7]
Amazon Kinesis is composed of four main services: Kinesis Data Streams, Kinesis Data Firehose, Kinesis Data Analytics, and Kinesis Video Streams.[4]
Kinesis Data Streams
Kinesis Data Streams is a scalable and durable real-time data streaming service that captures and processes gigabytes of data per second from multiple sources.[8] It enables the storage and processing of data in real time, making it useful for applications that require immediate insights, such as monitoring and alerting.
Kinesis Data Firehose
Kinesis Data Firehose is a fully managed service for delivering real-time streaming data to destinations such as Amazon S3, Amazon Redshift, Amazon Elasticsearch, and AWS-partner data stores.[9] With Data Firehose, users can configure and scale data delivery without manual intervention.
Kinesis Data Analytics
Kinesis Data Analytics enables the analysis of streaming data in real time using standard SQL or Apache Flink.
Kinesis Video Streams
Kinesis Video Streams is a fully managed service for securely capturing, processing, and storing video streams for analytics and machine learning.[10] It supports multiple video codecs and streaming protocols, making it suitable for various use cases, such as security and surveillance, video-enabled IoT devices, and live event broadcasting.
Amazon Kinesis can be easily integrated with other AWS services, such as AWS Lambda, Amazon S3, Amazon Redshift, and Amazon OpenSearch. This integration enables developers to build end-to-end streaming data processing applications, taking advantage of the extensive AWS ecosystem.[11]
Some common use cases for Amazon Kinesis include:[2]
- Real-time analytics: Analyzing streaming data in real time to provide immediate insights and make data-driven decisions.
- Log and event data collection: Collecting, processing, and analyzing log and event data generated by applications, infrastructure, and devices.[12]
- IoT data processing: Processing and analyzing large volumes of data generated by IoT devices in real time.[13]
- Machine learning: Ingesting and processing video streams for machine learning applications, such as object recognition, facial recognition, and sentiment analysis.
Amazon Kinesis follows a pay-as-you-go pricing model, with costs depending on the chosen service, data volume, and processing power required.[14] AWS provides a free tier for Kinesis Data Streams and Kinesis Data Firehose, allowing users to get started with the services at no cost.[15]
- Apache Kafka
- Google Cloud Pub/Sub
- Microsoft Azure Event Hubs
- Stream processing
Wikiwand in your browser!
Seamless Wikipedia browsing. On steroids.
Every time you click a link to Wikipedia, Wiktionary or Wikiquote in your browser's search results, it will show the modern Wikiwand interface.
Wikiwand extension is a five stars, simple, with minimum permission required to keep your browsing private, safe and transparent.
