Why Amazon built its data stream processing engine Kinesis


Turns out, Amazon(s AMZN) built its real-time data streaming processing service Kinesis because it was trying to solve some of its own internal data streaming issues. Ryan Waite, AWS Data Services general manager, said at Gigaom’s Structure Data conference in New York on Thursday that as AWS’s own data sets got bigger and bigger, the company needed a new way to process the data in real time around important applications like figuring out how much computing customers used and should be charged for.

Kinesis, which became available in December, enables Amazon and its customers to capture a stream of bits of data, store the data across multiple data centers and make it available for processing in just seconds. Real-time processing is becoming increasingly attractive to internet companies as they look for ways to move beyond batch-processing workloads.

Waite said some of Kinesis’ first customers are in the gaming industry…

View original post 53 more words


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s