WebProNews

Tag: Data Warehouse

  • Amazon Redshift Gets Faster Data Nodes

    Amazon Redshift Gets Faster Data Nodes

    Early last year, Amazon Web Services made Redshift available to the world. The service promised a “fast and powerful, fully managed, petabyte-scale data warehouse in the cloud.” AWS fulfilled that promise, and it’s now making it even better.

    Amazon Web Services announced this morning that Redshift customers now have access to what it calls Dense Compute nodes. These new solid state drive-based nodes “enable customers to create even faster, lower cost data warehouse with Amazon Redshift.” When AWS says Dense Compute will lower costs, they certainly mean it as 160GB datasets will only cost $0.10 an hour.

    “Amazon Redshift has become the fastest-growing service in the history of AWS by providing customers with a fast, fully managed, petabyte-scale data warehousing service for a tenth the price of traditional solutions,” said Raju Gulabani, Vice President of Database Services, AWS. “We have been actively engaging with our customers using Amazon Redshift and watching them tap into insights that were previously out of reach to help grow their businesses. Today, we are making Amazon Redshift even more accessible to customers, lowering the cost of a single node by as much as 56 percent while increasing the ratio of CPU, RAM, and I/O to storage to offer even higher performance.”

    With this latest option, Amazon says Redshift customers can now choose between Dense Compute nodes and Dense Storage nodes with just a simple API call. For customers who need less than 500GB of data or care more about performance when going above 500GB, you’ll want to go with Dense Compute. If you care more about lowering the cost of storage, you’ll want to go with Dense Storage. It may not have the same performance as Dense Compute, but you can scale up to 1PB or more.

    Before making Dense Compute nodes available to the public at large, AWS let some well known Web brands try it out. One such company was Pinterest and it only had nice things to say about it:

    “At Pinterest, we analyze tens of billions of objects, including pins, boards, and places, across our web and mobile properties to understand and optimize the Pinner experience for tens of millions of people around the world. Amazon Redshift has been a huge win. It’s made big data feel small and enabled our data science team to run the queries they need across a huge, rapidly growing data set. Amazon Redshift is easy to manage and with both the Dense Storage and Dense Compute node types, we know that regardless of our cost, storage, and performance needs, Amazon Redshift is up to the challenge,” said Mohammad Shahangian, Data Scientist, Pinterest.

    AWS notes that Amazon Redshift Dense Storage and Dense Compute nodes are available in the following regions: US East, US West, EU, Asia Pacific (Singapore), Asia Pacific (Sydney) and Asia Pacific (Tokyo). You can learn more about it here.

    Image via Amazon Web Services/YouTube

  • Amazon Announces Redshift, A Petabyte-Scale Data Warehouse Service

    Amazon announced a limited preview of Amazon Redshift today, a new product from Amazon Web Services described as a “fast and powerful, fully managed, petabyte-scale data warehouse service in the cloud”.

    According to Amazon, it enables customers to “dramatically” increase the speed of query performance when analyzing any size data set, with the same SQL-based BI tools they’re already using.

    “With a few clicks in the AWS Management Console, customers can launch a Redshift cluster, starting with a few hundred gigabytes and scaling to a petabyte or more, for under $1,000 per terabyte per year – one tenth the price of most data warehousing solutions available to customers today,” the company said in an announcement.

    Amazon Web Services VP of Database Services, Raju Gulabani, said, “Over the past two years, one of the most frequent requests we’ve heard from customers is for AWS to build a data warehouse service. Enterprises are tired of paying such high prices for their data warehouses and smaller companies can’t afford to analyze the vast amount of data they collect (often throwing away 95% of their data). This frustrates customers as they know the cloud has made it easier and less expensive than ever to collect, store, and analyze data.”

    “Amazon Redshift not only significantly lowers the cost of a data warehouse, but also makes it easy to analyze large amounts of data very quickly,” he added. “While actual performance will vary based on each customers’ specific query requirements, our internal tests have shown over 10 times performance improvement when compared to standard relational data warehouses. Having the ability to quickly analyze petabytes of data at a low cost changes the game for our customers.”

    Participants in the private beta program include Netflix, Flipboard, NASA/JPL and Schumacher Group.

    Kurt Brown, Director of Data Science & Engineering Platform at Netflix, said, “At Netflix, we deliver personalized recommendations for our millions of subscribers by analyzing large volumes of data, and are always looking for ways to improve our service. We’re very excited about the cost-disruptive and cloud-based model of Amazon Redshift. It’s sure to shake up the data warehousing industry.”

    Erik Selberg, Manager of the Amazon.com Data Warehouse team, added, “The Amazon Enterprise Data Warehouse manages petabytes of data for every group at Amazon. We are seeing significant performance improvements leveraging Amazon Redshift over our current multi-million dollar data warehouse. Some multi-hour queries finish in under an hour, and some queries that took 5-10 minutes on our current data warehouse are now returning in seconds with Amazon Redshift. Early estimates show the cost of Amazon Redshift will be well under 1/10th the cost of our existing solution. Amazon Redshift is providing us with a cost-effective way to scale with our growing data analysis needs.”

    Amazon reportedly also announced today that it has dropped the pricing for its S3 storage service by about 25%

    Earlier this week, Google announced some new features, lower prices and extended data center accessibility for its cloud platform, including a price reduction for its Cloud Storage offering, and the introduction of a limited preview of Durable Reduced Availability storage, which provides a lower price storage option for users. More on all of that here.