Case Study: Hosting 90 Terabytes by Using SQL Server 2008 R2 Parallel Data Warehouse
Microsoft has released the first case study of a customer, albeit internal to Microsoft, finding success using PDW. The customer is the Information Security Consolidated Event Management (ICE) 4.0. The data set of ICE is very similar to what many other customers collect. They capture, filter, store, and support queries of security events that occur across the Microsoft global corporate network. Here is the executive summary from the white paper:
When the Microsoft network security team needed to scale its data store to 90 terabytes, while increasing already strained data loading beyond 1 terabyte a day and improving query performance, it turned to Microsoft® SQL Server® 2008 R2 Parallel Data Warehouse. Parallel Data Warehouse enables large tables to be spread across multiple physical nodes. Each node has dedicated CPU, memory, and storage, and each runs its own instance of SQL Server. The resulting computing power enables the team to process up to 4 terabytes of new information per day into its data warehouse. The team has seen a twentyfold improvement in query performance as a result.
Additionally, there is a 10 minute video, where Pete Loveless, Senior Program Manager of Microsoft’s Network Security team where he describes the benefits and challenges of using PDW.
After reading the case study and watching the video, what questions do you have about PDW?