Collaborative Big Data Analytics. Copyright 2012 EMC Corporation. All rights reserved.

Transcription

1 Collaborative Big Data Analytics 1

2 Big Data Is Less About Size, And More About Freedom TechCrunch!!!!!!!!! Total data: bigger than big data 451 Group Findings: Big Data Is More Extreme Than Volume Gartner!!!!!!!!!!!!!!! Big Data! It s Real, It s Real-time, and It s Already Changing Your World IDC 2

3 Big Data Is Less About Size, And More About Freedom Techcrunch!!!!!! Findings: Big Get!!! Data Started Is More Extreme Than Volume Gartner!!!!!! Stop Talking, Total data: bigger than big data 451 Group!!!!!!!!! Big Data! It s Real, It s Real-time, and It s Already Changing Your World IDC 3

4 WHAT DOES IT TAKE? 8

5 1. New Applications 9

6 Build Big Data Analytics Applications Using Agile Development 10

7 2. Data Science 11

8 10 Years Of Patient History Saving Lives and Money With Data Science 12

9 3. The Right Platform 13

10 Big Data Requires a Unified Platform 3 People COLLABORATION & PRODUCTIVITY 2 Tools RICH SQL & APPLICATION SUPPORT 1 Data STRUCTURED UNSTRUCTURED 14

11 Big Data Requires a Unified Platform 1 Data STRUCTURED UNSTRUCTURED 15

12 MPP Databases x BETTER 1/10th T H E E D W C O S T 16

13 EMC Greenplum Database MPP Database For Structured Data Analysis Performance through parallelism Built for analytics Flexibility and choice 17

14 What used to take 24 hours on Oracle, I can do in less than 10 minutes on Greenplum. 18

15 In-Database Analytics Categories Data Access & Query Layer ODBC JDBC SQL Embedded Partner Open-Source Customized User-written Greenplum DB Embedded Analytics Greenplum Spatial SAS Scoring Accelerator SAS/HPA High Performance Analytics MADlib Open Source Analytical Algorithms Customized MADlib User-Written Analytical Algorithms GREENPLUM DATABASE 19

16 Enterprise Data Warehouse MPP Database Hadoop 20

17 We offloaded transformations to Hadoop and saved money on day one. Top Telecommunications Company 21

18 Introducing PIVOTAL HD The world s most powerful Hadoop distribution 22

19 HAWQ: The Crown Jewels of Greeplum High-Performance Query Processing Multi-petabyte scalability Interactive and true ANSI SQL support Programmable analytics Enterprise-Class Database Services Column storage and indexes Workload Management Comprehensive Data Management Scatter-Gather Data Loading Multi-level Partitioning 3 rd Party Tool & Open Client Interfaces 23

20 Pivotal HD Architecture HAWQ Advanced Database Services Pivotal HD Enterprise Resource Management & Workflow Yarn Zookeeper HBase Sqoop Xtension Framework ANSI SQL + Analytics Catalog Services Dynamic Pipelining Hadoop Virtualization (HVE) HDFS Data Loader Query Optimizer Pig, Hive, Mahout Map Reduce Flume Configure, Deploy, Monitor, Manage Command Center Apache Pivotal HD Added Value 24

21 HAWQ Benchmarks User intelligence Sales analysis Click analysis Data exploration 2.7 1,285 BI drill down 2.8 1,815 47X 19X 208X 476X 648X 26

22 HAWQ Benchmarks User intelligence Sales analysis Click analysis Data exploration BI drill down X 69X 25X 20X 21X 27

23 This Changes Everything TRUE SQL interfaces for data workers and data tools Broad range of data format support operate on data-in-place or optimize for query response time Single Hadoop infrastructure for Big Data investigation AND analysis 28

24 Big Data Requires a Unified Platform 2 Tools RICH SQL & APPLICATION SUPPORT 1 Data STRUCTURED UNSTRUCTURED 29

25 Analytics Means Different Things to Different People HIGH BUSINESS VALUE Predictive Analytics and Data Mining Business Intelligence (Descriptive) LOW Past TIME Future 30

26 Powerful Partner Ecosystem ANALYTICS BUSINESS INTELLIGENCE DATA INTEGRATION INDUSTRY Discovix TECHNOLOGY 33

27 Big Data Meets Fast Data GemFire Big data results delivered to modern apps In-memory performance Elastic scale-out Global, consistent view of data 34

28 Big Data Requires a Unified Platform 3 People COLLABORATION & PRODUCTIVITY 2 Tools RICH SQL & APPLICATION SUPPORT 1 Data STRUCTURED UNSTRUCTURED 35

29 GREENPLUM CHORUS A Social Platform For Collaborative Data Science 38

30 Chorus Enables Collaborative Data Science Quickly deliver value from your data Share domain knowledge, content, and findings Keep teams productive as organizations change 39

31 Getting Started: Greenplum Analytics Labs Packaged solutions that produce business value and actionable results Drive line of business and IT collaboration Accelerate analytics capabilities on your data Leverage the expertise of Greenplum s Data Scientists Establish a strategic vision for analytics development 48

32 Closing Thoughts On Big Data Volume, Variety, Velocity Target Business Processes That Make an Impact Prove The Concept Prepare to Iterate Socialize Wins 49

33 Thank You 50

34