Аналитика Больших Данных . Command Line ... Обработка запросов и хранение ... Аналитика журнальных данных на

  • Published on
    07-Feb-2018

  • View
    223

  • Download
    5

Embed Size (px)

Transcript

  • 1 EMC CONFIDENTIALINTERNAL USE ONLY

    Greenplum ,

  • 2 EMC CONFIDENTIALINTERNAL USE ONLY

    Greenplum

    :

    : (Data Science):

    Greenplum

  • 3 EMC CONFIDENTIALINTERNAL USE ONLY

    (EDW)

  • 4 EMC CONFIDENTIALINTERNAL USE ONLY

    MPP

    Tools

  • 5 EMC CONFIDENTIALINTERNAL USE ONLY

    Hadoop

    / Web 2.0

  • 6 EMC CONFIDENTIALINTERNAL USE ONLY

    ,

    290,000,000

    250,000,000

    1,000,000,000

    4,000,000

    2,800,000,000

    31,000,000,000

  • 7 EMC CONFIDENTIALINTERNAL USE ONLY

    Greenplum

  • 8 EMC CONFIDENTIALINTERNAL USE ONLY

    Greenplum

  • 9 EMC CONFIDENTIALINTERNAL USE ONLY

    Hadoop

    Greenplum gNet

    Data Access & Query Layer

    GREENPLUM HD GREENPLUM DATABASE

    Java/Perl/Python Command Line PigLatin HQL ODBC JDBC

    /

    SQL HDFS

  • 10 EMC CONFIDENTIALINTERNAL USE ONLY

    Greenplum Chorus:

    open source

  • 11 EMC CONFIDENTIALINTERNAL USE ONLY

    1.

    2.

    3.

    4.

    5. -!

    6.

  • 12 EMC CONFIDENTIALINTERNAL USE ONLY

    Chorus

  • 13 EMC CONFIDENTIALINTERNAL USE ONLY

    ,

    ,

  • 15 EMC CONFIDENTIALINTERNAL USE ONLY

    ?

    ,

    2:

    1:

  • 16 EMC CONFIDENTIALINTERNAL USE ONLY

    :

  • 17 EMC CONFIDENTIALINTERNAL USE ONLY

    .

  • 18 EMC CONFIDENTIALINTERNAL USE ONLY

  • 19 EMC CONFIDENTIALINTERNAL USE ONLY

    ?

    , .

  • 20 EMC CONFIDENTIALINTERNAL USE ONLY

    EMC Greenplum

    ... ...

    ... ... -

    -

    Silver Spring .

  • 21 EMC CONFIDENTIALINTERNAL USE ONLY

    10 100.000 , 5 .

  • 22 EMC CONFIDENTIALINTERNAL USE ONLY

    !

  • 23 EMC CONFIDENTIALINTERNAL USE ONLY

    600. .

  • 24 EMC CONFIDENTIALINTERNAL USE ONLY

    600. :

    : Analytics Lab 600: + 6

    : ,

    : GP 1000: Data Computing Appliance ( ),

    36 ( ) : MADlib, R Chorus : Greenplum HD, VMWARE Gemfire

  • 25 EMC CONFIDENTIALINTERNAL USE ONLY

    :

    ? ? ?

    ? ?

    ?

  • 26 EMC CONFIDENTIALINTERNAL USE ONLY

    :

    , ,

  • 27 EMC CONFIDENTIALINTERNAL USE ONLY

    .

  • 28 EMC CONFIDENTIALINTERNAL USE ONLY

    SQL Server 2008

    ORACLE

    Analysis Server

    .NET Application

    Microsoft SSIS ETL

  • 29 EMC CONFIDENTIALINTERNAL USE ONLY

    Microsoft ACCESS

    LOG

    Parsing program

    Environmental Status at 05:57:30 CPU Temperature: Boot UProc: 86C below ProcHot Ap UProc: 84C below ProcHot Ap2 UProc: 85C below ProcHot Ap3 UProc: 83C below ProcHot DIMM Temperatures: DIMM 0: 15C DIMM 1: 15C DIMM Throttling: Channel 0: Off Channel 1: Off Channel 2: Off CPU Temperature: Boot UProc: 7C (88C below ProcHot) Ap UProc: 8C (87C below ProcHot) DIMM Temperatures: DIMM 0: 17C DIMM 1: 16C DIMM Throttling: Channel 0: Off Channel 1: Off Channel 2: Off MCH Temperature : 49 SLIC Temperature : 0 CPU Temperature : 0

    General Enclosure Status: PSA0: Inserted PSB0: Inserted Peer: Inserted Storage Processor Status: Motherboard Battery Low: FALSE Manufacturing Mode: TRUE PSA 0 MCU Status Power-Supply Firmware Version: 1B Slot ID: 44 System Over Temperature Status: FALSE System Temperature Celcius: 11 System Over Temp Thresh Celcius: 41 PS Threshold fault_mask0: 0h PSA 0 MCU Power Status: Fault Status: NO FAULT DC present: FALSE AC fail: FALSE Other PS is faulted: FALSE key: f = faulted; ok = not faulted ------------------------------------ Power Status Details | V1 | V2 | ------------------------------------ Inactive | ok | ok | Disabled | ok | ok | SP Voltage not inserted | ok | ok | Over Current | ok | ok | Over Voltage | ok | ok | Under Voltage | ok | ok | | | | Voltage Level |0331|0332| Current Level |001C|001A| ------------------------------------

  • 30 EMC CONFIDENTIALINTERNAL USE ONLY

    SQL Server 2008

    ORACLE

    Hadoop File

    System

    Greenplum

    Analysis Server

    .NET

    M A P R U D E E C

    M A D L I B

    LOG

  • 31 EMC CONFIDENTIALINTERNAL USE ONLY

    . ?

    DATA SCIENCE

  • 32 EMC CONFIDENTIALINTERNAL USE ONLY

    POC

    -

    EMEA

    EMC - -

    LAB 1. 2.

    3.

    POBV

  • 33 EMC CONFIDENTIALINTERNAL USE ONLY

    ? Source: EMC Study, Data Science Revealed: A Data-Driven Glimpse into the Burgeoning New Field, December 5, 2011

    BI

    ,

  • 34 EMC CONFIDENTIALINTERNAL USE ONLY

    ?

  • 35 EMC CONFIDENTIALINTERNAL USE ONLY

    -

    ,

  • 36 EMC CONFIDENTIALINTERNAL USE ONLY

    EMC

    EMC (Data Science)

    -

  • 37 EMC CONFIDENTIALINTERNAL USE ONLY

    EMEA

    EMC - -

    LAB 1. 2.

    3.

    POBV

  • 38 EMC CONFIDENTIALINTERNAL USE ONLY

    ?

    Data Science Team Greeemplum EMEA riccardo.santi@emc.com

  • 39 EMC CONFIDENTIALINTERNAL USE ONLY

    THANK YOU

    MPP Hadoop , Greenplum Greenplum HadoopGreenplum Chorus: ? : Slide Number 17 ? EMC Greenplum !Slide Number 23 600. : : Slide Number 27 Slide Number 31 ? ? EMC (Data Science) ?Slide Number 39

Recommended

View more >