Reading drill

  • Published on
    17-Jul-2015

  • View
    151

  • Download
    0

Embed Size (px)

Transcript

<ul><li><p>DrillKai Sasaki(@Lewuathe)</p></li><li><p> (@Lewuathe) </p><p> Hadoop, Storm </p><p> Spark MLLib </p><p> Big DataDeep Learning</p></li><li><p>Apache Drill MapRSQL </p><p> GoogleDremel </p><p> Impala (http://impala.io/) </p><p> Phoenix (http://phoenix.apache.org/) </p><p> Presto (https://prestodb.io/) </p></li><li><p> Drill </p><p> Drill </p><p> Drill </p></li><li><p>Dremel Google </p><p> BigQuery </p><p> Dremel: Interactive Analysis of Web-Scale Datasets"</p></li><li><p>Dremel</p><p> Columnar Storage Format </p><p> NodeAggregation </p></li><li><p>Columnar Storage Format</p><p>http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf</p></li><li><p>Columnar Storage Format</p><p>http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf</p></li><li><p>Columnar Storage Format</p><p>http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf</p><p>instantiate</p></li><li><p>Columnar Storage Format</p><p>http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf</p><p>CSF</p><p>r: Repetition Level d: Definition Lebels</p><p>Definition Level</p></li><li><p>Columnar Storage Format</p><p>http://static.googleusercontent.com/media/research.google.com/ja//pubs/archive/36632.pdf</p><p>CSF</p><p>r: Repetition Level d: Definition Lebels</p><p>Loss Less</p><p>Definition Level</p></li><li><p>Agility IT </p><p>Flexibility </p><p>Familiarity ANSI SQLJDBC/ODBCBI</p></li><li><p>Agility</p><p>Embedded Mode service </p><p>Distributed Mode ProductionDrillbitZooKeeper</p></li><li><p>AgilityDistributed ModeCookbook</p><p>https://supermarket.chef.io/cookbooks/drill</p></li><li><p>Flexibility Data SourcePlugin</p></li><li><p>Flexibility Data SourcePlugin</p></li><li><p>Familiarity,'%&amp;'3+..7-.1&amp;$. !.10'10/$+05(/2 #10'10!(/2#.10'10/$+05(/2 #10'10!(/2#')4#.10'10"6($5*(3,410#.10'10')4#.10'10"6($5*(3,410#.10'10.10'100$/(.10'100$/(!810'10!(/2810'10!(/28888</p><p>3164(.(&amp;5('4(&amp;10'4</p><p>JSONjoin</p></li><li><p> SQLLine </p><p>RDBMS </p><p> OptiqJDBCSQL"</p><p> DrillbitDrill</p></li><li><p>SQLLine</p><p>1. </p><p>Optiq</p><p>DrillClient</p><p>Drillbit Drillbit Drillbit Drillbit Drillbit</p></li><li><p>SQLLine</p><p>1. </p><p>Optiq</p><p>DrillClient</p><p>Drillbit Drillbit Drillbit Drillbit Drillbit</p><p>2. JDBC</p></li><li><p>SQLLine</p><p>1. </p><p>Optiq</p><p>DrillClient</p><p>Drillbit Drillbit Drillbit Drillbit Drillbit</p><p>2. JDBC</p><p>3. Logical Plan</p></li><li><p>SQLLine</p><p>1. </p><p>Optiq</p><p>DrillClient</p><p>Drillbit Drillbit Drillbit Drillbit Drillbit</p><p>2. JDBC</p><p>3. Logical Plan</p><p>4. ProtocolBufferPlan</p></li><li><p>SQLLine</p><p>1. </p><p>Optiq</p><p>DrillClient</p><p>Drillbit Drillbit Drillbit Drillbit DrillbitForeman</p><p>2. JDBC</p><p>3. Logical Plan</p><p>4. ProtocolBufferPlan</p><p>5. Foreman</p></li><li><p>SQLLine</p><p>1. </p><p>Optiq</p><p>DrillClient</p><p>Drillbit Drillbit Drillbit Drillbit DrillbitForeman</p><p>2. JDBC</p><p>3. Logical Plan</p><p>4. ProtocolBufferPlan</p><p>5. Foreman</p><p>6. Planfragment</p></li><li><p> JDBC, ODBCSQL </p><p> SPOF </p><p> Fragment</p></li><li><p>ContributionSQL Functions Add, AVG, ConvertSQLexec/java-exec/src/main/java/org/apache/drill/exec/expr/fn/impl </p><p>New File FormatXML, Apache Avro, Thrift"</p><p>New Data Source Apache Solr, Elastic Search, MySQL, HTTP URL </p><p>New Query LanguagePig Latin, HiveQL</p></li><li><p> DrillSelf-DrivenSQL </p><p> SQL </p></li></ul>