1 / 13

Hue HBase Browser

Hue HBase Browser. Kevin Wang, Platform Intern, Cloudera @ Kevinverse. Cloudera Hue. Web Interface for making Hadoop easier to use Aggregation of apps for each Hadoop component (e.g. Hive, Pig, Impala, Oozie , Solr , Sqoop , HBase ...). Product Mission - HBase Usage Size.

talli
Download Presentation

Hue HBase Browser

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hue HBase Browser Kevin Wang, Platform Intern, Cloudera @Kevinverse

  2. Cloudera Hue • Web Interface for making Hadoop easier to use • Aggregation of apps for each Hadoop component (e.g. Hive, Pig, Impala, Oozie, Solr, Sqoop, HBase...)

  3. Product Mission - HBase Usage Size • Industry Usage • Widespread HBase Usage • Meetups, HBaseCon • Community Need Organic Example Community Expresses Need for HBase UI

  4. Product Mission - Problem & Competition Lack of Accessibility • Hard for beginners Lack of Familiarity • Unfamiliarity with Key-Value Usability Challenges • Lack of any web UI • Lack of imaginative interface • Low-level • CDH - Command Line Competing Application HBase Manager’s Tabular View

  5. Project Purpose – Addressing this Need • Open HBase usage to non-technical people • Drive HBase adoption in startups/organizations • Solve a pain point with a good product • Knockout/JS/jQuery • Django • Thrift  Hbase

  6. Demo

  7. Technical Challenges - Design • Design Innovation • Problem: HBaseis a key-value store, not a traditional RDB • Solution: Collapse Sparse Data across HBase Tables HBase Browser Smartview Tabular View

  8. Technical Highlight - Scale • Scale • Problem: Performance on Millions of Columns • Solution: Lazy loading & Truncation using Thrift FilterString • Stream raw data cached MEM  DOM elements dynamically generated • b64encode binary data to preserve during ASCII dump • Detect schema on preview reading byte headers • Capped, Lazy Loaded & Bound to DOM via MVVM Pattern 5TB HBase Cluster Thrift 100MB Currently Streamed

  9. Technical Highlight - Flexible Searchbar • Flexible Searchbar • Problem: Need high-level tool for complex data fetching & analysis • Solution: Simple custom query language • Supports HBase filter language • Supports selection & Copy + Paste, Gracefully degrades in IE • Autocomplete Help Menu • Regenerate Rendered Position – Firefox Bug Prefix Scan Row Key Thrift Filterstring Column/Family Filters Scan Length Searchbar Syntax Breakdown

  10. Roadmap, Timeline & Next Steps Current • Ramp up for CDH 4.4 release • Tutorial Video & Blog Post • Tons of JIRAs Initial Release in Hue 2.5 Ship in CDH 4.4

  11. Pageviews Any Questions? Kevin, Platform Intern, Cloudera Follow me: @Kevinverse www.gethue.com Hue HBase Browser 250+ commits 20000+ lines of code ∞ cups of coffee

  12. Icons (more to come)

  13. Working Elements Arrows

More Related