110 likes | 296 Views
25.Big Data with Hadoop and Cloud Computing
E N D
1. Big Data with Hadoop and Cloud Computing
2. �Big Data Processing� relevant for Enterprises Big Data used to be discarded or un-analyzed & archived.
Loss of information, insight, and prospects to extract new value.
How Big Data is beneficial?
Energy companies - Geophysical analysis.
Science and medicine - Empiricism is growing than experimentation
Disney � Customer behavior patterns across its stores, and theme parks
Pursuit of a �Competitive Advantage� is the driving factor for Enterprises
Data mining (Log processing, click stream analysis, similarity algorithms, etc.), Financial simulation (Monte Carlo simulation), File processing (resize jpegs), Web indexing
3. Cloud Computing ~ brings economy to Big Data Processing Big Data Processing can be implemented by HPC & Cloud.
1) HPC implementation is very costly w.r.t. CAPEX & OPEX.
2) Cloud Computing is efficient because of its paper use nature.
MapReduce programming model is used for processing big data sets.
Pig, Hive, Hadoop, � are used for Big data Processing
Pig - SQL-like operations that apply to datasets.,
Hive - Perform SQL-like data analysis on data
Hadoop - processes vast amounts of data; (Focal point)
Use EC2 instances to analyze �Big Data� in Amazon IaaS.
Amazon MapReduce reduces complex setup & Magt.
4. Cost Comparison of Alternatives
5. Future Direction Current Experiments & Identified areas
Social network analysis
Managing Data center
Collective Intelligence - Algorithms and Visualization techniques
Predictive analytics
Accelerators Exploration
Apache Whirr - Cloud-neutral way to run services
Apache Mahout - Scalable machine learning library
Cascading - Distributed computing framework
HAMA - define and execute fault tolerant data processing workflows
Exploration of LAMP-like stack for Big Data aggregation, processing and analytics
6. Download with Linkedin Username/Password
7. Download with Linkedin Username/Password
8. Download with Linkedin Username/Password
9. Download with Linkedin Username/Password
10. Download with Linkedin Username/Password