20 likes | 210 Views
Hadoop Institutes : kelly technologies is the best Hadoop Training Institutes in Hyderabad. Providing Hadoop training by real time faculty in Hyderabad.<br>www.kellytechno.com/Hyderabad/Course/Hadoop-Training<br>
E N D
[Type the document title] Map/Reduce Implementation Idea Execution on Clusters: 1.Input files split (M splits) 2.Assign Master & Workers 3.Map tasks 4.Writing intermediate data to disk (R regions) 5.Intermediate data read & sort 6.Reduce tasks 7.Return Map/Reduce Cluster Implementation: www.KellyTechno.com Page 1
[Type the document title] Execution: Fault Recovery: •Workers are pinged by master periodically –Non-responsive workers are marked as failed –All tasks in-progress or completed by failed worker become eligible for rescheduling •Master could periodically checkpoint –Current implementations abort on master failure www.KellyTechno.com Page 2