MapReduce as a master-slave infrastructure consists of two master-side severs and a large number of slave-side working nodes. In this paper, we derive a job completion reliability (JCR for short) model and a job energy consumption (JEC for short) model from a single-job perspective for a general MapReduce infrastructure in which no redundancy scheme is adopted on the master side, and a cold-standby scheme is employed on the slave side. Without loss of generality, the JCR model is derived based on a Poisson distribution. Through the simulation and analytical results, MapReduce managers and service providers can comprehend how this infrastructure behaves and how to improve the infrastructure so as to achieve a more reliable and energy-efficient MapReduce environment. ? 2013 IEEE.
Relation:
27th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2013 Proceedings - 27th International Conference on Advanced Information Networking and Applications Workshops, WAINA 2013,P.1642-1647