You are in:

Week 9: MapReduce

Lecture notes:

MapReduce - Lecture notes

MapReduce - Lecture slides (6 per page)

Supplemental notes:

MapReduce: Simplified Data Processing on Large Clusters: by Jeffrey Dean and Sanjay Ghemawat, Google, 2004
The definitive paper on MapReduce
MapReduce: The programming model and practice: Jerry Zhao, Jelena Pjesivac-Grbovic, SIGMETRICS'09 Tutorial, 2009
Google tutorial on MapReduce
MapReduce.org: A site that keeps up on information related to MapReduce: tutorials, deployments, and more.
Amazon Elastic MapReduce: Amazon's MapReduce service
Google: MapReduce in a Week: Google Code University
MapReduce Course: Three-day MapReduce Cource by Google at MIT: a part of 2008 Independent Activities Period at MIT

Buzzwords:

Master, worker, map worker, reduce worker, map, reduce, partition function, shards, intermediate files, pinging,

For questions or comments about this site, contact Paul Krzyzanowski, gro.kp@ofnibew

The entire contents of this site are protected by copyright under national and international law. No part of this site may be copied, reproduced, stored in a retrieval system, or transmitted, in any form, or by any means whether electronic, mechanical or otherwise without the prior written consent of the copyright holder. If there is something on this page that you want to use, please let me know.

Any opinions expressed on this page do not necessarily reflect the opinions of my employers and may not even reflect mine own.

Last updated: December 21, 2011

Week 9: MapReduce

Contents

CS 417

CS 417 background