216
MAP REDUCE DESIGN PATTERNS
Course Code :15 CS 52L2 L-T-P : 3-0-0
Pre-requisite: NIL Credits: 3
Syllabus:
Design Patterns and MapReduce: Design Patterns, MapReduce History ,MapReduce and
Hadoop,Refresher, Hadoop Example: Word Count ,Pig and Hive. Summarization Patterns:
Numerical Summarizations, Pattern Description,Numerical Summarization, Examples, Inverted
Index Summarizations, Pattern Description, Inverted Index Example, Counting with Counters,
Pattern Description, Counting with Counters Example. Filtering Patterns: Filtering,Pattern
Description, Filtering Examples, Bloom Filtering, Pattern Description, Bloom Filtering
Examples, Top Ten, Pattern Description, Top Ten Examples, Distinct , Pattern Description ,
Distinct Examples. Data Organization Patterns.: Structured to Hierarchical, Pattern
Description , Structured to Hierarchical Examples, Partitioning, Pattern Description, Partitioning
Examples, Binning, Pattern Description, Binning Examples , Total Order Sorting , Pattern
Description , Total Order Sorting Examples, Shuffling, Pattern Description, Shuffle Examples,
Join Patterns: A Refresher on Joins, Reduce Side Join , Pattern Description, Reduce Side Join
Example, Reduce Side Join with Bloom Filter, Replicated Join , Pattern Description, Replicated
Join Examples , Composite Join ,Pattern Description , Composite Join Examples ,Cartesian
Product , Pattern Description, Cartesian Product Examples, Metapatterns Job Chaining, With
the Driver, Job Chaining Examples, With Shell Scripting, With JobControl, Chain Folding, The
ChainMapper and ChainReducer Approach, Chain Folding Example , Job Merging, Job Merging
Examples, Input and Output Patterns: Customizing Input and Output in Hadoop, InputFormat,
RecordReader, OutputFormat, RecordWriter , Generating Data, Pattern Description, Generating
Data Examples, External Source Output, Pattern Description, External Source Output Example,
External Source Input , Pattern Description, External Source Input Example , Partition Pruning ,
Pattern Description, Partition Pruning Examples , Final Thoughts and the Future of Design
Patterns: Trends in the Nature of Data, Images, Audio, and Video, Streaming Data, The Effects
of YARN, Patterns as a Library or Component.
Text Book:
1. Donald Miner and Adam Shook, MapReduce Design Patterns, O’reilly Media Inc, 2013
References:
1. Thomas Erl, Cloud Computing Design Patterns, Pearson Education, 2014
2. Christoph Fehling, Frank Leymann, Ralph Retter, Walter Schupeck, Peter Arbitter, Cloud
Computing Patterns: Fundamentals to Design, Build, and Manage Cloud Applications,
Springer, 2014
3. Bill Wilder, Cloud Architecture Patterns, Oreilly, 2012
4. Srinanth Perera, Thilina Gunarathne, Hadoop MapReduce Cook Book,
PACKT publishning, 2013