Hadoop TopNWordCount Informations

Hadoop TopNWordCount Informations

Various Application Hadoop Version 2Code

• http://www.slideshare.net/andreaiacono/mapreduce-34478449

New Version Tutorial

• http://www.slideshare.net/sh1mmer/upgrading-to-the-new-map-reduce-api

 

TreeMap Information

• http://starcards.kr/220005458703

 

 

How to connect jobs

• http://gb-solutions.org/web/guest/wiki/-/wiki/Main/MapReduce+Job%EB%93%A4%20%EC%97%B0%EA%B2%B0%20%ED%95%98%EA%B8%B0

 

The number of map tasks

• 64MB / 3.3GB

 

http://gb-solutions.org/web/guest/wiki/-/wiki/Main/MapReduce+Job%EB%93%A4%20%EC%97%B0%EA%B2%B0%20%ED%95%98%EA%B8%B0

 

Chained Reducers

• https://hadoop.apache.rg/docs/current/api/org/apache/hadoop/mapred/lib/ChainReducer.html -

 

How to improve performance

• http://blog.cloudera.com/blog/2009/12/7-tips-for-improving-mapreduce-performance/

 

Various Drivers

• http://www.programcreek.com/java-api-examples/index.php?api=org.apache.hadoop.mapred.JobClient

 

희석이 블로그 - http://blog.naver.com/hisukdory

 

Actually, in-Mapper function's performance is better than a standard combiner.

• http://alpinenow.com/blog/in-mapper-combiner/

Install Single Node

• http://wcwtmt.blog.me/10167978289

Make Jar file

• http://cs.smith.edu/dftwiki/index.php/Hadoop_Tutorial_1_--_Running_WordCount

Multiple inputs

• http://halitics.blogspot.kr/2013/10/multiple-input-files-example-prog.html

SortedByValues

• http://www.valleyprogramming.com/blog/simple-hadoop-mapreduce-tutorial-example-boulder-colorado
• http://www.mkyong.com/java/how-to-sort-a-map-in-java/
•  

Creating a jar file rm -rf TopWordCount_classes mkdir TopWordCount_classes javac -classpath /usr/lib/hadoop/hadoop-core-1.2.1.jar -d TopWordCount_classes TopWordCount.java jar -cvf TopWordCount.jar -C ./TopWordCount_classes/ . class=./$1-class rm -rf $class mkdir $class javac -cp "/usr/lib/hadoop/*:/usr/lib/hadoop/lib/*" -d ./$1-class ./$1.java jar -cvf $1.jar -C ./$1-class/ .     Running on Hadoop   hadoop jar TopWordCount.jar TopWordCount input.txt outputIn hadoop fs -get outputIn/part-00000 TopWordCount.txt