KnowledgeHub
Questions
Tags
Users
Search
Alex Rivera
|
Logout
Edit Question
Title
Body
public static class Map extends MapReduceBase implements Mapper MapReduceBase , Mapper and JobConf are deprecated in Hadoop 0.20.203 . What should we use now? Edit 1 - for the Mapper and the MapReduceBase , I found that we just need to extends the Mapper public static class Map extends Mapper <LongWritable, Text, Text, IntWritable> { private final static IntWritable one = new IntWritable(1); private Text word = new Text(); public void map(LongWritable key, Text value, OutputCollector<Text, IntWritable> output, Reporter reporter) throws IOException { String line = value.toString(); StringTokenizer tokenizer = new StringTokenizer(line); while (tokenizer.hasMoreTokens()) { word.set(tokenizer.nextToken()); output.collect(word, one); } } } Edit 2 - For JobConf we should use configuration like this: public static void main(String[] args) throws Exception { Configuration conf = new Configuration(); Job job = new Job(conf); job.setMapperClass(WordCount.Map.class); } Edit 3 - I found a good tutorial according to the new API : http://sonerbalkir.blogspot.com/2010/01/new-hadoop-api-020x.html
Tags (comma-separated)
Save Edits
Cancel