MapR: Testing
Test MapR Installation with pre-installed examples
<syntaxhighlight> [mapr@smuk01 ~]$ cd /opt/mapr/hadoop/hadoop-2.5.1/share/hadoop/mapreduce/ [mapr@smuk01 mapreduce]$ hadoop jar hadoop-mapreduce-examples-2.5.1-mapr-1501.jar
An example program must be given as the first argument. Valid program names are:
aggregatewordcount: An Aggregate based map/reduce program that counts the words in the input files. aggregatewordhist: An Aggregate based map/reduce program that computes the histogram of the words in the input files. bbp: A map/reduce program that uses Bailey-Borwein-Plouffe to compute exact digits of Pi. blocklocality: Checking Map job locality dbcount: An example job that count the pageview counts from a database. distbbp: A map/reduce program that uses a BBP-type formula to compute exact bits of Pi. grep: A map/reduce program that counts the matches of a regex in the input. join: A job that effects a join over sorted, equally partitioned datasets multifilewc: A job that counts words from several files. pentomino: A map/reduce tile laying program to find solutions to pentomino problems. pi: A map/reduce program that estimates Pi using a quasi-Monte Carlo method. randomtextwriter: A map/reduce program that writes 10GB of random textual data per node. randomwriter: A map/reduce program that writes 10GB of random data per node. secondarysort: An example defining a secondary sort to the reduce. sleep: A job that sleeps at each map and reduce task. sort: A map/reduce program that sorts the data written by the random writer. sudoku: A sudoku solver. terachecksum: Compute checksum of terasort output to compare with teragen checksum. teragen: Generate data for the terasort teragenwithcrc: Generate data for the terasort with CRC checksum terasort: Run the terasort terasortwithcrc: Run the terasort with CRC checksum teravalidate: Checking results of terasort teravalidaterecords: Checking results of terasort in terms of missing/duplicate records teravalidatewithcrc: Checking results of terasort along with crc verification wordcount: A map/reduce program that counts the words in the input files. wordmean: A map/reduce program that counts the average length of the words in the input files. wordmedian: A map/reduce program that counts the median length of the words in the input files. wordstandarddeviation: A map/reduce program that counts the standard deviation of the length of the words in the input files.
[mapr@smuk01 mapreduce]$ hadoop jar hadoop-mapreduce-examples-2.5.1-mapr-1501.jar pi 10 10 Number of Maps = 10 Samples per Map = 10 ... 15/03/27 03:17:26 INFO mapreduce.Job: map 0% reduce 0% 15/03/27 03:17:30 INFO mapreduce.Job: map 10% reduce 0% 15/03/27 03:17:31 INFO mapreduce.Job: map 20% reduce 0% 15/03/27 03:17:32 INFO mapreduce.Job: map 40% reduce 0% 15/03/27 03:17:33 INFO mapreduce.Job: map 50% reduce 0% 15/03/27 03:17:34 INFO mapreduce.Job: map 80% reduce 0% 15/03/27 03:17:35 INFO mapreduce.Job: map 100% reduce 0% 15/03/27 03:17:39 INFO mapreduce.Job: map 100% reduce 100% 15/03/27 03:17:39 INFO mapreduce.Job: Job job_1427394736582_0325 completed successfully ... Job Finished in 19.002 seconds Estimated value of Pi is 3.20000000000000000000
Test MapR with HiBench
See HiBench Testing